How to Scrape Tweets From a User Profile

To scrape tweets from a user profile, run apidojo’s Tweet Scraper V2 on Apify with the query from:username in searchTerms, split into date windows for long histories. It returns each post with text, date and engagement at $0.40 per 1,000 tweets. For a timeline with each post’s replies, use apidojo’s Twitter Profile Scraper.

This guide covers both routes, how to collect a full history, and what each costs. Searching a user’s tweets by hand is covered in how to search tweets from a specific user. Every other collection task is mapped in how to scrape Twitter (X) data.

Which apidojo Actor Should You Use for a Profile?

Use Tweet Scraper V2 for a profile’s posts by keyword, date or engagement, and Twitter Profile Scraper when you also need the replies to each post. The table compares them.

Point	Tweet Scraper V2	Twitter Profile Scraper
Input	searchTerms with from:username, or twitterHandles	Profiles
Output	The account’s posts	The account’s posts plus their replies
Price	$0.40 per 1,000 tweets	$0.016 per profile, including 40 tweets, then per item
Filters	Any X search operator	Date filtering
Minimum	50 tweets per query	None

Prices and capabilities are from each actor’s listing on Apify (Tweet Scraper V2, Twitter Profile Scraper).

How Do You Scrape a Profile With Tweet Scraper V2?

You scrape a profile with Tweet Scraper V2 by putting from:username in searchTerms, adding filters, and running the actor. Listed below are the 4 steps.

1. Test from:username in X search to confirm the account is public.
2. Paste the query into searchTerms, adding -filter:retweets for original posts only.
3. Set sort to Latest and a maxItems cap.
4. Run and export the dataset as JSON, CSV or Excel.

{
  "searchTerms": ["from:NASA -filter:retweets"],
  "sort": "Latest",
  "maxItems": 5000
}

How Do You Scrape a Profile’s Full History?

To scrape a profile’s full history, split it into date windows, one query per window, because a single query on an active account can stop short. The actor’s own documentation shows a profile collected as two six-month windows (Apify).

{
  "searchTerms": [
    "from:NASA since:2024-01-01 until:2024-07-01",
    "from:NASA since:2024-07-01 until:2025-01-01",
    "from:NASA since:2025-01-01 until:2025-07-01"
  ],
  "sort": "Latest"
}

Generating windows in Python and merging them without duplicates is shown in how to scrape tweets by date range.

How Do You Scrape Several Profiles at Once?

Put one from: query per account in searchTerms, up to 5 per run, and turn on includeSearchTerms so each post is tagged with its account. Or group accounts in one query with OR: (from:NASA OR from:ESA) -filter:retweets. Tweet Scraper V2 allows one concurrent run (Apify).

What Filters Help When Scraping a Profile?

Search operators narrow a profile scrape to the posts you need before you pay for them. Listed below are the 6 most useful (twitter-advanced-search reference).

Keep	Query
Original posts only	from:username -filter:replies -filter:retweets
Replies only	from:username filter:replies
Threads by the author	from:username filter:self_threads
Posts with media	from:username filter:media
High-engagement posts	from:username min_faves:1000
Posts on a topic	from:username keyword

What Does a Profile Scrape Cost?

A profile scrape costs $0.40 per 1,000 tweets on Tweet Scraper V2, so an account with 20,000 posts costs about $8 to collect in full. Twitter Profile Scraper charges $0.016 per profile, which covers the first 40 tweets, then a per-item price. Tracking many competitor accounts over time is covered in how to build a competitor tweet tracker.