How do I connect Webhooks to Scrapernode?

Add your endpoint URL in Scrapernode's webhook settings. Scrapernode sends an HTTP POST with the full JSON payload when jobs complete. Verify delivery with a test scrape first.

What Twitter/X profiles data fields are sent to Webhooks?

All 22 output fields from the Twitter/X Profiles scraper are included: x_id, url, id, profile_name, biography, is_verified, and more. The full payload is sent as structured JSON — no fields are filtered out.

Can I schedule recurring Twitter/X scrapes to Webhooks?

Yes. Use the Scrapernode REST API to create scraping jobs programmatically on any schedule. Results are automatically delivered to Webhooks when each job completes.

How much does it cost to scrape Twitter/X profiles into Webhooks?

Each profiles record costs 1 credit. Credits start at $9 for 3,000 credits (Starter plan). The Webhooks integration itself is included free — no additional charges for data delivery.

What happens if the Webhooks delivery fails?

Scrapernode retries webhook deliveries with exponential backoff. Failed deliveries are logged and can be manually re-triggered from the job details page. Your scraped data is always available for download even if webhook delivery fails.

Twitter/XWebhooks

How to Scrape Twitter/X Profiles into Webhooks

Extract profiles data from Twitter/X and deliver via Webhooks automatically

Step-by-step guide

Choose the Twitter/X Profiles scraper

Navigate to the Twitter/X Profiles scraper in Scrapernode. Select "Fresh Scrape" for real-time data or "Quick Lookup" for pre-collected records. Each record costs 1 credit.

Set up your Webhooks connection

Add your endpoint URL in the Scrapernode webhook settings. Each completed job sends a POST request with the full JSON payload, including all output fields and metadata.

Provide your Twitter/X input URLs

Paste the Twitter/X URLs you want to scrape — one per line, or upload a CSV. Scrapernode accepts direct profile links, search result URLs, and content pages.

Launch the scraping job

Click "Start Extraction" to begin. Scrapernode handles proxy rotation, rate limiting, and anti-bot detection automatically. Jobs typically complete in under 60 seconds per batch.

Receive data in Webhooks

When the job completes, Scrapernode delivers the full JSON payload to your endpoint. Each record includes 22 structured fields like x_id, url, id, profile_name. Parse the payload in your application and process the data as needed.

Cost per record

1 credit

Output fields

22 fields

Destination

Webhooks

Sample Output

Preview the data you'll receive — 5 sample records

Record 1 of 5

X Id

sample_x_id

Url

sample_url

ACoAABcXYZ123

Profile Name

sample_profile_name

Biography

sample_biography

Is Verified

Yes

Profile Image Link

sample_profile_image_link

External Link

sample_external_link

Date Joined

sample_date_joined

Following

278

Followers

28,401,080

Subscriptions

1,000

Location

San Francisco, CA

Birth Date

sample_birth_date

Posts Count

2,998

Posts

Array [1]

Object {2}

content:"Excited to share our Series B news!"

likes:847

Suggested Profiles

sample_suggested_profiles

Is Business Account

Yes

Is Government Account

Yes

Category Name

sample_category_name

Max Number Of Posts

1,000

Banner Image

https://media.licdn.com/dms/image/v2/banner.jpg

Data Dictionary

22 fields returned per record

Unique X id of each profile (100.00% fill rate)

Profile URL (100.00% fill rate)

ID of the post (99.37% fill rate)

Profile username (99.80% fill rate)

Bio of the profile (73.37% fill rate)

Is the user verified (100.00% fill rate)

Profile Image link (99.44% fill rate)

External link (40.07% fill rate)

Date where the profile joined Twitter (99.37% fill rate)

Number of profiles the user follows (100.00% fill rate)

Number of followers of the profile (100.00% fill rate)

Number of subscriptions of the profile (100.00% fill rate)

Profile location (49.71% fill rate)

Profile birth date (0.90% fill rate)

Number of profile's posts (100.00% fill rate)

Profile posts (12.83% fill rate)

Sub-fields

post_idTextPost ID

textTextPost text

dateTextPost date

likesNumberNumber of likes

retweetsNumberNumber of retweets

Suggested profiles (44.81% fill rate)

Sub-fields

nameTextSuggested profile name

handleTextSuggested profile handle

urlTextSuggested profile URL

Is the profile a business account (100.00% fill rate)

Is it a government account (100.00% fill rate)

Category names (4.79% fill rate)

Sub-fields

nameTextCategory name

urlTextCategory URL

The number of posts input from discovery (33.62% fill rate)

The profile's banner image (51.45% fill rate)

Frequently Asked Questions

Common questions about How to Scrape Twitter/X Profiles into Webhooks

Ready to connect Twitter/X data to Webhooks?

Start extracting twitter/x profiles data and deliver via Webhooks in minutes.

Go to Twitter/X Profiles scraper Browse all integration guides

No code requiredAuto-delivery to Webhooks22 data fields