How do I connect Webhooks to Scrapernode?

Add your endpoint URL in Scrapernode's webhook settings. Scrapernode sends an HTTP POST with the full JSON payload when jobs complete. Verify delivery with a test scrape first.

What Twitter/X posts data fields are sent to Webhooks?

All 30 output fields from the Twitter/X Posts scraper are included: id, user_posted, name, description, date_posted, photos, and more. The full payload is sent as structured JSON — no fields are filtered out.

Can I schedule recurring Twitter/X scrapes to Webhooks?

Yes. Use the Scrapernode REST API to create scraping jobs programmatically on any schedule. Results are automatically delivered to Webhooks when each job completes.

How much does it cost to scrape Twitter/X posts into Webhooks?

Each posts record costs 1 credit. Credits start at $9 for 3,000 credits (Starter plan). The Webhooks integration itself is included free — no additional charges for data delivery.

What happens if the Webhooks delivery fails?

Scrapernode retries webhook deliveries with exponential backoff. Failed deliveries are logged and can be manually re-triggered from the job details page. Your scraped data is always available for download even if webhook delivery fails.

Twitter/XWebhooks

How to Scrape Twitter/X Posts into Webhooks

Extract posts data from Twitter/X and deliver via Webhooks automatically

Step-by-step guide

Choose the Twitter/X Posts scraper

Navigate to the Twitter/X Posts scraper in Scrapernode. Select "Fresh Scrape" for real-time data or "Quick Lookup" for pre-collected records. Each record costs 1 credit.

Set up your Webhooks connection

Add your endpoint URL in the Scrapernode webhook settings. Each completed job sends a POST request with the full JSON payload, including all output fields and metadata.

Provide your Twitter/X input URLs

Paste the Twitter/X URLs you want to scrape — one per line, or upload a CSV. Scrapernode accepts direct profile links, search result URLs, and content pages.

Launch the scraping job

Click "Start Extraction" to begin. Scrapernode handles proxy rotation, rate limiting, and anti-bot detection automatically. Jobs typically complete in under 60 seconds per batch.

Receive data in Webhooks

When the job completes, Scrapernode delivers the full JSON payload to your endpoint. Each record includes 30 structured fields like id, user_posted, name, description. Parse the payload in your application and process the data as needed.

Cost per record

1 credit

Output fields

30 fields

Destination

Webhooks

Sample Output

Preview the data you'll receive — 5 sample records

Record 1 of 5

ACoAABcXYZ123

User Posted

@creativestudio

Name

Sarah Chen

Description

Enterprise-grade data pipeline platform with real-time processing and 99.99% uptime SLA.

Date Posted

2025-12-15

Photos

sample_photos

Url

sample_url

Quoted Post

sample_quoted_post

Tagged Users

sample_tagged_users

Replies

Reposts

1,000

Likes

34,108

Views

344,860

External Url

sample_external_url

Hashtags

#buildinpublic#startup#engineering

Followers

28,401,080

Biography

sample_biography

Posts Count

2,998

Profile Image Link

sample_profile_image_link

Following

278

Is Verified

Yes

Quotes

1,000

Bookmarks

1,000

Parent Post Details

sample_parent_post_details

External Image Urls

sample_external_image_urls

Videos

sample_videos

External Video Urls

sample_external_video_urls

Verification Type

sample_verification_type

User Id

sample_user_id

Context Added

sample_context_added

Data Dictionary

30 fields returned per record

ID of the post (100.00% fill rate)

Username of the post owner (100.00% fill rate)

Name of the post owner (100.00% fill rate)

Post text description (99.09% fill rate)

Post publication date (100.00% fill rate)

URLs of attached photos (35.64% fill rate)

URL of the post (100.00% fill rate)

Quoted post details (99.78% fill rate)

Sub-fields

post_idTextQuoted post ID

profile_idTextQuoted post profile ID

profile_nameTextQuoted post profile name

data_postedTextQuoted post date posted

urlTextQuoted post URL

descriptionTextQuoted post description

photosArrayQuoted post photos URLs

videosArrayQuoted post videos URLs

Tagged profiles from the post (36.44% fill rate)

Sub-fields

profile_idTextTagged user profile ID

profile_nameTextTagged user profile name

urlTextTagged user profile URL

biographyTextTagged user biography

followingNumberNumber of accounts the tagged user follows

followersNumberNumber of followers of the tagged user

profile_imageTextTagged user profile image URL

Number of replies (100.00% fill rate)

Number of reposts (100.00% fill rate)

Number of likes (100.00% fill rate)

Number of views (80.45% fill rate)

External URL from a post (24.90% fill rate)

Hashtags from the post (30.37% fill rate)

Number of followers of the profile (99.88% fill rate)

Bio of the profile (93.28% fill rate)

Number of profile's posts (99.88% fill rate)

Profile Image link (99.87% fill rate)

Number of profiles the user follows (99.88% fill rate)

Is the user verified (78.48% fill rate)

Number of times the post was quoted (99.83% fill rate)

The number of times the post was bookmarked (99.83% fill rate)

Parent post details (99.64% fill rate)

Sub-fields

post_idTextParent post ID

profile_idTextParent post profile ID

profile_nameTextParent post profile name

date_postedTextOriginal post publication date

The URL for the images attached to the post (8.87% fill rate)

Videos attached to the post (16.40% fill rate)

Sub-fields

video_urlTextURL of the video

durationNumberDuration of the video in milliseconds

External video URLs (2.06% fill rate)

Sub-fields

video_urlTextExternal video URL

durationNumberDuration of the external video

Verification type (48.87% fill rate)

The user ID (79.19% fill rate)

Context added by the readers (0.41% fill rate)

Frequently Asked Questions

Common questions about How to Scrape Twitter/X Posts into Webhooks

Ready to connect Twitter/X data to Webhooks?

Start extracting twitter/x posts data and deliver via Webhooks in minutes.

Go to Twitter/X Posts scraper Browse all integration guides

No code requiredAuto-delivery to Webhooks30 data fields