Webhook
A webhook is an automated message sent from one app to another the moment an event happens. Instead of constantly asking for updates, your app gets notified instantly.
Definition
A webhook is a lightweight way for one application to send real-time data to another whenever a specific event occurs. Rather than repeatedly polling an API to ask "is there anything new?", the source system pushes an HTTP request, usually a POST with a JSON payload, to a URL you provide the instant something changes.
How webhooks work
You register a callback URL with the provider. When an event fires, such as a payment succeeding or a scraping job finishing, the provider sends an HTTP request to that URL carrying the event details. Your endpoint receives the data and triggers whatever logic you want. Many providers sign the payload with a secret so you can verify it is authentic.
Why webhooks matter for automation and scraping
- Real-time reactions: kick off downstream workflows the moment data is ready.
- Efficiency: no wasted requests polling for changes, which avoids hitting rate limits.
- Scraping pipelines: a scraper can fire a webhook when a crawl completes so the next stage starts automatically.
Webhooks are a core building block of event-driven automation, connecting proxies, scrapers, and data tools without manual checks.
Examples
Stripe sending a webhook when a customer's payment succeeds
A scraping API POSTing results to your endpoint when a job finishes
GitHub triggering a CI/CD pipeline via a push webhook
Common Use Cases
Frequently Asked Questions
Keep Learning
All termsMCP (Model Context Protocol)
MCP (Model Context Protocol) is an open standard that lets AI applications connect to external tools, data sources and services through one consistent client–server interface.
Read definitionWeb Scraping
Web scraping is the automated extraction of data from websites — fetching pages programmatically and parsing their content into structured data.
Read definitionHTTP Proxy
An HTTP proxy is an intermediary server that forwards web (HTTP/HTTPS) requests on your behalf, able to read, cache and filter traffic at the application layer.
Read definitionRate Limiting
Rate limiting restricts how many requests a client can make in a given time, and it is one of the most common defenses scrapers must work around.
Read definition