Introducing Parallel Agents - Run multiple /agent queries simultaneously. Read more →
. .
.. ..+
.:.
.. .. .::
+.. ..: :.
.:..::. .. ..
.--:::. .. ... .:. ..
.. .:+=-::.:. . ...-.::. ..
::.... .:--+::..: ......:+....:. :.. ..
....... ::-=:::: ..:-:-...: .--..:: .........
.. . . . ..::-:-.. .-+-:::.. ...::::. .: ...::.:..
. -... ....: . . .--=+-::. :-=-:.... . .:..:: .:---:::::-::....
..::........::=..... ...:-.. .:-=--+=-:. ..--:..=::.... . .:.. ..:---::::---=:::..:...
..........::::.:::::::-::.-.. ...::--==:. ..-::-+==-:... .-::....... ..--:. ..:=+==.---=-+-:::::::-..
. .....::......:: ::::-::.---=+-:..::-+==++X=-:. ..:-::-=-== ---.. .:.--::.. .:-==::=--X==-----====--::+:::+...
..-....-:..::-::=-=-:-::--===++=-==-----== X+=-:.::-==----+==+XX+=-::.:+--==--::. .:-+X=----+X=-=------===--::-:...:. ....
....::::...:-:-==+++=++==+++XX++==++--+-+==++++=-===+=---:-==+X:XXX+=-:-=-==++=-:. .:-=+=- -=X+X+===+---==--==--:..::...+....+
..:::---.::.---=+==XXXXXXXX+XX++==++===--+===:+X+====+=--::--=+XXXXXXX+==++==+XX+=: ::::--=+++X++X+XXXX+=----==++.+=--::+::::+. ::.=...
.:::-==-------=X+++XXXXXXXXXXX++==++.==-==-:-==+X++==+=-=--=++++X++:X:X+++X+-+X X+=---=-==+=+++XXXXX+XX=+=--=X++XXX==---::-+-::::.:..-..
. .
.. ..+
.:.
.. .. .::
+.. ..: :.
.:..::. .. ..
.--:::. .. ... .:. ..
.. .:+=-::.:. . ...-.::. ..
::.... .:--+::..: ......:+....:. :.. ..
....... ::-=:::: ..:-:-...: .--..:: .........
.. . . . ..::-:-.. .-+-:::.. ...::::. .: ...::.:..
. -... ....: . . .--=+-::. :-=-:.... . .:..:: .:---:::::-::....
..::........::=..... ...:-.. .:-=--+=-:. ..--:..=::.... . .:.. ..:---::::---=:::..:...
..........::::.:::::::-::.-.. ...::--==:. ..-::-+==-:... .-::....... ..--:. ..:=+==.---=-+-:::::::-..
. .....::......:: ::::-::.---=+-:..::-+==++X=-:. ..:-::-=-== ---.. .:.--::.. .:-==::=--X==-----====--::+:::+...
..-....-:..::-::=-=-:-::--===++=-==-----== X+=-:.::-==----+==+XX+=-::.:+--==--::. .:-+X=----+X=-=------===--::-:...:. ....
....::::...:-:-==+++=++==+++XX++==++--+-+==++++=-===+=---:-==+X:XXX+=-:-=-==++=-:. .:-=+=- -=X+X+===+---==--==--:..::...+....+
..:::---.::.---=+==XXXXXXXX+XX++==++===--+===:+X+====+=--::--=+XXXXXXX+==++==+XX+=: ::::--=+++X++X+XXXX+=----==++.+=--::+::::+. ::.=...
.:::-==-------=X+++XXXXXXXXXXX++==++.==-==-:-==+X++==+=-=--=++++X++:X:X+++X+-+X X+=---=-==+=+++XXXXX+XX=+=--=X++XXX==---::-+-::::.:..-..
2 Months Free — Annually
Real-Time Agents
& Deep Research
Add web data to your real-time agentic loops
for deep research and competitive analysis with Firecrawl.
//
Used by over 500,000 developers
//
Trusted by 80,000+
companies of all sizes
companies of all sizes
10x
faster source collection
100k+
URLs crawled per project
24/7
scheduled refresh runs
Perfect for
Deep research agents
Power agent loops with search, scraping, and citations across many sources.
Market and competitive analysis
Track changes across competitors and industries with automated refresh workflows.
Technical investigations
Collect docs, PDFs, and long-form sources into consistent markdown or JSON outputs.
Research platforms
Build UIs with citations and audit trails using URLs, titles, and timestamps per chunk.
[ 01 / 03 ]
·
Use Cases
Deep research in progress...
Academic papers
0 found
News articles
0 found
Expert opinions
0 found
Research reports
0 found
Industry data
0 found
Ask anything...
How it works
Search for relevant sources
Call Firecrawl’s /search from your agents so each research question starts from a focused set of relevant sources instead of the open web.
Scrape or crawl content
Use /scrape or /crawl to pull docs, blogs, filings, and PDFs into markdown or JSON so your pipelines always ingest the same structure, no matter the site.
Keep citations attached
Keep URLs, titles, and timestamps on every chunk so you can show citations in the UI and audit how each answer was assembled.
Schedule refresh jobs
Schedule Firecrawl jobs for competitors and industry sources so your research stack tracks changes automatically without manual checks.
Run at larger scale
Run larger Firecrawl jobs across thousands of pages so you can scale research projects without adding new scraping infrastructure.
Feed your answer engine
Feed Firecrawl output into your answer engine or RAG stack so agents synthesize long-form answers backed by verifiable sources.
[ 02 / 03 ]
·
What Our Customers Say
//
Community
//
People love
building with Firecrawl
Discover why developers choose Firecrawl every day.
Firecrawl is an open-source framework that takes a URL, crawls it, and conver..."
Upload a CSV of emails and..."
Firecrawl is an open-source framework that takes a URL, crawls it, and conver..."
Upload a CSV of emails and..."
How Firecrawl compares to alternatives
| Feature | Firecrawl | Manual CSV uploads | Browser extensions | Generic scrapers |
|---|---|---|---|---|
| Structured markdown output | ||||
| Automatic scheduling & refresh | ||||
| JavaScript rendering | ||||
| URL metadata preserved | ||||
| Multi-tenant scoping | ||||
| API-first integration | ||||
| Built-in rate limiting & retries | ||||
| No manual intervention required |
Tutorials & Guides
11 AI Agent Projects You Can Build Today (With Guides)
Discover 11 practical AI agent projects with step-by-step guides, from research assistants to workflow automation.
Read tutorial →
Building a Local Deep Research Application with Firecrawl and Streamlit
Learn to build a web research tool that explores sources, synthesizes information, and provides comprehensive answers with citations.
Read tutorial →
Introducing Fireplexity, our Open Source AI Answer Engine
Build your own AI-powered answer engine with real-time web search and intelligent synthesis.
Read tutorial →
//
FAQ
//
Frequently
asked questions
Everything you need to know about this use case.
General
Firecrawl automates the “collect sources” step by searching, crawling, and scraping your target domains into clean markdown or JSON with URLs and timestamps attached. Your agents and analysts spend time on synthesis and analysis instead of manual copy-paste from websites.
Yes. Firecrawl processes HTML sites, PDF-heavy libraries, docs portals, and JS-rendered knowledge bases into structured output that keeps headings, sections, and links intact so you can cite and navigate the original sources.
Technical
You can define Firecrawl jobs that run on a schedule (daily, weekly, monthly) against the same domains and paths. Each run returns updated content with URLs and timestamps so you can diff changes, refresh embeddings, and keep research dashboards current.
Why Firecrawl?
The world's most comprehensive web data API. Our custom browser stack and semantic index deliver superior data quality across any website, handling more content types and edge cases than any competitor.
JavaScript rendering, dynamic content, and robust request handling built-in.
Process millions of pages with automatic rate limiting, caching, and distributed infrastructure.
Optimized scraping engine with parallel processing and smart caching for instant results.
Comprehensive docs, SDKs for all major languages, and dedicated support to help you succeed.
[ 03 / 03 ]
·
Pricing
Loading pricing...
FOOTER
The easiest way to extract
data from the web
data from the web
. .
.. ..+
.:.
.. .. .::
+.. ..: :.
.:..::. .. ..
.--:::. .. ... .:. ..
.. .:+=-::.:. . ...-.::. ..
::.... .:--+::..: ......:+....:. :.. ..
....... ::-=:::: ..:-:-...: .--..:: .........
.. . . . ..::-:-.. .-+-:::.. ...::::. .: ...::.:..
. -... ....: . . .--=+-::. :-=-:.... . .:..:: .:---:::::-::....
..::........::=..... ...:-.. .:-=--+=-:. ..--:..=::.... . .:.. ..:---::::---=:::..:...
..........::::.:::::::-::.-.. ...::--==:. ..-::-+==-:... .-::....... ..--:. ..:=+==.---=-+-:::::::-..
. .....::......:: ::::-::.---=+-:..::-+==++X=-:. ..:-::-=-== ---.. .:.--::.. .:-==::=--X==-----====--::+:::+...
..-....-:..::-::=-=-:-::--===++=-==-----== X+=-:.::-==----+==+XX+=-::.:+--==--::. .:-+X=----+X=-=------===--::-:...:. ....
....::::...:-:-==+++=++==+++XX++==++--+-+==++++=-===+=---:-==+X:XXX+=-:-=-==++=-:. .:-=+=- -=X+X+===+---==--==--:..::...+....+
..:::---.::.---=+==XXXXXXXX+XX++==++===--+===:+X+====+=--::--=+XXXXXXX+==++==+XX+=: ::::--=+++X++X+XXXX+=----==++.+=--::+::::+. ::.=...
.:::-==-------=X+++XXXXXXXXXXX++==++.==-==-:-==+X++==+=-=--=++++X++:X:X+++X+-+X X+=---=-==+=+++XXXXX+XX=+=--=X++XXX==---::-+-::::.:..-..