Launch Week I / Day 4: Introducing Firecrawl /v1
Welcome to Day 4 of Firecrawl’s Launch Week! Today, we’re thrilled to announce our biggest release yet: Firecrawl /v1.
Introducing Firecrawl /v1
Firecrawl v1 is a more reliable and developer-friendly API that makes gathering any web data seamless. We’ve packed this release with numerous improvements and new features to enhance your web scraping experience. Let’s dive into the exciting updates!
1. New Scrape Formats
With v1, you now have the flexibility to choose your output formats. From markdown to screenshots, get your data exactly how you want it. You can even specify multiple output formats in a single request!
2. Improved Crawl Status
We’ve significantly enhanced our crawl status results:
- Pagination by default for easy content streaming
- A ‘next’ parameter to show which URL to query next
- Improved clarity on errors, credits used, and crawl expiration
3. Enhanced Markdown Parsing
Our markdown parsing has been upgraded, with improved content cleaning by default. The onlyMainContent
option is now set to true by default, resulting in cleaner text chunks and improved quality of LLM outputs.
4. V1 Support for All SDKs
We’ve bumped all our SDKs to version 1.0, ensuring full compatibility with the new v1 API. Don’t worry - they’re backwards compatible with v0 too! We’re also excited to introduce two new SDKs: GO and Rust. A big thanks to our amazing contributors @sanixdarker and @kentchiahaohsu for their work on these.
5. New /map Endpoint
As announced yesterday, our new v1 endpoint /map
is the fastest way to gather and search for relevant links on a website. If you missed it, check out our previous post for more details.
6. Improved Developer Experience
We’ve enhanced the developer experience across all our API endpoints. This includes reducing complexity and providing more descriptive errors. For a smooth transition, check out our guide on how to migrate from v0: https://docs.firecrawl.dev/migrating-from-v0
A Milestone Achievement
We’re thrilled to announce that we’ve just hit 10,000 GitHub stars! This achievement wouldn’t have been possible without our amazing community, contributors, and partners. Thank you for your continued support and enthusiasm.
Check out our v1 documentation here: https://docs.firecrawl.dev/v1-welcome
And don’t forget to star our GitHub repo: https://github.com/mendableai/firecrawl
Stay tuned for our final day of Launch Week tomorrow. We can’t wait to show you what else we have in store!
Ready to Build?
Start scraping web data for your AI apps today.
No credit card needed.
About the Author
Eric Ciarla is the Chief Operating Officer (COO) of Firecrawl and leads marketing. He also worked on Mendable.ai and sold it to companies like Snapchat, Coinbase, and MongoDB. Previously worked at Ford and Fracta as a Data Scientist. Eric also co-founded SideGuide, a tool for learning code within VS Code with 50,000 users.
More articles by Eric Ciarla
Cloudflare Error 1015: How to solve it?
Cloudflare Error 1015 is a rate limiting error that occurs when Cloudflare detects that you are exceeding the request limit set by the website owner.
Build an agent that checks for website contradictions
Using Firecrawl and Claude to scrape your website's data and look for contradictions.
How to easily install requests with pip and python
A tutorial on installing the requests library in Python using various methods, with usage examples and troubleshooting tips
How to quickly install BeautifulSoup with Python
A guide on installing the BeautifulSoup library in Python using various methods, with usage examples and troubleshooting tips
How to Use OpenAI's o1 Reasoning Models in Your Applications
Learn how to harness OpenAI's latest o1 series models for complex reasoning tasks in your apps.
Introducing Fire Engine for Firecrawl
The most scalable, reliable, and fast way to get web data for Firecrawl.
Firecrawl July 2024 Updates
Discover the latest features, integrations, and improvements in Firecrawl for July 2024.
Launch Week I Recap
A look back at the new features and updates introduced during Firecrawl's inaugural Launch Week.