Our first Launch Week is over! See the recap 🚀

August 29, 2024

•

Eric Ciarla imageEric Ciarla

Launch Week I / Day 4: Introducing Firecrawl /v1

Launch Week I / Day 4: Introducing Firecrawl /v1 image

Welcome to Day 4 of Firecrawl’s Launch Week! Today, we’re thrilled to announce our biggest release yet: Firecrawl /v1.

Introducing Firecrawl /v1

Firecrawl v1 is a more reliable and developer-friendly API that makes gathering any web data seamless. We’ve packed this release with numerous improvements and new features to enhance your web scraping experience. Let’s dive into the exciting updates!

1. New Scrape Formats

With v1, you now have the flexibility to choose your output formats. From markdown to screenshots, get your data exactly how you want it. You can even specify multiple output formats in a single request!

2. Improved Crawl Status

We’ve significantly enhanced our crawl status results:

  • Pagination by default for easy content streaming
  • A ‘next’ parameter to show which URL to query next
  • Improved clarity on errors, credits used, and crawl expiration

3. Enhanced Markdown Parsing

Our markdown parsing has been upgraded, with improved content cleaning by default. The onlyMainContent option is now set to true by default, resulting in cleaner text chunks and improved quality of LLM outputs.

4. V1 Support for All SDKs

We’ve bumped all our SDKs to version 1.0, ensuring full compatibility with the new v1 API. Don’t worry - they’re backwards compatible with v0 too! We’re also excited to introduce two new SDKs: GO and Rust. A big thanks to our amazing contributors @sanixdarker and @kentchiahaohsu for their work on these.

5. New /map Endpoint

As announced yesterday, our new v1 endpoint /map is the fastest way to gather and search for relevant links on a website. If you missed it, check out our previous post for more details.

6. Improved Developer Experience

We’ve enhanced the developer experience across all our API endpoints. This includes reducing complexity and providing more descriptive errors. For a smooth transition, check out our guide on how to migrate from v0: https://docs.firecrawl.dev/migrating-from-v0

A Milestone Achievement

We’re thrilled to announce that we’ve just hit 10,000 GitHub stars! This achievement wouldn’t have been possible without our amazing community, contributors, and partners. Thank you for your continued support and enthusiasm.

Check out our v1 documentation here: https://docs.firecrawl.dev/v1-welcome

And don’t forget to star our GitHub repo: https://github.com/mendableai/firecrawl

Stay tuned for our final day of Launch Week tomorrow. We can’t wait to show you what else we have in store!

Ready to Build?

Start scraping web data for your AI apps today.
No credit card needed.

About the Author

Eric Ciarla image
Eric Ciarla@ericciarla

Eric Ciarla is the Chief Operating Officer (COO) of Firecrawl and leads marketing. He also worked on Mendable.ai and sold it to companies like Snapchat, Coinbase, and MongoDB. Previously worked at Ford and Fracta as a Data Scientist. Eric also co-founded SideGuide, a tool for learning code within VS Code with 50,000 users.

More articles by Eric Ciarla