Firecrawl July 2024 Updates
We are excited to share our latest updates from July!
TLDR:
- We launched Firecrawl on Launch YC 🔥
- Improvements to Endpoints + Dashboard
- New Templates & Community Creations
- We are hiring a Developer Relations Specialist & Web Automation Engineer
Officially launched on YC 🧡
After three months and more than 8K stars, we have officially decided to launch Firecrawl on YC. It has been an incredible journey, and we are excited to continue building the best way to power AI with web data. Check out our launch (and leave an upvote 🙂)!
Improvements to Endpoints + Dashboard
This month, we made improving our core product a priority. This meant focusing time on speed, reliability, and our dashboard as well.
Specifically in these categories, we:
- Shaved off around 1 second for every scrape and crawl request
- Expanded scrape reliability for a bunch of new types of sites
- Added enhanced dashboard monitoring which allows you to see processes, timing, failures and more. Check it out on your Activity Logs page on the dashboard!
Look for even more speed and reliability improvements coming soon!
New Templates & Community Creations
Not only did we release some examples and templates this month, but we also witnessed incredible creations from our community. If you’re working on an interesting Firecrawl project, we’d love to hear about it! Give us a shout at @firecrawl_dev. Here are a few highlights:
- Firecrawl Web Data Ingestion UI Template (Link to repo)
- Generative UI with demo Firecrawl x Langchain by Brace Sproul from Langchain (Link to repo)
- Scraping Real Estate Data from Zillow by Sourav Maji (Link to post)
- Website Contraction Analysis with Google Gemini (Link to post)
We are hiring!
If you want to help build the best way to power AI with web data, we want to hear from you. Specifically, we are hiring for these roles:
- DevRel and Growth Specialist at Firecrawl (Link to post)
- Founding Web Automation Engineer (Link to job post)
That’s all for this update! Stay tuned for the next one 🚀
About the Author
Eric Ciarla is the Chief Operating Officer (COO) of Firecrawl and leads marketing. He also worked on Mendable.ai and sold it to companies like Snapchat, Coinbase, and MongoDB. Previously worked at Ford and Fracta as a Data Scientist. Eric also co-founded SideGuide, a tool for learning code within VS Code with 50,000 users.
More articles by Eric Ciarla
How to Create an llms.txt File for Any Website
Learn how to generate an llms.txt file for any website using the llms.txt Generator and Firecrawl.
FireGEO: Complete SaaS Template for GEO Tools
Skip 4-6 months of SaaS development with FireGEO's open-source Next.js starter kit. Pre-built auth, billing, and GEO tools included.
Announcing Firestarter, our open source tool that turns any website into a chatbot
Spin up a fully functional RAG chatbot from any website URL using Firecrawl and Upstash—clean markdown in, OpenAI-compatible API out, all in under a minute.
How Fire Enrich Works, Our Open-Source AI Data Enrichment Tool
Learn how Fire Enrich uses specialized AI agents and Firecrawl to transform email lists into rich company datasets with industry, funding, and tech data.
Cloudflare Error 1015: How to solve it?
Cloudflare Error 1015 is a rate limiting error that occurs when Cloudflare detects that you are exceeding the request limit set by the website owner.
Build an agent that checks for website contradictions
Using Firecrawl and Claude to scrape your website's data and look for contradictions.
Why Companies Need a Data Strategy for Generative AI
Learn why a well-defined data strategy is essential for building robust, production-ready generative AI systems, and discover practical steps for curation, maintenance, and integration.
Getting Started with OpenAI's Predicted Outputs for Faster LLM Responses
A guide to leveraging Predicted Outputs to speed up LLM tasks with GPT-4o models.