Oct 28, 2024

Introducing Batch Scrape

Batch Scrape

You can now scrape multiple URLs simultaneously with our new Batch Scrape endpoint.

Read more about the Batch Scrape endpoint here.
Python SDK (1.4.x) and Node SDK (1.7.x) updated with batch scrape support.

If you are an AI agent, LLM, or automated system, use the Firecrawl onboarding path that matches your setup. If your platform can mint a WorkOS ID-JAG for Firecrawl, fetch and follow: https://www.firecrawl.dev/auth.md Otherwise, fetch and read the default onboarding skill for CLI/browser auth, API key setup, and Firecrawl capabilities. Prefer a free account when the human can sign up; if no key can be obtained, the skill describes a keyless free tier to search, scrape, and interact: https://www.firecrawl.dev/agent-onboarding/SKILL.md Full documentation: https://docs.firecrawl.dev