Introducing the Firecrawl Developer Index, built for supercharging coding agents. Read the announcement →

Developer Search Index

Technical docs search
for coding agents

70M+ docs, READMEs, issues, and merged pull requests in one index, with the highest recall of any coding-specific index.

firecrawl developer "why is my retry backoff not firing on 429" --limit 10

issue:sidekiq/sidekiq#1471
Retries are not applied to 429 responses

The client treats 429 as a terminal status, so backoff never runs.

pull_request:aws/aws-sdk-js-v3#2384
fix(retry): honor Retry-After on 429

Adds 429 to the throttling error list so the standard retry applies.

doc:docs.stripe.com/rate-limits
Rate limits

Handle 429 responses with an exponential backoff before each retry.

Primary sources
70M+
Most sources refreshed
Daily
Plus an MCP server
1 API
To get started
No API key
//
Inside the index
//

The libraries your agents
ask about

70M+ technical docs[ NOT EXHAUSTIVE ]
Next.js
React
Vue
Svelte
Angular
Astro
Remix
Nuxt
Node.js
Deno
Bun
Vite
Tailwind CSS
Playwright
Expo
Next.js
React
Vue
Svelte
Angular
Astro
Remix
Nuxt
Node.js
Deno
Bun
Vite
Tailwind CSS
Playwright
Expo
TypeScript
Python
Rust
Go
Swift
Kotlin
.NET
Flutter
Django
FastAPI
Flask
Rails
Laravel
Spring
tRPC
TypeScript
Python
Rust
Go
Swift
Kotlin
.NET
Flutter
Django
FastAPI
Flask
Rails
Laravel
Spring
tRPC
PostgreSQL
Redis
MongoDB
SQLite
Supabase
Prisma
Kubernetes
Docker
Terraform
Cloudflare
Kafka
GraphQL
PyTorch
OpenAI
PostgreSQL
Redis
MongoDB
SQLite
Supabase
Prisma
Kubernetes
Docker
Terraform
Cloudflare
Kafka
GraphQL
PyTorch
OpenAI
Sources
70M+
Types
READMEs · issues · PRs · docs · specs
Browse the docs
[ 01 / 04 ]
·
Features
//
Built for coding agents
//

The sources your agent needs,
ranked and ready

70M+ artifacts

Primary sources, not web pages.

READMEs, issues, merged pull requests, docs, and OpenAPI specs.
readme:
vercel/next.js
issue:
sidekiq/sidekiq#1471
pull_request:
pydantic/pydantic#8291
doc:
docs.stripe.com/webhooks
Skill, CLI, MCP, and API

One line into any agent.

Claude Code, Cursor, and Codex search the index on their own.
terminal
$
npx -y firecrawl-cli@latest \
setup developer-index
firecrawl-developer-index ready
Wired into
Claude Code
Claude Code
Cursor
Cursor
Codex
Codex
ModelContextProtocol
MCP
Matched passages

The answer, not just the link.

Matched passages come back as markdown, so there is no second scrape.
issue:sidekiq/sidekiq#1471
github.com/sidekiq/sidekiq
matched passagemarkdown

The client treats 429 as terminal, so the

Semantic retrieval

Ask the way you'd ask a person.

Paste an error message, get the thread that solved it.
why is my retry backoff not firing on 429
Top matches
issue:sidekiq/sidekiq#1471#1
pull_request:aws/aws-sdk-js-v3#2384#2
doc:docs.stripe.com/rate-limits#3
Continuous refresh

Today's thread, not last quarter's.

Most sources land within a day of publishing.
index refreshlive
github.com/vercel/next.jsjust now
docs.stripe.com1 hr ago
github.com/pydantic/pydantic18 min ago
docs.astral.sh/uv4 min ago
Rich filters

Scope it down to one repo.

Filter by type, repo, language, topic, license, or stars.
narrow the index
types:issue
repos:vercel/next.js
language:Rust
min_stars:1000
license:MIT
sources:docs.stripe.com
70M+26.2Mresults
[ 02 / 04 ]
·
Benchmarks
//
DevDex, an open benchmark
//

The highest recall of any
coding-specific index

1,179 real developer queries. Scored deterministically, no model judge.
Recall@10, all tracks combined[ HIGHER IS BETTER ]
Firecrawl Developer Index
0.63
Firecrawl Search
0.58
Parallel
0.57
Mintlify
0.54
Exa
0.54
Context7
docs only
0.17
Native web search
0.45

Native web search is the control. With no search tool, the same model scores 0.01.

Repository discoveryTrails
0.76

Find the repo behind a capability, without its name.

Best on this track: Parallel·0.82
Issues & pull requestsLeads
0.66

Find the bug report and the PR that fixed it.

Next best: Parallel·0.63
Documentation lookupTied
0.47

Find the page that answers a how-to question.

Statistically tied with Context7·0.47
Queries
1,179
Tracks
3
Driver
Claude Opus 4.8
Judge
None
Run it yourself
Trusted by 150,000+
companies
of all sizes
[ 03 / 04 ]
·
For AI agents
//
For AI agents
//

Built into the AI tools
you already use

Use Firecrawl from Claude CodeClaude Code Cursor WindsurfWindsurf and the agent harnesses your team already runs.
One command. Connect your agent to Firecrawl via our Skills/CLI or MCP.
npx -y firecrawl-cli@latest init --all --browser
Agent onboarding. Are you an AI agent? Fetch this skill to get an API key and start building.
cURL
curl -s https://firecrawl.dev/agent-onboarding/SKILL.md
curl -X POST \
  https://api.firecrawl.dev/v2/search/developer \
  -H "Content-Type: application/json" \
  -d '{
    "query": "retry backoff not firing on 429",
    "k": 10,
    "types": ["issue", "pull_request"]
  }'
No API key. Send one for higher rate limits.
[ 04 / 04 ]
·
FAQ
//
FAQ
//

Frequently asked questions

General
Using it
Benchmarks & pricing