← Web Search LLM Leaderboard
MiniMax M3.1 Flash
MiniMax · open weights · data as of
MiniMax M3.1 Flash ranks 7 of 10 on the Web Search LLM Leaderboard, across 4,703 questions from BrowseComp, DeepSearchQA, HLE and Firecrawl Search Bench.
Score with Firecrawl Alexandria64.8
+40.5 points of lift, from 24.3 without050100
Without With Firecrawl Alexandria
MiniMax M3.1 Flash on each question set
Points out of 100. Rank is among the 10 models on that set, by score with Firecrawl Alexandria; vs median is the gap to the median model there. Firecrawl Search Bench is our own question set; its questions are not published.
| Question set | Without | WithWith Firecrawl Alexandria | Lift | Rank | vs median |
|---|---|---|---|---|---|
| BrowseComp | 3.0 | 38.0 | +35.0 | #9 | −18.4 |
| DeepSearchQA | 27.9 | 75.8 | +47.9 | #7 | −4.4 |
| HLE | 49.9 | 51.9 | +2.0 | #4 | +3.9 |
| Firecrawl Search Bench | 16.6 | 93.5 | +77.0 | #7 | −0.4 |
Cost and speed
$205 per 1,000 questions, model tokens plus Firecrawl credits: 0.9× the median model, 4th cheapest of 10.
- Time per question
- 407 s
- average, 9th fastest of 10
- Median time
- 269 s
- set-weighted, half take longer
- 90th percentile time
- 990 s
- set-weighted, 1 in 10 take longer
- Failed
- 0.2%
- of questions, scored 0
MiniMax M3.1 Flash vs its closest rivals
- Claude Haiku 5.5 scores 61.9, clearly behind. It is 1.2× cheaper and takes 156 s per question on average.
- GLM 5.3 Flash scores 61.9, clearly behind. It is 1.2× cheaper and takes 755 s per question on average.
- Mercury 3 scores 68.7, clearly ahead. It costs 1.2× as much and takes 214 s per question on average.
- Ranks count only the models clearly ahead, so models too close to call share a rank. How we tested →
- What score and lift mean →What is Firecrawl Alexandria? →Firecrawl search docs →
//
Get started
//
Ready to build?
Start getting web context for free and scale seamlessly as your project expands. No credit card needed.
Are you an AI agent? See setup options