How Botpress Enhances Knowledge Base Creation with Firecrawl

At Botpress, we’re focused on making bot creation as seamless as possible for our users. A critical part of this process involves helping users efficiently populate their knowledge bases with existing content. That’s where Firecrawl has made a significant difference—enabling our platform to import content directly from websites with minimal effort.

Web scraping is essential for our knowledge base feature. It allows our users to leverage their existing web content without the manual work typically required. Before implementing Firecrawl, we were handling HTML to Markdown conversion ourselves, which demanded additional processing and ongoing maintenance.

What stood out most during integration was how little adaptation was needed. Unlike other solutions we evaluated, Firecrawl intelligently extracted relevant data right out of the box. This saved us substantial development time and resources—we didn’t have to manually parse page content to get the data we needed.

The support from the Firecrawl team has been exceptional. When we quickly hit the default usage limit due to our high volume, their team responded immediately and ensured we maintained access during this critical time. The stability of the platform has been impressive, with very few issues encountered since implementation.

If we had to stop using Firecrawl, we’d definitely miss the built-in HTML to Markdown conversion capability the most. Having this feature integrated into the service has significantly streamlined our workflow.

In one sentence: Firecrawl is the easiest way to extract relevant content from a website.

We’re excited to continue leveraging Firecrawl to enhance our knowledge base capabilities and provide even more value to our users.