Scrape a webpage and convert it to clean, LLM-ready markdown or other formats. Handles JavaScript rendering, extracts main content, and returns structured data with metadata. Ideal for: content extraction, RAG data collection, web research, article summarization, data aggregation.

Search the web and get results with optional full content scraping. Supports web, news, and image search with query operators (site:, filetype:, exact phrases). Returns titles, descriptions, and URLs, with optional markdown content. Ideal for: web research, content discovery, competitive analysis, finding documentation, building RAG datasets.

Search the web for cryptocurrency and blockchain news using the Heurist FirecrawlSearchDigestAgent. This endpoint crawls and digests web search results about crypto topics, returning summarized content from news sources like Fortune, The Block, and CoinMarketCap. Supports time-filtered searches (past week, month, year) and advanced search operators. | Input: Takes a search query (without time words), optional result limit (default 10), and optional time filter (past week/month/year). Supports advanced search operators like OR, AND, site:domain.com, and quoted phrases. | Output: Returns an array of web search results with article titles, URLs, published dates, and full text content from crawled pages. Results are aggregated from major crypto news sources and financial websites. | Use cases: I need the latest Bitcoin and cryptocurrency news from major sources; Search for recent crypto market movements and corporate Bitcoin purchases; Get summarized web content about specific cryptocurrencies or blockchain topics; Find news about crypto mining, regulations, or market sentiment from the past week | Cost: 0.01 on base

Scrapes and analyzes web page content using Heurist's FirecrawlSearchDigestAgent, extracting key information and generating concise summaries. Perfect for gathering insights from documentation, articles, and web resources without manual reading. | Input: Requires a URL to scrape. Optionally accepts a wait time (in milliseconds) for page loading and a debug flag. | Output: Returns the processed and summarized content from the URL, the source URL, and a success status indicating whether the scraping was completed. | Use cases: I need to extract and summarize content from a documentation page; Scrape a web article and get the key information automatically; Analyze a URL and get a digest of its main content; Extract structured information from a web page for research | Cost: 0.01 on base

Extract structured data from web pages using natural language prompts via Heurist's FirecrawlSearchDigestAgent. Supports single URLs, multiple pages, and wildcard domain crawling to gather and digest web content based on your specific extraction requirements. | Input: Accepts a list of URLs (with optional wildcard patterns for domain crawling) and a natural language description of what data to extract from those pages | Output: Returns extracted structured data from the specified URLs based on your extraction prompt, or an error message if URLs are invalid or extraction fails | Use cases: I want to extract product information from multiple e-commerce pages; Extract all pricing data from a competitor's website using wildcards; Get structured data from news articles across a domain; Scrape and digest content from multiple URLs based on custom extraction rules | Cost: 0.01 on base