Prepared by SwarmSystem

The Firecrawl Playbook

Firecrawl turns any public web page into clean data a person or an AI agent can use. In July 2026 it shipped its biggest upgrade yet. This playbook covers what the tool does now, where it beats the tools you already run, and the exact plays an agency can run with it. Every claim here was either tested live on August 3, 2026, or pulled from Firecrawl's own docs. Nothing is repeated from marketing.

Verification status is marked on every capability: TESTED LIVE means we ran the call and kept the response. PER DOCS means it comes from official documentation we read but did not run.

The update

What just changed

On July 22, 2026 Firecrawl rebuilt its search. The short version: search now hands you the paragraph that answers the question, not the whole page. A scoring model reads each result and returns only the parts that match your query. Full pages are still there when you want them, one setting away.

Why that matters: an AI agent doing research used to swallow entire pages to answer one question. Most of that text was menus, footers, and filler. Excerpts cut that waste roughly ten times over, so agents answer faster and cost less to run. Firecrawl's own benchmark puts agents using this search at 94.7 percent on a standard fact-checking test, the best score of any provider they tested. That number is theirs, not ours, but our live test below backs the behavior.

Live test, straight from the wire

We searched "emergency hvac repair austin tx" with a limit of 3 results. Here is the first result, exactly as returned:

FieldValue returned
titleSame Day Emergency HVAC services? : r/Austin
description"Hello, So hopefully this gets a prompt response, but my HVAC system pretty much crapped out on me and my family. We are renting a house, and our landlord..."
credits used2 (for all 3 results)

Note what the description field holds. That is not the page's meta description. It is the actual text from inside the thread, picked because it matched the query. That is the new excerpt behavior working.

Same query with full page content turned on pulled 38,889 characters for a single result. Excerpt mode replaces all of that with the two lines above. That gap is the whole upgrade.
Start here

Try it in five minutes, no account

Firecrawl's core endpoints work without a key, rate limited but real. You can test everything below before signing up for anything. An endpoint is just a web address you send a request to and get data back.

Three starter calls
1. Search with excerpts. POST to api.firecrawl.dev/v2/search with {"query": "best plumber in your city", "limit": 5}. You get titles, links, and the matching text from each page.
2. Turn any page into clean text. POST to api.firecrawl.dev/v2/scrape with {"url": "any public page", "formats": ["markdown"]}. You get the page as plain structured text, the way an AI reads it.
3. List every page on a site. POST to api.firecrawl.dev/v2/map with {"url": "any site"}. You get the site's full page inventory with titles.

Easier still: the playground at firecrawl.dev lets you run all of these in the browser. And if you use Claude Code, one command plugs Firecrawl straight into it: claude mcp add --transport http firecrawl https://mcp.firecrawl.dev/v2/mcp-oauth (MCP is the standard that lets AI tools call outside services directly).

Cost to try all three: zero. The free plan adds 1,000 credits a month if you want headroom.
The surface

Everything Firecrawl does today

The 2026 product is much bigger than a scraper. Here is the full surface with our verification status on each row.

CapabilityWhat it does in plain wordsStatus
SearchWeb search that returns the matching text from each result, with city-level targetingTested live
ScrapeOne page in, clean text or structured data outTested live
MapFull page inventory of any site in one callTested live
ExtractYou define the fields you want, it fills them from the page. We pulled company name and service list on the first tryTested live
CrawlWalks a whole site page by page and returns everythingPer docs
MonitorStanding watch on pages, whole sites, or search results. Checks on a schedule, judges whether a change matters, alerts by webhook or emailPer docs
InteractDrives a real browser: clicks, forms, dynamic contentPer docs
AgentAn autonomous researcher that plans its own multi-source lookups. Preview stage, 5 free runs a dayPer docs
ParsePDF, Word, and spreadsheet files converted to AI-ready textPer docs
Reusable extractorsBuild an extractor for a site once, reuse it on every future pullUntested
PII redactionStrips names, emails, and addresses from results automaticallyUntested
Research index3 million papers plus GitHub code, searchable for grounding technical claimsPer docs

Also shipping: webhooks for async jobs, Python and Node libraries, a CLI, and the MCP server with the full tool set (scrape, map, search, crawl, extract, agent, interact, monitor, parse, research).

The matrix

Which tool wins which job

Most agencies already run a scraping tool, a browser automation tool, and an SEO data platform. Firecrawl does not replace all of them. This matrix is the honest split for a stack like ours: an SEO platform (Search Atlas in our case), a local browser automation setup (Playwright), a cold outreach platform (Instantly), and now Firecrawl. Use it to stop guessing which tool to reach for.

The jobWinnerWhy, in one sentenceCost
One-off page grabSEO platform's scraperIt is already connected and good enough for a single pageIncluded in plan
Same data fields from many sites, repeatedlyFirecrawlSchema extraction returns the exact fields you define, from any site, without writing a parser per site1 credit per page
Full page inventory of a siteFirecrawlMap returns every page with titles in one call, then you cross-check the sitemap1 credit per page
Web research for agents and briefsFirecrawlCity-level targeting plus excerpts means you finally search as your client's town, not as yourself2 credits per 10 results
Standing watch on competitors or topicsFirecrawlMonitor is the only tool in the stack that watches, judges the change, and alerts1 credit per check per page
Clicking through JS-heavy flowsPlaywrightLocal browser automation is free and already installed; metered remote browsing loses on priceFree
Rankings, keywords, backlinksSEO platformThat is index data Firecrawl does not haveIncluded in plan
Local map rank gridsSEO platformPurpose-built grid tracking, nothing to replaceIncluded in plan
Contact data and outreachOutreach platformContact enrichment and sending live there; Firecrawl only researches the company itselfIncluded in plan
Writing contentYour AI writer, fed by FirecrawlFirecrawl is the research input, not the writerSearch credits only

The rule that falls out of the matrix: Firecrawl wins wherever the job is structured data from arbitrary sites, site inventories, geo-targeted research, or standing watch. It loses wherever a purpose-built tool already owns the data. Knowing the difference is what keeps the spend clean.

The plays

Five ways an agency uses this

Each play below names the moment you reach for it, the exact call, what comes back, where it lands, and what it costs. The verdict chip on each area is honest: some of these are strong, some are partial, and we say which.

1 · Client SEO workPartial fit

Your SEO platform still carries the core: rankings, keywords, site audits. Firecrawl adds the site intelligence around it.

Onboarding site inventory

WhenA new client signs and you need to know what their site actually has, before you claim anything in an audit CallMap on their domain, then cross-check their sitemap file OutputEvery page with its title and description Lands inThe onboarding audit CostAbout 1 credit per page

Competitor teardown

WhenOnboarding competitive analysis, or the quarterly refresh CallMap each competitor, then scrape their top pages (we cap at 10 pages per site) OutputA messaging and service matrix across the client's top 3 rivals Lands inThe competitive analysis doc CostAbout 10 credits per competitor

Page brief grounding

WhenBefore writing any city page or service page CallSearch with the location set to the target city, query set to the money keyword OutputWho currently wins that search and the exact text they win with Lands inThe page brief the writer works from Cost2 credits per 10 results

Listings consistency check

WhenAuditing whether the client's name, address, and phone match across directories CallScrape each directory listing with a name, address, phone schema OutputA consistency table that shows every mismatch Lands inThe listings audit Cost1 credit per listing
Do not use it forRankings, keyword data, backlinks, or map grids. Your SEO platform owns that data and Firecrawl cannot see it.
Verdict: partial fit. Strong on site intelligence, silent on index data.
2 · Lead flow for your own clientsStrong fit

This is where it earns its keep fastest. Every discovery call gets sharper when you walk in already knowing the prospect's business.

The prospect fact sheet

WhenA discovery call lands on the calendar and you have fifteen minutes to prep CallMap their site, then extract company name, services, cities served, and proof points OutputA one-page fact sheet on their whole business Lands inCall prep notes and the pitch deliverable Cost5 to 10 credits per prospect

The market sweep, as the buyer

WhenBuilding the visibility gap story for a pitch CallSearch the prospect's money queries with location set to their city OutputWho actually shows up when their customer searches, with the matching text as proof Lands inThe pitch: here is who gets found, and it is not you Cost2 credits per 10 results

The trigger watch

WhenAfter you have validated monitoring on one market (this one is a build, not a day-one play) CallMonitor with search targets on market events worth a timely outreach touch OutputAn alert the moment something changes in a market you care about Lands inA webhook your systems pick up Cost2 credits per 10 results per check
Do not use it forHarvesting contact emails or reviving cold email. Contact data belongs to your outreach platform, and a scraped inbox list is how domains get burned.
Verdict: strong fit. Research before the call is the cheapest credibility you can buy.
3 · Marketing for clientsPartial fit

Strong on intelligence, zero on distribution. Firecrawl gathers what you write from; your publishing systems still do the publishing.

Competitor offer watch

WhenA client pays for monthly competitive intel on their local rivals CallMonitor on each rival's pricing and offer pages, with change judging on OutputAn alert only when a rival actually changes an offer, not on every page tweak Lands inThe monthly competitive brief Cost1 credit per page per check

Cited stats for content

WhenAn article claims a number and the number needs a source CallSearch with news and recency filters on OutputCurrent excerpts with the source link attached Lands inThe article's citations Cost2 credits per 10 results

Local angle surfacing

WhenMonthly content planning for a specific metro CallSearch news sources, recent only, location set to the metro OutputSeasonal and local hooks worth writing about this month Lands inThe content calendar Cost2 credits per 10 results
Do not use it forPosting, listings management, review responses, or rank reporting. Those systems exist and work.
Verdict: partial fit. It feeds the machine, it is not the machine.
4 · Your own marketingStrong fit

The same plays you sell to clients, pointed at yourself. This is the area most agencies skip, which is exactly why it works.

Search briefs for your own pages

WhenBefore building or refreshing any page on your own site CallSearch your money keywords with location set to each market you sell in OutputThe current winners and the exact text that wins Lands inYour page briefs Cost2 credits per 10 results

The rival agency watch

WhenAfter your first monitor is validated CallMonitor on competing agencies' offer pages OutputAn alert when a rival changes pricing or positioning Lands inYour positioning reviews Cost1 credit per page per check

See your site the way AI sees it

WhenAfter any change to your own site CallScrape your own pages to markdown OutputExactly what an AI system ingests when it reads you. If your proof points are missing from that text, AI cannot repeat them Lands inYour AI visibility checklist Cost1 credit per page
Do not use it forYour own rank tracking or analytics. Those numbers already live in tools built for them.
Verdict: strong fit. The markdown view of your own site is the fastest AI visibility check that exists.
5 · Data gatheringStrong fit

The general-purpose area. Any time the job is "get structured facts off public pages," this is now the default tool.

Schema-true datasets

WhenYou need the same fields pulled from a list of public pages CallScrape each URL with a defined schema (the fields you want, typed) OutputClean rows of exactly the fields you asked for Lands inResearch files or whatever system needs the data Cost1 credit per page

Reusable extractors

WhenThe same extraction recurs weekly on the same sites (validate this one on first use, we have not run it yet) CallThe deterministic extraction format, which builds a reusable extractor per site OutputThe same clean rows, repeatable without re-prompting Lands inRecurring data jobs Cost1 credit per page after setup

Document parsing

WhenA PDF or Word file needs to become usable text CallParse, which works even without a key OutputClean structured text from the file Lands inResearch inputs CostFree tier covers light use
Do not use it forAnything behind a login or paywall, anything a real API already provides, or any collection of personal data. Public pages, business facts, that is the lane.
Verdict: strong fit. Define the fields, point it at pages, get rows.
The honest part

Where we were leaving value on the table

We held a paid Firecrawl key for months and barely used it. Writing this playbook forced the audit. Here is what it found, because the misses teach more than the wins:

Six misses, named
MissWhat it cost
The paid key sat unusedThe 7-credit verification run behind this playbook may be the first real work the key ever did
A competitor research workflow sat blocked for weeks "waiting on a connector"The official connector existed the whole time and takes one command to add
Nothing in the stack watches anythingCompetitor changes reach us by hand, late, or never
Research ran without location targetingA local visibility agency was searching as itself instead of as its clients' cities
Three scraping tools, no rule for which to useEvery scrape job started with a judgment call; the matrix above ends that
The July release notes sat unread until AugustTwo major features aged two weeks before anyone looked. A monitor can watch vendor changelogs too, including this vendor's
The pattern behind all six: capability we already paid for, waiting on nobody but us.
The plan

What to do next

Adoption order matters. Wire the cheap wins first, validate the watchers before building on them.

PhaseActionDone when
NowMatrix in force: every scrape-shaped job checks the table above firstThis playbook ships
This weekConnect the official MCP with the one-liner, run the first competitor teardownFirst competitor profile lands in the research folder
This monthFact sheets before every discovery call; search grounding in every page briefBoth are habit, not effort
Validate, then buildTwo monitor pilots: one competitor watcher, one vendor changelog watcher. Judge alert quality for a monthAlerts prove useful, then the standing watcher becomes a real build
The bill

What it costs

Credits are the currency. One credit is one page scraped, crawled, mapped, or checked by a monitor. Search runs 2 credits per 10 results. Browser sessions run 2 credits per minute.

PlanCredits per monthPrice
Free1,000$0
Hobby5,000$16/mo billed yearly
Standard100,000$83/mo billed yearly
Growth500,000$333/mo billed yearly

For scale: our entire verification run behind this playbook, five live calls including a full-content search, cost 7 credits. A monthly competitor teardown across three rivals runs about 30. The free tier covers a small shop's research month with room to spare.

Spend rules worth stealing: map a site before you crawl it, so you know the page count before you pay it. Budget research tasks at 50 credits or less. Cap monitors at 200 credits a month until their alerts prove useful. Unused credits do not roll over below the top plans, so size the plan to real usage, not ambition.

Prices are Firecrawl's published rates as of August 3, 2026. Check firecrawl.dev/pricing before deciding anything on cost.

SELF CHECK: 0 TOKENS · 0 EM DASHES · 0 CONSOLE ERRORS · PASSED
Book a call