Data & Analytics Skill
Airflow DAG Patterns
Build production Apache Airflow DAGs with best practices for operators, sensors, testing, and…
$15
Firecrawl CLI
Official Firecrawl CLI skill for web scraping, search, crawling, and browser automation.
A disciplined command-line workflow for web scraping, search, crawling, and browser automation that returns clean, LLM-ready markdown instead of messy HTML. It enforces a five-step escalation pattern: search, scrape, map, crawl, browser, so you never burn API credits or hammer a server when a lighter tool would do. Built around credit tracking, rate limiting, and robots.txt compliance so your data collection stays fast, polite, and legal.
$15 one-time
Add to a kit → Prices include 20% VAT. · Forged on real agency work · one-time, no lock-in
- Type Skill
- Category Data & Analytics
- Delivery Email · instant
- License One-time
Inside the run · no black box
See the actual work before you buy it.
Scraping escalates from cheapest call to full browser session, never the other way. Auth and credits get checked first, crawls respect politeness limits, results land in files read incrementally, and counts are verified before the job is called done.
- Gate check before anything fires: runs firecrawl --status to verify auth and remaining credits. An invalid API key returns silent empty JSON instead of an error, so this check always comes first.
- Escalates through five tiers and never skips ahead: no URL yet means search (with --scrape to pull full page content in the same call), a known URL means scrape with --only-main-content, a large site means map --search to locate the exact subpage first.
- Bulk extraction runs crawl with --include-paths, --limit, --delay and --max-concurrency set deliberately for crawl politeness: small sites get 500ms delay at concurrency 2, robots.txt is checked before any client-site crawl.
- Browser is the last resort, used only when scrape fails behind interaction: open the page, snapshot to get @ref element IDs, click or fill by ref, then scrape the rendered state. Never used for web search.
- Every result is written to .firecrawl/ with a naming convention and read incrementally via grep and head, never loaded whole. search --scrape output is reused instead of re-scraping the same URLs, which burns credits twice.
- Output is verified before continuing: result counts checked with jq and wc -l. If the file holds 20 percent fewer pages than expected, that signals a rate limit or auth failure, not a finished job.
One power source. 6 lines out.
firecrawl-cli · core
core active · 6 lines
- ✓ researching a topic and
Researching a topic and scraping the top results in one pass
- ✓ extracting clean markdown
Extracting clean markdown from articles and documentation pages
- ✓ mapping a large site to
Mapping a large site to locate a specific subpage before scraping
- ✓ bulk-downloading an entire
Bulk-downloading an entire docs section into local files
- ✓ pulling structured data
Pulling structured data (pricing tiers, product lists) from complex sites
- ✓ reaching content behind
Reaching content behind pagination, modals, or login via cloud browser sessions
Yours to keep.
Drag time forward. Watch what stays.
Forever
That's what owning means.
The rented stack
ai writing tool: subscription
expired · access lostanalytics suite: subscription
expired · access lostdesign platform: subscription
expired · access lost(nothing left)
Your forge
-
Stop wasting API credits: escalation logic and credit checks prevent redundant fetches
license: perpetual -
Get content your model can actually read, not raw HTML you have to clean
license: perpetual -
Avoid IP bans and legal exposure through built-in crawl politeness and robots.txt handling
license: perpetual -
Run independent scrapes in parallel up to your concurrency limit for faster collection
license: perpetual
subscriptions expire · deeds don't
Everything in the box.
Pick a piece up. Watch it work.
Five-command toolkit: search, scrape, map, crawl, and cloud browser automation
6 parts · one working system · ships instantly by email
This wasn't forged for everyone.
- Not for you if you'd rather rent a tool than own one.
- Not for you if you want someone else to run your stack.
- Not for you if you're happy guessing.
Developers, researchers, and AI engineers who need to feed clean, structured web content into LLM pipelines without managing scraping infrastructure.
then this was forged for you.Works with
Universal by design: these run in any AI. Delivered in the open Agent Skills + MCP format (native in Claude); ChatGPT, Gemini, Cursor and Copilot adapt the same files their own way.
- Claude Native format
- ChatGPT Adapts via open standards
- Gemini Adapts via open standards
- Cursor Adapts via open standards
- Copilot Adapts via open standards
Catch what's on your mind.
the air is clear. nothing between you and the forge.
catch a spark: the forge will answer
-
Do I need a Firecrawl account and key to use this?
Yes, it is a command-line workflow over the Firecrawl service, so it expects a key. The discipline is about spending those credits well, escalating only when a lighter call cannot answer.
-
Why bother with five steps, why not just crawl the whole site every time?
Crawl is the heaviest call, and a search or single scrape usually gets the answer for a fraction of the cost. The escalation order exists so you stop hammering servers and burning credits on work a lighter step already does.
-
Will it scrape pages behind a login or strong bot protection?
Browser automation handles JavaScript-rendered pages, but it is not built to defeat hard authentication or aggressive anti-bot walls. Where a site blocks automated access, this respects that rather than forcing through.
-
How is it delivered?
By email right after purchase: ready to run, downloaded instantly, no setup wait.
-
One-time or subscription?
A one-time purchase; no subscription or hidden fees. VAT (20%) is included.
-
Can I get a refund?
As a digital product, it can’t be refunded once downloaded. That’s why we show exactly what’s inside and who it’s for, right here.