Minifetch Technical SEO API

Cheap robots.txt preflight before you call the Minifetch /extract and /run/seo-page-audit endpoints: returns whether the Minifetch user.

Listed — not yet verified

Visit website · Category: Search & Retrieval

What it does

Cheap robots.txt preflight before you call the Minifetch /extract and /run/seo-page-audit endpoints: returns whether the Minifetch user agent may fetch a target URL (allow/deny) plus its crawl-delay. If blocked or setting a crawl delay read https://minifetch.com/tutorials/unblock-minifetch . Checks the URL as given — does not follow redirects. Supports GET & POST

Audience: ai-agents, developers. Tags: crawl, extract.

Pricing

Pricing modelper-request
Price hint$0.001/request
Accepted tokensUSDC
Chainbase
Facilitatorcoinbase-cdp

How agents pay

  1. The agent sends a plain request and receives an HTTP 402 response describing the price and payment requirements.
  2. The agent signs a payment payload for the exact amount on base and attaches it to a retried request.
  3. The facilitator verifies and settles the payment, then the service returns the paid response.

Related services

Facet hubs for this service

Similar services in Search & Retrieval

  • Agent Utilities — Research outline 0.01 USDC (first pay · Base).
  • Agentic Reservations — Restaurant recommendations from the Blackbird network (~2,000 curated restaurants, mostly NYC and San Francisco).
  • Apify — Apify is the largest and most trusted marketplace of tools for web scraping, crawling, data extraction, and automation.
  • Book chapter — Paid book chapter (x402): Automate the Boring Stuff with Python: What Is Programming.
  • CoinGecko — Search onchain DEX pools and token, by contract address, name, or token symbol.
  • Email Auth SPF/DMARC/DKIM Check — Email authentication posture check: parses SPF, DMARC and DKIM plus MX for any domain and grades deliverability/anti-spoofing gaps (SPF.

Last updated: 2026-09-23

Last checked: 2026-09-28 — reachable. Weekly automated check, not continuous monitoring.