# Minifetch Technical SEO API

Cheap robots.txt preflight before you call the Minifetch /extract and /run/seo-page-audit endpoints: returns whether the Minifetch user.

- Status: Listed — not yet verified
- Category: [Search & Retrieval](https://x402looker.com/category/search-retrieval/)
- Website: https://minifetch.com

## What it does

Cheap robots.txt preflight before you call the Minifetch /extract and /run/seo-page-audit endpoints: returns whether the Minifetch user agent may fetch a target URL (allow/deny) plus its crawl-delay. If blocked or setting a crawl delay read https://minifetch.com/tutorials/unblock-minifetch . Checks the URL as given — does not follow redirects. Supports GET & POST

Audience: ai-agents, developers. Tags: crawl, extract.

## Pricing

- Pricing model: per-request
- Price hint: $0.001/request
- Accepted tokens: USDC
- Chain: base
- Facilitator: coinbase-cdp

## How agents pay

1. The agent sends a plain request and receives an HTTP 402 response describing the price and payment requirements.
2. The agent signs a payment payload for the exact amount on base and attaches it to a retried request.
3. The facilitator verifies and settles the payment, then the service returns the paid response.

## Related services

- [Maha Context Compiler](https://x402looker.com/service/maha-context-compiler/) — Compress long documents and RAG inputs into token-budgeted, deduplicated context packs with source-linked provenance.
- [PatentPulse — PatentPulse — global IP intelligence](https://x402looker.com/service/patentpulse-patentpulse-global-ip-intelligence/) — PatentPulse — global IP intelligence: USPTO/EPO/WIPO/JPO/CNIPA patent search, FTO analysis, SEP licensing, trademark clearance, prior art.
- [Mode x402 Trading Data](https://x402looker.com/service/mode-x402-trading-data/) — Mode-x402 is a complete library of signals and indicators for intelligent trading agents.

## Facet hubs

- Chain hub: [Base services](https://x402looker.com/chain/base/)
- Facilitator profile: [Coinbase Cdp](https://x402looker.com/facilitator/coinbase-cdp/)
- Price band: [Micro ($0.01 or less per request)](https://x402looker.com/price-band/micro/)

## Similar services in Search & Retrieval

- [Agent Utilities](https://x402looker.com/service/agent-utilities/) — Research outline 0.01 USDC (first pay · Base).
- [Agentic Reservations](https://x402looker.com/service/agentic-reservations/) — Restaurant recommendations from the Blackbird network (~2,000 curated restaurants, mostly NYC and San Francisco).
- [Apify](https://x402looker.com/service/apify/) — Apify is the largest and most trusted marketplace of tools for web scraping, crawling, data extraction, and automation.
- [Book chapter](https://x402looker.com/service/book-chapter/) — Paid book chapter (x402): Automate the Boring Stuff with Python: What Is Programming.
- [CoinGecko](https://x402looker.com/service/coingecko/) — Search onchain DEX pools and token, by contract address, name, or token symbol.
- [Email Auth SPF/DMARC/DKIM Check](https://x402looker.com/service/email-auth-spf-dmarc-dkim-check/) — Email authentication posture check: parses SPF, DMARC and DKIM plus MX for any domain and grades deliverability/anti-spoofing gaps (SPF.

Last updated: 2026-09-23
Last checked: 2026-09-28 — reachable. Weekly automated check, not continuous monitoring.
