BE DISCOVERABLE BY AI
robots.txt, sitemaps, canonicals, indexability and AI crawler access form the discovery foundation.
We never conflate an official standard, a vendor guideline, an evolving proposal, and an internal heuristic.
RFCs (e.g. RFC 9309 robots.txt), W3C standards, Schema.org official vocabularies.
Published vendor crawler documentation from OpenAI, Anthropic, Google, and Perplexity.
Emerging specifications such as llms.txt v2. Evaluated with limited weight and marked as evolving.
Directly observed HTTP responses, status codes, headers, and SSL parameters.
Internal algorithmic patterns detecting dead-end navigation or anti-patterns.
Early-stage agent discovery signals (e.g. MCP endpoints), labeled separately without score inflation.
Core Web Vitals cannot be fabricated from raw HTML fetches. Without real user CrUX metrics, performance hygiene strictly reports NOT_MEASURED.
Private IPv4/IPv6 ranges, loopback addresses, and cloud metadata endpoints fail closed before any TCP handshake to prevent SSRF vulnerabilities.
HTML&HTML audits public website surfaces, shows evidence for each finding, and prioritizes a fix path your technical team can execute.
Evidence boundary: External-model recommendation, ranking, citation, traffic or revenue is not guaranteed. Unavailable evidence stays NOT_MEASURED; code context stays REQUIRES_CONTEXT.
Paid delivery boundary: up to 30 evidence-bound page-level Markdown machine surfaces and a versioned ZIP delivery package.
HTML&HTML prepares your website for visibility, citation eligibility and recommendation opportunity across AI search experiences. It shows measurable website-side blockers that can prevent discovery, understanding and source consideration.
robots.txt, sitemaps, canonicals, indexability and AI crawler access form the discovery foundation.
GEO, AEO, LLMO, entity graphs, schema and answer extractability reduce machine ambiguity.
RAG/retrieval, original information, E-E-A-T, freshness and evidence support source eligibility.
AAO, accessible journeys, intact links, measurable referrals and clear CTAs connect AI discovery to commercial action.
Recommendations, rankings, citations, traffic, customers and revenue are not guaranteed. HTML&HTML measures website-side technical and content blockers; it does not claim control over external AI systems.