Check the live URL, raw HTML, canonical and error response before diagnosing visibility. For Google AI search, also check the effective inclusion control and report prerequisites. A passing page test proves delivery; it does not prove indexing or an AI citation.
What you’ll learn
- What to inspect on the live page before inviting search traffic.
- How to write useful answers and keep evidence visible.
- How inherited Google AI controls and missing-report thresholds affect diagnosis.
Check the real published page
I would check the published URL before changing content or adding SEO markup.
Start with access, the actual page response and indexing intent. For Google AI visibility, also check the effective Search generative AI control.
An editor preview and a live website can behave differently. Publish a small representative page, then open its public address from a fresh browser session.
Create a homepage, a useful detail page and one article before doing the checks below. Include the navigation and action a real visitor needs. Record the public URLs and the date so you can repeat the check after a change.
This is a practical inspection guide. It does not establish that any particular AI builder passes every item or guarantees Google indexing.
1. Verify access and indexing intent
Public pages should load at the intended domain and return the expected successful status. Check the canonical HTTPS address and redirects from alternate hosts.
Read robots.txt and the page’s robots metadata. Confirm that public search pages are intentionally crawlable and indexable.
A CDN, security rule or login wall can also prevent access. Keep private account content private; it should not become public merely to satisfy a checklist.
Google’s AI search guidance includes allowing crawling at both the robots and infrastructure levels. Analytics bot filtering is a separate concern from serving a crawler a public page.
2. Inspect what the page contains
Read the initial HTML and the rendered page. Make sure the important answer, headings and links are available and make sense outside an editor preview.
Google documents a crawling and rendering process for JavaScript pages in its JavaScript SEO guide. A page can be rendered, but that is not a reason to hide essential content behind unnecessary interaction or a fragile client request.
Check the longest real title, a missing image and an empty state. A convincing sample layout does not establish that actual content remains readable.
Worked example: a page, an alternate host and a missing path
On October 31, 2026, I checked this guide on SiteKeen, an Astro site served through Cloudflare. This is a reproducible SEO inspection example, not a test of the AI builders shown above.
- The public guide returned 200 with its H1, article text and self-referencing canonical in the initial HTML. Chrome showed the same H1, canonical and opening paragraph.
- The
wwwversion returned 308 to the apex host, preserving the path and test query. I disabled automatic redirect following to inspect that first response. - A deliberately missing guide path returned 404 with
X-Robots-Tag: noindex, follow. It did not redirect to the homepage.
These checks establish what ordinary requests received. They do not show what a verified crawler received, whether Google indexed the page or whether an AI answer cited it.
Check the status as well as the message. A screen saying “not found” can still return 200. Google’s JavaScript SEO guidance explains meaningful statuses and soft-404 handling.
3. Give each page a distinct job
Choose a question or decision the page answers. A service page should describe the service and the next action. A comparison should explain differences that affect the choice. A review should separate documented capabilities from your own observations.
Use a useful page title and description. Keep one clear main heading and a hierarchy that helps readers scan. Write introductions that answer the main question early, then provide evidence, conditions and practical steps.
Google’s helpful-content guidance asks site owners to focus on useful, trustworthy information for people. Adding many lightly rewritten pages does not establish that value.
4. Check canonical URLs and links
Every indexable page should have a deliberate canonical address. Verify it after publishing and after changing a slug. Redirect an old URL when a meaningful replacement exists.
Use actual links for navigation and relevant next steps. Link a review to its comparison, a ranking to the tool profiles and a practical guide to the next task. Avoid linking every page to every other page simply to increase the count.
Check a useful 404 page and a sitemap containing your intended public URLs. A submitted sitemap is a discovery aid; it is not proof that Google has indexed the pages.
In Search Console, distinguish a submitted URL, a successful live test and an actually indexed URL.
5. Make the evidence easy to check
For changing software claims, give a source, date and scope. “GitHub sync is documented” is different from “we migrated this project successfully.” Explain plan conditions and service dependencies near the claim.
When publishing a ranking, define the audience and criteria. Explain why a tool is a useful first trial for that audience. If you have not tested it, do not add invented star scores or a tested badge.
Give readers practical examples and a way to correct the content. Update the conclusion when the evidence changes, rather than changing only the date.
6. Keep structured data aligned with the page
Use markup for the content that is actually present: organization, breadcrumbs, articles and an ordered list where there is a visible ranking. Keep names, URLs and item order consistent with the HTML.
Do not create review ratings, prices or firsthand results that the page cannot support. Google’s structured-data guidelines require markup to represent the visible page and warn against misleading information.
Correct markup helps describe content; it does not guarantee a rich result. Check syntax and eligibility separately from whether a feature appears in Search.
7. Review mobile usability and measurement
Use a narrow screen to complete the real task. Check navigation, heading wraps, forms, tables, touch targets and keyboard focus. An article should remain readable without horizontal page scrolling.
Verify analytics on the production domain with a real browser session. Record a page view without requiring a click when your configured measurement policy permits it.
Filter known bot traffic in the analytics layer while keeping public search pages accessible to crawlers.
Keep performance and measurement checks distinct: a test score does not prove that a normal browser sent an analytics event.
What changes for GEO and AI search?
Google’s current AI optimization guide keeps the SEO baseline: an indexed page eligible for a snippet, readable content and normal technical requirements. It does not require special AI schema or an llms.txt file.
The same guide also identifies a separate property-level condition: the site must be included in Search generative AI features in Search Console. A successful HTTP check cannot establish that setting, and eligibility still does not guarantee inclusion.
Our editorial approach is to make answers understandable and evidence inspectable. Use direct answers, clear conditions and checkable citations; none guarantees an AI citation.
Check the effective AI control, including its parent
Google documents Settings → Search generative AI in Search Console. The control can include the site, exclude it or inherit a parent’s value.
Google dates the worldwide rollout to August 31, 2026.
For a URL-prefix property, record the effective choice and its parent before proposing a change. A child property can inherit an exclusion even when its page permits indexing. Fixing its schema would not resolve that exclusion.
This control covers the specified Search AI features. It is separate from ordinary Search ranking and from Google’s AI-training control. I have not inspected or changed SiteKeen’s Search Console settings.
Treat an unavailable AI report as unknown
The Generative AI performance report includes impressions from supported Search AI features. Google says the report may be missing when the site has insufficient impressions; exclusion is another possible cause.
A missing report is not a measured zero.
When reconciling that report with analytics:
- Match the canonical page and report scope, rather than comparing an alternate URL with the whole property.
- Align dates: the report uses Pacific Time; your analytics view may use another timezone.
- Keep impressions separate from visits and conversions.
- Check placeholders before interpreting exports: Google says unavailable values shown as
~or-become zeros in the download.
The general AI-features overview also describes AI traffic within the aggregate Web performance data.
Use the specific report documentation for its current availability and dimensions; do not infer a feature-specific result from a Web total.
Separate search discovery, training and user-triggered fetching
OpenAI distinguishes OAI-SearchBot for search, GPTBot for training and ChatGPT-User for user-triggered visits. Perplexity distinguishes PerplexityBot search discovery from Perplexity-User fetches.
Review the purpose of each rule before changing it. A normal browser success, or a request with a copied bot name, does not prove access for a verified crawler. Keep any policy change subject to the site’s intended access choices.
Keep a small launch record
| Check | Evidence to save |
|---|---|
| Access and redirects | Public URL, status and redirect destination |
| Indexing intent | Robots policy, canonical and Search Console result |
| Content and links | The page’s main answer and working relevant links |
| Structured data | Valid syntax and agreement with visible content |
| Mobile task | Screen size and the action completed |
| Analytics | Production page view and collection response |
| Google AI eligibility | Effective inclusion choice, parent and report availability |
| Follow-up work | Failed checks, owner and the next repair |
Repeat the relevant items after a substantial content, template, domain or hosting change. A manageable record of observed results is more useful than an unsupported claim that a website is “SEO perfect.”
Next step: check one important public URL, its alternate host and one missing path. Save the responses and fix the first failed delivery or indexing check.
Then review the effective Google AI control and report prerequisites, recording unavailable account data as unknown.
Sources & scope
Capabilities are based on these official sources. Recommendations are editorial judgments. Hands-on scope: Public HTTP and Chrome checks of SiteKeen’s Astro/Cloudflare guide on October 31, 2026, including a www redirect and a missing URL. No AI-builder benchmark, verified crawler, Search Console account, indexing or AI-report result is claimed.
- Google AI features and your website ↗Checked Oct 31, 2026
- Google helpful, reliable content guidance ↗Checked Oct 31, 2026
- JavaScript SEO basics ↗Checked Oct 31, 2026
- General structured data guidelines ↗Checked Oct 31, 2026
- Google AI search optimization guide ↗Checked Oct 31, 2026
- Search generative AI control ↗Checked Oct 31, 2026
- Generative AI performance report ↗Checked Oct 31, 2026
- OpenAI crawler purposes ↗Checked Oct 31, 2026
- Perplexity crawler purposes ↗Checked Oct 31, 2026





