AI agent readiness scanner · aiscan.site
Dubai, United Arab Emirates
- Tweets 181
- Following 6
- Followers 5
- Likes 0
One prerender flag can hide your Astro Markdown from AI agents.
Prerendered pages skip middleware, so Accept: text/markdown got HTML, no Vary header.
Tip: drop prerender = true on routes serving Markdown.
Follow the website from the bio
#AIReadiness #Astro
3
An RBT exam prep site on WordPress scored C, 64/100 in AIScan.
It already welcomes 4 AI bots in its robots file and has an RSS feed. The gaps: its llms file returns 404, and markdown requests get HTML back.
Where does yours land?
3
Half of popular homepages can't tell a crawler "nothing changed."
On 3 Oct, 75 of 152 sent no ETag or Last-Modified header at all.
Tip: send an ETag, re-request with If-None-Match, expect a 304.
Follow the website from the bio
#AIReadiness #HTTPCaching
11
A two-way radio rental company on WordPress went from B, 75/100 to A+, 100/100 in about 12 hours.
Three changes did it: an llms file went live, its robots file now names 6 AI bots, and that file points to the sitemap.
No redesign needed. Test yours.
6
A modest fashion store in Bangladesh, built with Lovable, scored D, 40/100 in AIScan.
In a browser it's a full shop. An AI agent reading the raw HTML gets 9 words; the rest loads in JavaScript. Missing pages return 200, not 404.
How does yours read?
15
Stripe has a sitemap, but the usual path returns a 404.
In our 3 Oct check of 14 big sites, Stripe's file lived only where its robots file points.
Tip: put a full https Sitemap URL in your robots file.
Follow the website from the bio
#AIReadiness #Sitemap
3
"We can't control it, the client can't control it, something could go wrong and who's liable?"
Schwab CEO Rick Wurster, on AI agents that move client money. Schwab's answer: read-only access over MCP.
Give agents a door you control. #AIReadiness
2
Vercel Shop from @vercel and @Shopify is now GA: one product URL serves a page to people and readable product data (price, availability, options) to agents.
Any store, same rule: an agent should not have to parse your layout to find a price. #AIReadiness
1
48
Hugo can write Markdown for AI agents and still fail.
nginx served it as text/plain: Ubuntu's stock MIME list has no md entry.
Tip: map md to text/markdown in nginx, then test with an Accept header.
Follow the website from the bio
#AIReadiness #Hugo
6
A free WordPress security plugin's website scored C, 50/100 in AIScan.
The good part: a 48 KB llms file and an RSS feed. The gaps: markdown requests get HTML back, zero AI bot rules, and pricing data that skips the paid plans.
Where does yours land?
4
OpenAI's homepage refused a GPTBot user-agent but let a ClaudeBot one in.
Same IP: browser 403, ClaudeBot 200, GPTBot 403.
Tip: curl your site as each bot and compare status and size.
Follow the website from the bio
#AIReadiness #AICrawlers
9
A reporting dashboard for Shopify agencies was already A+ at 92/100. Its latest scan says 99.
The only check that changed: pricing. Its pricing page now describes paid plans with billing periods, not just the free tier.
One page, seven points. Test yours.
1
6
A UK software and AI company has scored D, 44/100 on all eight AIScan scans since Sep 22.
The basics are there: an llms file, 3,505 words of server-rendered text, clean HTTPS. Missing: markdown for agents, AI bot rules, an API catalog.
How does yours score?
3
A deleted llms file can still look healthy.
On a Replit app, the llms file and a fake path returned the same 200 page. Status checks stay green.
Tip: alert if a path that can't exist isn't a 404.
Follow the website from the bio
#AIReadiness #Monitoring
6
"There's no change to how Meta uses web crawlers." Meta's Andy Stone, @andymstone
Meta says its new crawl terms cover only ads and business products, from Oct 30.
Our take: robots rules apply per user agent. Name each Meta bot you mean.
#AIReadiness #AIBots
5
DeepSeek opened Search and Fetch APIs for agents, run on its own engine. It says it filters SEO spam, GEO manipulation and low-quality AI content.
Our take: tricks get filtered out. Clean, readable pages get fetched.
#AIReadiness #AISearch
20
Docusaurus dev mode lies about your MCP server card.
A typo'd card path got a 200 from the dev server. The production server gave a real 404.
Tip: build, test with docusaurus serve, read the body.
Follow the website from the bio
#AIReadiness #MCP
1
14
A Roblox script generator scored C, 63/100 in AIScan.
The good part: its llms file is live. The odd part: ask the homepage for markdown and the server answers with a 500 error. It also names zero AI bots in its robots file.
Where does yours land?
5
We graded 10 Instagram analytics tools for AI readiness: 8 to 100.
Social Blade got an F: 403 on its robots and llms files, and 3 words of text.
Tip: block every bot and agents see almost nothing.
Follow the website from the bio
#AIReadiness #Instagram
1
1
37
