This is the news from Sunday 1 November. Read the latest news
Daily news
One AI training opt-out for Google and OpenAI, plus Claude Ultra
Today in 30 seconds
- Google, OpenAI, Anthropic and Microsoft back one AI training opt-out
- Anthropic renames Claude Max 20x to Ultra and drops the five-hour limit
- Google’s Gary Illyes says AI has made fake Googlebots worse
- Vercel Data Cache becomes Runtime Cache, and reads and writes get billed
- DoorDash says AI shopping agents sent only a few hundred orders
- Cloudflare’s new DNS page is now the only one, and it can change record types
- HTTP/3 made Delivery Hero’s app 17% faster, with Cloudflare’s help
- Tokio’s creator launches Topcoat for building web apps in Rust
- Apple tells stores how to fix the iPhone Duo’s cracked inner screen
Good morning. Today the big AI companies finally agree on something: one simple rule to keep your site out of AI training. We also have a new Claude plan, a Vercel bill change to check, and a camera app from a film director.
Google, OpenAI, Anthropic and Microsoft back one AI training opt-out
Four of the biggest AI companies will honour a single robots.txt rule that blocks AI training. Google, OpenAI, Anthropic and Microsoft have all committed to it. Before this, you had to block each company’s training bot one by one.
The rule uses a shared user agent called __usage_ai-training. Add Disallow: / under it to opt out, and Allow lines for any folders you are happy to share. Anthropic already supports it. Microsoft starts on 1 February 2027, Google in early 2027, and OpenAI says “in the coming months”. Google will treat the opt-out as a block on Google-Extended, its Gemini training crawler. It does not remove you from Google Search.
Why it matters This is the closest thing yet to one switch for AI training. It only covers future crawling, so it can’t undo what was already collected.
Yesterday I covered Bing’s version of this control. Now the rest of the big names are on board. My guide on how AI search finds your site explains which bots to keep and which to block.
Anthropic renames Claude Max 20x to Ultra and drops the five-hour limit
Anthropic’s top personal plan is now called Claude Ultra. It is the old Max 20x plan, still US$200 a month, and current subscribers move over automatically. Verified Ultra accounts no longer have a five-hour usage limit.
Ultra gives you 10 times the Pro plan’s weekly usage. A weekly limit still applies across all models, and Fable has its own weekly limit. Verification is automatic. If your Settings, Usage page shows no “Current session” bar, you are verified.
Why it matters Long coding or Cowork sessions no longer stop halfway through the afternoon. If you lean on Claude Code all day, the weekly cap is now the only number to watch.
I think the five-hour wall was the most annoying limit on any AI plan. I’m glad to see it go.
Google’s Gary Illyes says AI has made fake Googlebots worse
Gary Illyes from Google says bots that pretend to be Googlebot are a bigger problem now, and AI is the reason. Companies want content to train models, so some scrape the web while using a fake Googlebot name. His own test traps caught “Googlebot” visits from IP addresses that have nothing to do with Google.
He also called robots.txt a suggestion, not a lock. He is looking at signed bot requests, called Web Bot Auth, as a better way to prove who a bot is.
Why it matters A user agent that says Googlebot proves nothing. Check Google’s published IP ranges or do a reverse DNS lookup before you trust it. A firewall from Cloudflare or your host can block the fakes for you.
Vercel Data Cache becomes Runtime Cache, and reads and writes get billed
Vercel’s Data Cache is leaving beta and merging into Runtime Cache. Next.js fetch caching and unstable_cache move over with no code changes. Pro projects get 8 times more cache storage than before.
The catch is the bill. Cache reads and writes that used to be free will now be charged. Rates start at US$0.40 per million reads and US$4 per million writes. Hobby teams get 1 million reads and 200,000 writes free each month and move on 29 November. Pro teams will get a date by email.
Why it matters A busy Next.js site can make a lot of cache calls. Check your Data Cache usage in Observability now, before the first new bill arrives.
DoorDash says AI shopping agents sent only a few hundred orders
DoorDash says third-party AI agents have placed only “several hundred” orders so far. That is tiny next to the roughly 3 million deliveries it handles a day. CEO Tony Xu said most people still order in DoorDash’s own app.
DoorDash still wants to learn from agent makers, and it may advertise inside their agents later. Amazon blocks personal shopping agents, while Walmart welcomes them.
Why it matters AI shopping agents get a lot of hype, but real orders are still small. My advice for shop owners: make your products easy for agents to read, and keep your own checkout great. That is where the sales are today.
Cloudflare’s new DNS page is now the only one, and it can change record types
Cloudflare has retired its classic DNS records page. The new DNS records experience, first shown in May, is now the default for every plan. You can now change a record’s type in place, for example from an A record to a CNAME.
Why it matters If you manage DNS for clients, the page will look different next time you log in. Changing a record type no longer means deleting and re-adding it, which removes one easy way to break a site.
HTTP/3 made Delivery Hero’s app 17% faster, with Cloudflare’s help
Delivery Hero moved about 95% of its app users to HTTP/3 and cut home screen load time by 17%. Engineer Elvis Chidera shared the numbers at the P99 conference. Devices on networks that block UDP fall back to HTTP/2.
The secure handshake got 51% faster. In Pakistan, where a handshake could take nearly a second, response time was halved. Some pages on patchy networks are still slow, and the team is working with Cloudflare on a fix.
Why it matters HTTP/3 helps most where mobile networks are slow. If your site is on Cloudflare, it is one switch in the Network settings. It is one of the first things I would check.
Tokio’s creator launches Topcoat for building web apps in Rust
Carl Lerche, who created the popular Tokio library for Rust, has shown Topcoat. It is a framework for building web apps in Rust. Most logic runs on the server, and when you click a button, only that part of the page comes back as fresh HTML.
Small bits of browser logic can be written in Rust and compiled to JavaScript. Data can stream into placeholders, so a slow query doesn’t block the whole page. Lerche says it suits smaller, database-driven apps best.
Why it matters It is a fresh take on fast, server-rendered pages. If you already write Rust, it is worth a weekend test.
Apple tells stores how to fix the iPhone Duo’s cracked inner screen
Apple has sent a memo to Apple Stores and repair partners about inner screen cracks on the iPhone Duo. Technicians should inspect the phone, then repair or replace it under normal rules. Apple says only a small number of phones are affected, and there is no recall.
Apple says the fault tends to show up soon after you start using the phone. iFixit thinks a faulty hinge is the likely cause. Apple has not set up a public repair program yet.
Why it matters If your new iPhone Duo shows a crack on the inner screen, go to Apple support early. It also says something about folding phones: test your site on them, but don’t build for them first.
Quick hits
- Cloudflare D1 will fail queries that return more than 50 MB from 4 November. Cloudflare
- Bing is reportedly showing sponsored results inside its AI Overviews. Search Engine Roundtable
- iOS 27.3 beta arrives 4 November, with Apple Intelligence for China due in December. 9to5Mac
- Apple Music 7.0 for Android rolls out with the Liquid Glass look and a new icon. 9to5Google
- WhatsApp adds a mentions filter, pins that never expire and status updates for one group. 9to5Mac
- Chromagraph Camera from director Rian Johnson shoots raw with a film look for US$12.99. 9to5Mac
- Apple is buying Ascend.io, a startup that builds AI agents for data engineering. 9to5Mac
- Zest launches an AI concierge that finds restaurants and books tables over text. TechCrunch
You're all caught up
That's today's web, tech and SEO news. The next edition lands tomorrow morning, around 3 am Melbourne time.That was the news from Sunday 1 November. A newer edition is waiting for you.
Read the latest news → ← Saturday's news Every edition
Get the news by email
One short email every morning. Free, and you can unsubscribe any time.
That’s you caught up. Not sure what to put in your robots.txt now? My SEO service can set it up so you stay visible in search. Enjoy your Sunday, and see you tomorrow.
Opens in a new tab
Comments
No comments yet. Questions, fixes and better ways are all welcome.