This is the news from Monday 16 November. Read the latest news
Daily news
United blocks AI agents, Meta’s Muse leads agent traffic and more
Today in 30 seconds
- United lets search engines in but makes AI agents ask first
- Meta’s Muse now makes most AI agent visits to websites
- Cloudflare says OpenAI pays for hints on when pages change
- Thousands of Lovable apps left their databases open to anyone
- Apple closes its Support Community forums on 20 November
- Amazon Ad Tag now sets a 30-day cookie on advertisers’ sites
- YouTube Studio swaps Analytics for Insights and adds Research
- Google Pixel phones get a Family hub in Settings
- Milton turns an old iPad into a family dashboard
Good morning. It was a quiet weekend, but one theme kept coming up. AI agents are knocking on every website’s door, and sites are starting to answer back. Let’s go.
United lets search engines in but makes AI agents ask first
United Airlines updated its website terms on 11 November. Search engines may still index its public pages. But any AI agent that searches, books or buys on united.com or in the app now needs written permission.
The terms also ban using United’s fares, schedules and prices to train or ground an AI model. Its contract of carriage now lists booking with an AI agent as a banned practice, and United can cancel those bookings. Search Engine Journal found that its robots.txt had not changed. The block lives in the legal terms, not in robots.txt. A person using a normal browser is fine, but AI features built into browsers are not exempt.
Why it matters Big brands are starting to treat search crawlers and AI agents as two different things. You may want to make the same choice for your own site.
My take: most small sites want AI agents to visit, because agents bring buyers. Just make it a decision, not an accident.
Meta’s Muse now makes most AI agent visits to websites
HUMAN Security’s October report says Meta’s Muse agent made 59% of all AI agent requests to websites. That is up 19 points from September. Meta and OpenAI agents together made nearly 90% of requests.
Agent traffic was about 2.6 times September’s level and about 8 times August’s. ChatGPT Agent’s share fell from 28.5% to 15.9%. 85% of agent requests went to product and search pages, and only 1.9% reached checkout or payment pages. Ecommerce got about 60% of the traffic, then travel and media.
Why it matters If you run a shop, AI agents are already reading your product pages. The report says they “still browse far more than they buy.” Clear prices, stock and specs help them pick you.
I would check your server logs this week. I bet you will see more agent visits than you expect.
My guide on how AI search finds your website covers the basics.
Cloudflare says OpenAI pays for hints on when pages change
Cloudflare CEO Matthew Prince says OpenAI pays Cloudflare for change hints. These tell OpenAI’s crawler when a page has changed, so it does not need to fetch everything again. Prince said this was the first money from Cloudflare’s new “Act 4” products. He gave no dollar figure.
Cloudflare’s AI Crawl Control is on every plan, including free. It lets you allow or block each AI crawler one by one. Prince called helping with AI agent traffic “sort of the new version of SEO.”
Why it matters The same roundup reports that Ziff Davis saw Google referrals fall about 37% in a year. Deciding which AI crawlers you let in is now part of SEO.
New to Cloudflare? Start with my Cloudflare 101 guide for the free plan.
Thousands of Lovable apps left their databases open to anyone
A research firm called Crissy Field scanned apps built with the AI app builder Lovable. Per Cybernews, 24,664 of the 34,545 apps on Supabase returned records without a login. Exposed data included email addresses on 7,403 sites, more than 1,000 passport records and 200,000 chat messages. The story was the top post on Hacker News this weekend.
Lovable itself was not hacked. The cause was missing or wrong database access rules in each app. Supabase now keeps new tables off its public API by default, but older tables stay reachable. Lovable now asks you to review security findings before you publish, but you can still publish anyway.
Why it matters If you or a client built an app with Lovable, Bolt or a similar tool, check every table’s access rules today. Then try to read your data without logging in.
My take: AI builders are great for speed. They don’t replace a second pair of eyes on who can read what.
Apple closes its Support Community forums on 20 November
Apple’s Support Community forums, 28 years old, close for good on 20 November 2026. The site has been read-only since 10 November. Apple points users to support.apple.com instead.
Apple has not said whether old threads or their URLs will stay online or redirect. It only mentioned a “careful evaluation of strategy and customer needs.”
I think this is a real loss for the web. Those threads held years of useful answers.
Why it matters Those threads answered millions of long-tail searches like “why does my Mac do X”. If they vanish, that search traffic goes elsewhere. A clear help page on your own site could pick some of it up.
Amazon Ad Tag now sets a 30-day cookie on advertisers’ sites
The Amazon Ad Tag now sets a first-party cookie called aatSession on the advertiser’s own domain. It is on by default, with no setup. It expires 30 days after the visitor’s last page view. For now it is North America only.
It is set only when consent allows it, through TCF, GPP or Amazon’s own consent signal. To turn it off, add amzn("disableAATSessionCookie", true); on every page before the first event.
Why it matters If your store runs Amazon ads, a new cookie just appeared on your site. Add it to your cookie list and privacy policy. My cookie consent guide can help.
YouTube Studio swaps Analytics for Insights and adds Research
YouTube has renamed Analytics to Insights in YouTube Studio on desktop. It adds plain-language summaries of how your videos are doing. Advanced analytics and real-time data stay the same.
A new Research tab replaces Trends and ranks “outlier” videos. A 5x score means five times the views of the channel’s earlier videos in that format. The Ask Studio AI helper is now in the Android and iPhone apps, with voice prompts.
Why it matters If your business posts videos, the summaries tell you what worked without digging through charts.
Google Pixel phones get a Family hub in Settings
Pixel phones now have a Family section in Settings. It brings together Google One storage, the Play Family Library, shared payment methods, family calendar events and location sharing. Parents can also remove or transfer family members from there.
It arrives through the November 2026 Google System Update, so there is nothing to install. 9to5Google says it is now widely rolled out, on phones like the Pixel 11 Pro XL and Pixel 10 Pro.
Why it matters It is a small change, but it saves real time if you manage a family plan. Check who still shares your payment card.
I wish every phone made family settings this easy to find.
Milton turns an old iPad into a family dashboard
Milton is an indie app that turns a spare iPad into a home dashboard. It shows tiles for your calendar, chores, shopping list, weather, photos and to-dos. It needs iPadOS 17 or later.
Kids earn points for chores. A recipe feature turns a photo of a cookbook page into step-by-step instructions. The core app is free. The Individual plan costs US$4.99 once, and Family costs US$14.99 and shares with your iCloud family.
Why it matters That old iPad in your drawer can earn its place on the fridge. It is a fun weekend project, and I like that the core app is free.
Quick hits
- Cloudflare had resolved incidents on Saturday for R2, Tiered Cache and the Workers API. Cloudflare Status
- Claude Code 2.1.325 now asks permission before sandboxed Bash commands, and fixes a zstd decoding issue. GitHub
- Microsoft 365 Education ends free student email, mostly at renewals from 1 January 2028. The Register
- Samsung News shuts down in India and Korea on 21 December. Engadget
- Pixel Tag works well, but 9to5Google says the Find Hub network still holds it back. 9to5Google
- Mac Studio is the new Xserve for running local AI models, argues 9to5Mac. 9to5Mac
- TechCrunch keeps a running list of AI products that shut down, including Sora and ChatGPT Atlas. TechCrunch
- Apple Black Friday deals have started early in the US. MacRumors
You're all caught up
That's today's web, tech and SEO news. The next edition lands tomorrow morning, around 3 am Melbourne time.That was the news from Monday 16 November. A newer edition is waiting for you.
Read the latest news → ← Sunday's news Every edition
Get the news by email
One short email every morning. Free, and you can unsubscribe any time.
That’s you caught up. Want to decide which AI crawlers and agents get into your site, and make sure the right ones find you? My SEO team can set it up. Have a great Monday.
Opens in a new tab
Comments
No comments yet. Questions, fixes and better ways are all welcome.