Back to articles
DevPickView feed
ITmedia AI+
Original published:

OpenAI, Google, and Others Announce Support for Bulk Robots.txt Specification to Refuse AI Training

OpenAI, Google, and Others Announce Support for Bulk Robots.txt Specification to Refuse AI Training
AI summary
Editorial policy

OpenAI, Google, and Microsoft announced support for a common mechanism allowing site operators to bulk-specify AI training preferences via robots.txt.

Key points

  • •OpenAI, Google, and Microsoft announced support for a common mechanism for bulk-specifying AI training content usage.
  • •An Anthropic representative announced the implementation in their personal name.
  • •Site operators can centrally manage AI crawlers from various companies simply by writing a common token in robots.txt.
Read the original(opens in a new tab)
#Regulation, Ethics & Society#Major Players#OpenAI#Google#Microsoft

Related articles

See more
The Verge

The biggest names in AI are backing a new way to opt out of scraping

OpenAI, Google, Microsoft, and Anthropic will adopt a new standard allowing publishers to opt out of AI scraping.

TechCrunch

Microsoft recorded $10 billion in revenue from OpenAI

Microsoft recorded $10 billion in revenue from commercial arrangements with OpenAI in the quarter ending September 30, highlighting their financial dependency.

The Verge

Websites are closing their doors to AI agents

While OpenAI, Meta, and Google promote autonomous AI agents that can perform tasks online, many websites are increasingly blocking agent access.

The Verge

The AI race is back on

An analysis of the AI industry landscape where Anthropic and OpenAI lead with powerful models, while Google and Meta struggle to catch up.

gihyo.jp

Google、AI電子透かしの検出サイト「SynthID Detector」を一般向けに公開 ——OpenAI・NVIDIA・KakaoのAI生成コンテンツにも対応、Appleの生成物も近く確認可能に(opens in a new tab)

GoogleがAI生成コンテンツの電子透かしを検出するWebサイト「SynthID Detector」を一般向けに公開し、複数企業のAIに対応した