The Race to Block OpenAI’s Scraping Bots Is Slowing Down

Artificial Intelligence News

The Race to Block OpenAI’s Scraping Bots Is Slowing Down
OpenaiMediaBots
  • 📰 WIRED
  • ⏱ Reading Time:
  • 20 sec. here
  • 6 min. at publisher
  • 📊 Quality Score:
  • News: 25%
  • Publisher: 51%

OpenAI’s spree of licensing agreements is paying off already—at least in terms of getting publishers to lower their guard.

It’s too soon to say how the spate of deals between AI companies and publishers will shake out. OpenAI has already scored one clear win, though: Its web crawlers aren’t getting blocked by top news outlets at the rate they once were. The generative AI boom sparked a gold rush for data—and a subsequent data-protection rush in which publishers sought to block AI crawlers and prevent their work from becoming training data without consent.

For most of the internet’s existence, people running webpages expected each other to abide by the file. When a WIRED investigation earlier this summer found that the AI startup Perplexity was likely choosing to ignore robots.txt commands, Amazon’s cloud division launched an investigation into whether Perplexity had violated its rules. It’s not a good look to ignore robots.

We have summarized this news so that you can read it quickly. If you are interested in the news, you can read the full text here. Read more:

WIRED /  🏆 555. in US

Openai Media Bots Copyright

Singapore Latest News, Singapore Headlines

Similar News:You can also read news stories similar to this one that we have collected from other news sources.

A horse-race race: What SF mayoral polling revealsA horse-race race: What SF mayoral polling revealsThere are lessons to be learned — and some to be ignored — from poll results so far
Read more »

Stenhouse snaps 65-race losing streak as Talladega race scrambles playoff pictureStenhouse snaps 65-race losing streak as Talladega race scrambles playoff pictureStenhouse is not in the playoffs and his victory Sunday marked the second consecutive week a driver not competing for the Cup Series title has won.
Read more »

‘Comic opera scenes’ at first ever Japanese GP‘Comic opera scenes’ at first ever Japanese GPWe reveal the chaos from the debut race at the storied Suzuka race track
Read more »

Bass Pro Shops Night Race: Bristol Picks, Betting Odds & Race PreviewBass Pro Shops Night Race: Bristol Picks, Betting Odds & Race PreviewOur Bass Pro Shops Night Race picks see Denny Hamlin as a proven NASCAR driver in a desperate spot, and his success at Bristol will come in handy.
Read more »

Denny Hamlin Offers Blunt Response to Kevin Harvick OutburstDenny Hamlin Offers Blunt Response to Kevin Harvick OutburstFollowing a post-race incident at the Kansas race, Kevin Harvick and Denny Hamlin engaged in a heated exchange over the latter's post-race comments.
Read more »

Wu-Tang Clan rapper, Polyphonic Spree to play Deep Ellum Block PartyWu-Tang Clan rapper, Polyphonic Spree to play Deep Ellum Block PartyThe daylong celebration in the Dallas entertainment district will be on Nov. 23.
Read more »



Render Time: 2025-08-28 03:51:15