Websites have visitors that aren't people. Automated programs called crawlers collect their pages. AI companies can use collected text to train models: teaching software patterns from examples. Robot…
Source: https://www.theverge.com/tech/1023763/openai-google-microsoft-ai-scraping-standard-opt-out