On June 26th, Grail News reported that social media platform Reddit will update a web standard used by the platform to block automatic data scraping from its website. Previously, an AI start-up was reported to have circumvented this rule to collect content for its system. This move comes as AI companies are accused of plagiarizing content from publishers to create AI-generated summaries without attribution or permission. Reddit said it will update the Robots Exclusion Protocol, also known as the crawler protocol, which is a communication protocol between websites and web crawlers. Through this protocol, website administrators can specify which pages are allowed to be crawled by crawlers and which pages are not allowed.
Reddit将更新《机器人排除协议》 以阻止自动数据搜刮
Reddit will update the 'Robot Exclusion Protocol' to prevent automatic data scraping.
The translation is provided by third-party software.
The above content is for informational or educational purposes only and does not constitute any investment advice related to Futu. Although we strive to ensure the truthfulness, accuracy, and originality of all such content, we cannot guarantee it.