Websites scramble to dam ChatGPT net crawler after directions emerge

A woman hiding behind a cloud.

Enlarge (credit score: Getty Photographs)

With out announcement, OpenAI just lately added particulars about its net crawler, GPTBot, to its on-line documentation web site. GPTBot is the identify of the consumer agent that the corporate makes use of to retrieve webpages to coach the AI fashions behind ChatGPT, resembling GPT-4. Earlier this week, some websites rapidly introduced their intention to dam GPTBot’s entry to their content material.

Within the new documentation, OpenAI says that webpages crawled with GPTBot “could doubtlessly be used to enhance future fashions,” and that permitting GPTBot to entry your web site “can assist AI fashions turn into extra correct and enhance their normal capabilities and security.”

OpenAI claims it has applied filters guaranteeing that sources behind paywalls, these gathering personally identifiable info, or any content material violating OpenAI’s insurance policies won’t be accessed by GPTBot.

Learn 12 remaining paragraphs | Feedback

Leave a Reply

Your email address will not be published. Required fields are marked *