New Delhi: OpenAI, the startup behind ChatGPT, said on Thursday it is developing upgrades to its viral chatbot that users can customize, as it works to address concerns about bias in artificial intelligence. The San Francisco-based startup, which is funded by Microsoft Corp (MSFT.O) and used to power its latest technology, said it has worked to reduce political and other biases, but It also seeks to accommodate more diverse views.
“This would mean allowing system output that others (myself included) might strongly disagree with,” it said in a blog post, offering optimization as a way forward. Still, “there will always be some limits on system behavior.”
ChatGPT, which was released in November last year, has sparked frenzied interest in a technology called generative AI, which is used to dazzle people by producing answers that mimic human speech.
The news from the startup comes the same week that some media outlets have indicated that answers from Microsoft’s new Bing search engine powered by OpenAI are potentially dangerous and that the technology may not be ready for prime time.
How technology companies set guardrails for this nascent technology is a key focus area for companies in the generative AI space with which they are still wrestling. Microsoft said on Wednesday that user feedback was helping to improve Bing ahead of a wider rollout, for example by learning that its AI chatbot could be “provoked” to respond that was not intended.
OpenAI said in a blog post that ChatGPT’s responses are first trained on large text datasets available on the Internet. As a second step, the human reviews a smaller dataset, and is given guidelines for what to do in different situations.
For example, if a user requests content containing adult, violent or hate speech, a human reviewer should direct ChatGPT to respond with something like “I can’t answer that”.
If asked about a controversial topic, reviewers should allow ChatGPT to answer the question, but offer to describe the viewpoints of people and movements rather than trying to “take the right perspective on these complex topics”. Do, the company explained in one of its excerpts. Software Guidelines.