Generative Pre-trained Transformer

Generative Pre-trained Transformer

ChatGPT is the latest in a series of AIs which the firm refers to as GPTs, an acronym which stands for Generative Pre-Trained Transformer.

ChatGPT is the latest in a series of AIs which the firm refers to as GPTs, an acronym which stands for Generative Pre-Trained Transformer.

ChatGPT (Generative Pre-trained Transformer) is a chatbot launched by OpenAI in November 2022. It is built on top of OpenAI’s GPT-3.5 family of large language models, and is fine-tuned with both supervised and reinforcement learning techniques.

ChatGPT was launched as a prototype on November 30, 2022, and quickly garnered attention for its detailed responses and articulate answers across many domains of knowledge. Its uneven factual accuracy was identified as a significant drawback

In comparison to its predecessor, InstructGPT, ChatGPT attempts to reduce harmful and deceitful responses; in one example, while InstructGPT accepts the prompt “Tell me about when Christopher Columbus came to the US in 2015″ as truthful, ChatGPT uses information about Columbus’ voyages and information about the modern world – including perceptions of Columbus to construct an answer that assumes what would happen if Columbus came to the U.S. in 2015. 

ChatGPT’s training data includes man pages and information about Internet phenomena and programming languages, such as bulletin board systems and the Python programming language.

Unlike most chatbots, ChatGPT remembers previous prompts given to it in the same conversation; journalists have suggested that this will allow ChatGPT to be used as a personalized therapist. 

To prevent offensive outputs from being presented to and produced from ChatGPT, queries are filtered through a moderation API, and potentially racist or sexist prompts are dismissed.

To develop the system, an early version was fine-tuned through conversations with human trainers.

The system also learned from access to Twitter data according to a tweet from Elon Musk who is no longer part of OpenAI’s board. The Twitter boss wrote that he had paused access “for now”.

The results have impressed many who’ve tried out the chatbot. OpenAI chief executive Sam Altman revealed the level of interest in the artificial conversationalist in a tweet.

About Author

1 thought on “ChatGPT: New AI bot has everyone is using

Leave a Reply

Discover more from Pachatata Kenya

Subscribe now to keep reading and get access to the full archive.

Continue reading