(Comments)
Last week, OpenAI announced the release of an AI language model called ChatGPT . ChatGPT is a chatbot based on the GPT-3.5 model, which in turn is an improved GPT-3 model, known from e.g. writing a scientific paper about myself , writing journalistic articles or writing poetry and prose .
ADVERTISING
What is ChatGPT? A model that conquers the internet
The ChatGPT model was trained using the Reinforcement Learning from Human Feedback (RLHF) method. This training was based on conversations with human trainers who impersonated both AI users and assistants. The trainers had access to the suggestions generated by ChatGPT, which were corrected by them and reported back to the AI as correct.
In turn, to create the reward model - essential for reinforcement learning - OpenAI engineers collected comparative data consisting of at least two model responses ranked by quality. To collect this data, OpenAI researchers used records of conversations between AI trainers and a chatbot, then randomly selected messages written by the model, matched them with alternative endings and had the trainers evaluate them in terms of content and fact.
How does ChatGPT work?
For the ChatGPT OpenAI training, over 45 terabytes of training data were used, which consisted of Common Crawl content , various online texts, books, and Wikipedia content . It is worth noting that the ChatGPT training was completed at the beginning of this year, which means that the model is not aware of, for example, the takeover of Twitter by Elon Musk or the death of Queen Elizabeth II.
As OpenAI declares, in addition to generating text based on the instructions we will introduce and talking in natural language, ChatGPT is also able to recognize errors in the codes of various programs and correct them. Created by OpenAI, ChatGPT refuses to answer questions about illegal activities or socially considered sensitive and controversial topics.
OpenAI also mentions the limitations of ChatGPT, noting that "ChatGPT sometimes writes plausible-sounding but incorrect or nonsensical answers." According to OpenAI, this problem is due to the fact that training the model to be more careful led to it rejecting questions it cannot answer. On the other hand, supervised training misleads the model because the ideal answer depends on what the model knows, not what the human interlocutor knows.
In an ideal ChatGPT scenario where the user makes an ambiguous query, the model should ask him clarifying questions. Instead, the ChatGPT model guesses what the user meant.
What can ChatGPT write? Beautiful language, but often nonsense content
Despite its limitations, ChatGPT gained immense popularity on the Internet, as OpenAI made the model available for free to all interested parties for the time of open research. While it's still free and unlimited, I decided to talk to ChatGPT.
Unlike many intelligent models that conquered the Internet, ChatGPT also understands Polish, and this gave a fairly wide field to check whether it was possible to get something more out of it than generating advertising texts. Spoiler: yes.
After registering on the OpenAI website and logging in, I immediately started the conversation. The first task: "the content of Christmas wishes for parents". A relatively simple query, which additionally has quite a large amount of training data, was not a problem for ChatGPT.
It was similar to generating a soy candle ad on Instagram. It's probably not the most engaging text and many marketers could do better, but it presents the product in natural language and in a positive, buying light.
Then I threw ChatGPT into deeper water and asked why people prefer iPhone over Samsung. Artificial intelligence gave me the reasons that most often appear in the content of comparing Apple equipment with other brands.
However, when asked about polynomials, the SI started choking and did not finish the statement.
Then I threw ChatGPT into even deeper water, commissioning to write simple texts that every student of primary school, high school or technical school will collide with sooner or later. If there are smarties who are convinced that ChatGPT will do them at the last minute, then I have to cool down the expectations. SI writes total nonsense that would lead to failing the final exams.
A rather interesting example is ChatGPT's commission to write a sermon based on the letter to the Romans, specifically verse 21 in chapter 12.
Do not be overcome by evil, but overcome evil with good.
Rz 12,21
ChatGPT, instead of referring to the quote, paraphrased passages from other books, while not finishing his sermon.
ChatGPT has its uses, but it won't replace a human yet
ADVERTISING
Although some of the content generated by ChatGPT is not true and can at best bring a smile to your face, it is worth distinguishing factual errors and factual errors here. Although ChatGPT can, colloquially speaking, write nonsense and make cardinal factual errors with more difficult issues, each of the messages I received from the bot was linguistically, grammatically and stylistically correct.
Although reading that Seweryn Baryka is the main character of "Lalka" by Prus, I cannot hide my amused expression, I cannot deny that the model is extremely efficient - especially considering the realities of the Polish language, which does not have such a large amount of data training languages, such as English or Spanish.
Share on Twitter Share on FacebookUnbelievable! Its comfort actually!
read moreAs time went by, this blog was developed for many different purposes. Last time, I had a lot of pleasure in sharing some of my Lego-related hobbies. However, I will mostly upload a blog about bikes and their development in the next few months! Recently, I have so much into ebike cargo. They say this type of bike can replace the car! And I am very into it since my place is crowded with traffic jams! The video above showed a funny situation: I started the review from Brooks's handle! And after nine years! It's still an excellent bike handle and not even destroyed!
read moreKeep Watching
Hi, hi, hi. So, it's been a while for the last couple of weeks since I have considered buying a cargo bike. The reason is that I am often trapped in a traffic jam because I can't get faster in my car.
read moreIndonesia has launched Southeast Asia’s first-ever bullet train, a high-speed rail line connecting two of its largest cities.
Congrats! Indonesia launched Southeast Asia’s first bullet train.
Custom LEGO Transformers Devastator
My faith in humanity is restored! OK, that’s a bit overboard – but you couldn’t blame me if you see an incredibly, exquisitely and wonderfully executed custom LEGO Transformers Devastator such as this by Alex Jones. I feel transported to the 80’s once again, with the same intense childhood wonder when I first saw the Constructicons combine and become the formidable Devastator.
Collaboratively administrate empowered markets via plug-and-play networks. Dynamically procrastinate B2C users after installed base benefits. Dramatically visualize customer directed convergence without
Comments