GPT-3 in short OpenAI’s GPT-3 is “autocomplete on steroids”: a language model that uses deep learning to produce text by predicting the next word in a sentence, given a prompt. It’s trained using gargantuan amounts of compute on a diverse corpus of text comprising hundreds of billions of words crawled from the internet, using two major recent innovations in machine learning: attention and unsupervised training.
OpenAI's GPT-3 - what you should know
OpenAI's GPT-3 - what you should know
OpenAI's GPT-3 - what you should know
GPT-3 in short OpenAI’s GPT-3 is “autocomplete on steroids”: a language model that uses deep learning to produce text by predicting the next word in a sentence, given a prompt. It’s trained using gargantuan amounts of compute on a diverse corpus of text comprising hundreds of billions of words crawled from the internet, using two major recent innovations in machine learning: attention and unsupervised training.