GPT-4

From Justapedia, unleashing the power of collective wisdom
Jump to navigation Jump to search
Generative Pre-trained Transformer 4 (GPT-4)
Original author(s)OpenAI[1]
Initial releaseMarch 14, 2023
TypeAutoregressive transformer language model

GPT-4 (Generative Pre-trained Transformer 4) is a multimodal large language model created by OpenAI,[1] the fourth in the GPT series. It was released on March 14, 2023, and will be available via API and for ChatGPT Plus users.[2] Microsoft confirmed that versions of Bing using GPT had in fact been using GPT-4 before its official release.[3] As a Transformer, GPT-4 was pretrained to predict the next token (using both public data and "data licensed from third-party providers"), and was then fine-tuned with reinforcement learning from human feedback.[4]: 2 

The GPT-4 technical report explicitly refrained from specifying the model size, citing "the competitive landscape and the safety implications of large-scale models".[4] The Verge cited rumors that GPT-4 would substantially increase the parameter count from GPT-3's 175 billion to 100 trillion, which OpenAI CEO Sam Altman described as "complete bullshit".[5] U.S. Representatives Don Beyer and Ted Lieu confirmed to the New York Times that Altman visited Congress in January 2023 to demonstrate GPT-4 and its improved "security controls" compared to other AI models.[6]

OpenAI wrote in their blog post announcing GPT-4 that "GPT-4 is more reliable, creative, and able to handle much more nuanced instructions than GPT-3.5."[2] It can read, analyze, or generate up to 25,000 words of text, which is a significant improvement over previous versions of the technology.[1][7] The New York Times wrote that GPT-4 showed impressive improvements in accuracy compared to GPT-3.5, had gained the ability to summarize and comment on images, was able to summarize complicated texts, passed a bar exam and several standardized tests, but still showed a tendency to hallucinate answers.[8]

References

  1. ^ a b c "GPT-4". OpenAI. March 14, 2023. Archived from the original on March 14, 2023. Retrieved March 14, 2023.
  2. ^ a b "GPT-4". openai.com. 2023-03-14. Archived from the original on 2023-03-14. Retrieved 2023-03-14.
  3. ^ "Microsoft's new Bing was using GPT-4 all along". techcrunch.com. 2023-03-14. Archived from the original on 2023-03-15. Retrieved 2023-03-14.
  4. ^ a b "GPT-4 Technical Report" (PDF). OpenAI. 2023. Archived (PDF) from the original on 2023-03-14. Retrieved 2023-03-14.
  5. ^ Vincent, James (January 18, 2023). "OpenAI CEO Sam Altman on GPT-4: "people are begging to be disappointed and they will be"". The Verge. Archived from the original on January 26, 2023. Retrieved January 27, 2023.
  6. ^ Kang, Cecilia (March 3, 2023). "As A.I. Booms, Lawmakers Struggle to Understand the Technology". The New York Times. Archived from the original on March 3, 2023. Retrieved March 3, 2023.
  7. ^ GPT-4 Developer Livestream (Videotape). OpenAI. 2023-03-14. Archived from the original on 2023-03-14. Retrieved 14 March 2023 – via YouTube.
  8. ^ Metz, Cade; Collins, Keith (2023-03-14). "10 Ways GPT-4 Is Impressive but Still Flawed". The New York Times. Archived from the original on 2023-03-14. Retrieved 2023-03-14.


Stub icon

This artificial intelligence-related article is a stub. You can help Justapedia by expanding it.

Retrieved from "https://justapedia.org/index.php?title=GPT-4&oldid=2000004460"