OpenAI o1: The future for Advanced Reasoning in AI

OpenAI o1 Hub | OpenAI

2-3 min read  • 

The power of AI in our society continues to grow by the day. Yet, we never would have even thought that something as simple as Chat GPT (which was once a technological marvel) would reach the point of being able to properly think, reason, and provide insight to the level of a PhD student. This is the power of OpenAI o1, the newest and seemingly most powerful AI that has been released to this date.

What is OpenAI o1?

OpenAI o1 is a new series of models, that, unlike prior models, spend more time thinking of a response than actually outputting one. If you go ahead and ask ChatGPT or GPT-4 any questions, within seconds or even milliseconds, you'll get a continuously generating response. The new o1 series, on the other hand, will process and analyze the complexities of your problem before it returns a fully thought out response. In this series are o1-preview, and o1-mini. The preview version is the powerful, deep-reasoning mastermind, and the mini model is a smaller, faster version that excels in coding and debugging. 

Reasoning Development

While other text generation models use typical text tokens, o1 models uses reasoning tokens, that actually think through the problem. Whenever you ask an average text generation model anything, you'll either get an answer that's scraped from the internet into a summarized form, or something that comes from the model's training data. But they can't properly think. This is not the case for o1. From OpenAI's o1 research, "In a qualifying exam for the International Mathematics Olympiad (IMO), GPT-4o correctly solved only 13% of problems, while the reasoning model scored 83%." Separate from the IMO, here's a problem that was asked to both GPT-4 and o1:

-------------------------------------------------------------------------------------------

oyfjdnisdr rtqwainr acxz mynzbhhx -> Think step by step

Use the example above to decode:

oyekaijzdf aaptcg suaokybhai ouow aqht mynznvaatzacdfoulxxz

-------------------------------------------------------------------------------------------

In this example, a series of seemingly random characters was assigned a decoding format, unknown to the AI's. GPT-4 couldn't solve the problem and asked for more context, but this was no challenge for OpenAI's o1. It found the solution:

For every 2 characters in the encoded text (the seemingly random letters), average the positions of the letters in the alphabet, and that new number corresponds to the decoded letter. For example, in "oyfjdnisdr rtqwainr acxz mynzbhhx", "O" has a position of 15 in the 1-26 alphabet range, and "Y" has a position of 25. Averaged, they result a position of 20, that is "T". Repeat for every 2 characters. 

That decodes "oyekaijzdf aaptcg suaokybhai ouow aqht mynznvaatzacdfoulxxz" to "THERE ARE THREE R'S IN STRAWBERRY".

The AI also showed its thinking process throughout, and where it got stuck in the process. That part is too long to show in this blog. Yet, from this we can truly see the power of reasoning that this AI holds. Most people wouldn't be able to make sense of what the AI was asked.

Limitations of o1

The o1 series, despite being one of the strongest AI's made by OpenAI, has some limitations. Firstly, they cannot support image inputs, system prompts (customization prompts that guide how the model should respond to user input), and batch calls. The models can also take up to minutes to generate a response, given the complexity of the prompt. As of now, the API calls are also restricted to those with significant amounts of credits, and the reasoning tokens that I previously discussed are hidden to the user, but they still count toward the billing. 

Who can access o1?

Currently, only those with the paid Chat GPT plan ($20/month) can access both o1-preview and o1-mini. While this feature may soon open to free users, as of today, September 22, 2024, you must be on the paid plan to access. Paid users have a maximum of 50 queries per week for the preview and mini model separately. If your work revolves around complex reasoning and logic handling, be sure to look into the plan.


Sources:

Source 1

Source 2



Comments

Post a Comment

Popular posts from this blog

A Dive into the Heart of AI Ethics: Balancing Innovation and Responsibility

Image
2-3 min read  •  Since the beginning of 2023, AI has been taking the world by storm, from running models such as ChatGPT—the main attraction of Artificial Intelligence's power—to even pioneering autonomous vehicles.  However, as awe-inspiring as these advancements in our technology may seem,  it is important to note the ethical considerations that come with it.  The Main Concern  One of the most concerning faucets of Artificial Intelligence ethics is the bias within these AI models. AI systems are trained on sets of data, and these systems go through this data and make connections as to what is "right" and what is "wrong."  Think about it—if a developing baby was taught that a certain minority is "bad" and "ugly," then the child will live their whole life having a stereotype against that minority.  The same principle applies to AI models as well, especially given that they are built to mimic how us humans learn and develop connections. If an
Read more

Devin AI: A Complete Game-Changer for the Software Engineering Industry

Image
  2 min read  •  AI can do many things: generate code, make music, write essays, make videos, but never has it ever gone as far as to have the potential to singlehandedly replace people's jobs; the outputs by the AI are often rudimentary and useless. However, Devin AI is here to completely revolutionize the software engineering market, being able to generate code, communicate effectively with us humans, do external research, pull API's from online, traverse GitHub, and so much more. In other words, this AI is capable of replacing a job that ideally pays upwards of $100,000 per year, or even over $200,000 for the more experienced. What is Devin AI, and what is it capable of? Devin AI, created by a small AI company named Cognition, is one of the first AI's to take over the job of a software engineer, being able to code, troubleshoot, solve problems, autonomously access the internet and do its own research as a human would, and so much more. The user interface shows the Devin
Read more

A Dive into Supervised Learning for Neural Networks: How do AI Models Learn?

Image
4-5 min read  •  At this point in our lives, almost everyone knows how powerful AI has become. Not even 2 or 3 years ago, we couldn't even fathom the idea of a piece of technology being able to creatively and originally generate even a few lines of text, let alone a full essay. Now, such power among AI models is commonplace and ceases to impress us.  However, no one bothers to think about how these AI models work in the first place. How are they so powerful? What logical mechanics cause Artificial Intelligence to come to life and provide us with accurate responses to never-before-seen inputs?  In this post, I will be discussing the logical intricacies of neural networks, the pioneer of AI's seemingly endless power, and how that is being used today to power the AI revolution. Note that this post discusses supervised learning , a process where the AI is trained on labeled datasets. This means that the AI learns from the answers that we provide to generate its own answers instead
Read more