Everything OpenAI Launched at DevDay

Was this newsletter forwarded to you? Sign up to get it in your inbox.

---

I’m at OpenAI’s developer conference, DevDay, today in San Francisco. Here’s what I saw.

The big news is that the company launched a Realtime API that promises to allow anyone to build functionality similar to ChatGPT’s Advanced Voice Mode within their own app. Paired with their new model o1, released a few weeks ago, OpenAI is creating an new way to build software.

o1 can prototype anything you have in your head in minutes rather than months. And the Realtime API enables developers to build software with a novel interface—life-like voice conversations—that was previously only the domain of science fiction.

OpenAI also announced the following: 

• An increase of the API rate limits on the o1 model equal to that of GPT-4o (10,000 requests per minute)
• A reduction of the price of GPT-4o API calls with automatic prompt caching, making repeated API calls 50 percent cheaper with no extra developer effort
• A multi-modal fine-tuning API that allows developers to fine-tune GPT-4o with images in addition to text
• Triple the number of active apps are on the OpenAI platform from last year to this year, and there are 3 million active developers.

Let’s get into the details. 

---

Become a paid subscriber to Every to unlock this piece and learn about:

• The rise of specialized models for diverse use cases
• Realtime API: Bringing voice conversations to life
• Fine-tuning and distillation: Customizing AI for every company
• Dan's three big takeaways