Everything Announced at OpenAI Dev Day 2026 in 15 Minutes
Publicado no IA Dots ·
Agentes de IAAI SignalDotsidioma-enInglêsMuseyt-rxM3UKS4BFc
Vídeo em Inglês, publicado pelo canal PCMag.
Video transcript
Transcript from available captions; it may contain errors.
Good morning and welcome to Dev Day. It is great to have everyone here and everyone joining us online. Thank you for coming. I think this is going to be our best dev day yet. You asked us to bring codeex to Linux, so we did that. You asked Yeah. Wow. Lot of people like that one. And you asked for codeex on your phone, so we brought it there. [applause and cheering] It gives us a lot of joy to build things that you find really helpful. And the next thing is one of the things that you've all the most. You may have seen early signs of what this could look like in virtual assistants that help you book a reservation or buy a plane ticket. And these things are useful to hand off, but they are trivial to relative relative to what the technology can do. And so we wanted to be way more ambitious. Dots are remarkably capable, always on agents built to handle really anything you can think of. They bring AI into a whole new form factor to work and give you more time and attention so you can do the things that you care about. What feels new about my dot is that it gets to know how I like to work over time and where I want to focus my attention. Of course, DOT can take care of the small things like those plane tickets or the time for dinner or help with the home renovation that you've been putting off. But because DOTs are powered by Astra and a lot of other things we built around them, you can delegate ambitious pieces of work. Get our app off this legacy API before it shuts down. That is a difficult problem. The API might be used all over a codebase and it's not obvious what's going to break as you start making changes. Dot's on board with everything they need to get to work. They follow your access. They have their own computer in the cloud, their own browser, and they can write and test code as needed. You also don't need to be in chatbt to talk to your dot. coming soon. You'll be able to send it a text message. It'll text you back. It can text you updates, flag when something's changed, or ask you to weigh in on a decision. You can even give your dot a call and talk with it directly. Dots also work with more than 4,000 apps across Chat GBT. When you onboard your dot, it gets to use the same plugins you've already connected. It can just follow along with your work wherever it happens. Dots are powered by Astra, our most aligned model, and they have built-in protections and safeguards. You can set the boundaries on app and computer use and you can customize instructions for any actions your dot takes. We're introducing chat GBT space. This is a place where you, your teammates, and your agents can all work together. Space starts with a page like the one here you see on the screen. You can write a plan, do research, create images, generate data, or build something new. Dots can work alongside you directly in the page. You can bring in a dot and ask it to track dependencies just like you would with a senior engineer. You can tag a dot in a comment and it'll jump in and get to work, but spaces feel alive. You can give the page specific instructions like check the API platform slack channel and update it daily with findings here. Coming soon, we're introducing a new way to build presentations right inside space 2. So you'll be able to share a presentation with your team, collaborate together with your dot and their dots right inside chatbt. So today I'm going to show you how teams at OpenAI use Dots via a fictional music app we're calling Blossom. It's a fictional cool app for creating playlists. And this is my dot. Doy. It's a second set of eyes across everything I give it access to. And more importantly, a second set of hands to actually take work off my plate. This morning it proactively caught a bunch of things for me to look at. Our launch review moved earlier. It already updated my calendar. We shipped some new features to test users last night and it's already looked at the feedback and it looks like design landed a last minute rev on our home screen and not only spotted this but actually sent me the design to take a look at right here. So let's take a look at this new design. Okay, I like it but this close to launch I really want to be able to play with it. Right. And because access to this laptop and its dev tools I'm just going to say go build it. And no pressure, Doie. We'll check back on this later. And because Doie already knows who I am, what I'm working on, and why, I can get straight to the point. It's like talking to a second brain. So, let's say I'm walking into the office and I just need to catch up on last night's alpha. >> Good morning, Holly. Nice to hear from you. >> Hey, so I'm just walking in. Um, can you catch me up on just user testing from last night? >> Checking that now. >> All right. Um, how's it going? >> Still checking. >> I might ask it to Hey, I'm going to review with the go to market leads later. Do you want to just drop an FAQ into the page? >> Sure, I'll take care of that. >> Okay, thank you. We've added a brand new place to collaborate with your team inside of chat GPT called space. When I hit slash here, you can see all of the different things that you can build. Interactive charts, sheets, live prototypes, anything you need to bring your ideas to life. And your team and your dots can actually join you in here. So, let me show you what I mean. I can just tag in teammates like Renie or Rishib, but I can also tag in itself and say, "Hey, can we actually turn this into a bar chart, please?" And the visualizations in here are completely dynamic. Now, here's the FAQ that we just asked Doy to drop in. And because Doy has all my context, I can actually just, you know, hand it off things that would really slow me down like, hey, let's add in that stat about onboarding from that one engineer in my Slack DMs and Doie can find it. Or maybe something like, hey, uh, let's incorporate more of Laura's feedback. But where dot has really changed how we work is Slack. All of us are getting tagged all day. And sometimes an innocuous ask like reconciling launch specs can turn into a whole project. Now I can forward the thread to do. I can just delegate and say, "Hey, can you take this?" And as you can see, my DMs are full of these little handoffs. I get to decide what needs my attention and what my dot can take care of. So here's something we totally didn't expect at OpenAI. People started treating their dots like they're delegates. And now we bring our dots into group chats from the get-go. So here, Gabe and Patrick are handing off tasks to their dots. When the dots come back with the results, everyone stays in the loop. And our engineers are taking this one step further. So here, someone's dropped in a session ID and a user bug into a feedback channel somewhere. But Gab's Dot picks it up, investigates it right away, and opens a PR with a fix. And this is a real example. Our engineers have their dots fixing dozens of bugs a day in this way. It's been amazing to see how much dots were built by dots. This is a live demo, and it looks like earlier there was a little bit of an error throwing up this codeex thread. So, I'm going to try it again. And what's happening here is that Doie can actually use codeex on my laptop to build the app and launch it in the iPhone simulator. Now, this might take a bit, but the amazing thing is we can start with the mock on my phone, run local execution, and get it to be a working app here. And then I can even ask Doy to just run with it and ship the PR all while I'm here with you. Both dots and space will be available to all chatbt pro business premium and enterprise users today. And your dot is included in your plan and conversions don't conversations don't eat into your usage. You can always work with your dot. It's available 247. We're also previewing specialist dots today. These are like virtual teammates set up by your company that will work alongside your whole team. They can help scale intensive work like accounting, marketing, legal, much more. You can give them goals and context, review what they produce, give them feedback to improve, and that'll be shared across your whole company. We've been testing these inside of OpenAI and they have been remarkably effective in many different roles. So for our enterprise customers, we'd love to work with you to get them set up and make sure they're really great. We're also working with Microsoft to integrate specialist dots into agent 365. So this means businesses can manage their dots through the Microsoft tools that they already use. We are launching GPT 6.1 Soul. You don't even know what it is yet. It gives you very near Astro level intelligence at a fifth of the price to help you code and build. It's extremely affordable to run. In fact, the cash input costs are a 95% discount on standard input. So, this makes it much cheaper for agents to reuse context, iterate on solutions, and work through longer tasks. We think you will really love this model. that is smarter than Astra in some ways and it will become your daily workhorse. So we're very excited to get 6.1 Soul launched today. We're launching ultra fast across the API chatbt and codeex. [cheering] [applause] Fast already gives you twice the speed at twice the price of standard but ultraast takes that to eight times the speed at six times the price of standard. An incredible 300 tokens per second. You know what? It's worth it. Um let me show you actually. So this is the same task side by side. We gave both models the same prompt. Create and launch a rocket with the dev day colors. On the left here you have ultra fast. On the right you have regular. You can see how much faster this builds. The ultraast rocket is already taking off and the regular rocket is not even close to being finished. There is nothing like this on the market today. You can use ultraast now with Astra and soon we're going to offer it for 6.1 soul as well. The decisions API lets the model respond in a fraction of a second is so fast. So it really feels almost instant to interact with. You can see here at using a computer and how quickly it's moving through these steps. This is not sped up. This works by giving our Luna model a predefined set of options to choose from like routing a request, classify an image, deciding what agent should do next, and by focusing the model on that choice, we can make it extremely fast while keeping capabilities like image understanding, broad language support, and safety protections. This starts with the codeex harness. It powers codecs work and now dots. We have put a lot of effort into making this harness very efficient so that you get accurate results at the fastest speed with the fewest tokens possible. We're making all of this available in the cloud. This is something I know you all have been waiting for. Codex is now fully in the cloud. [applause] It's been awesome to see how all of you have been creating 3D worlds with Astra the past few weeks. And I took a few basic photos of the venue to kind of recreate the same thing here. So, let's take a look. So, uh what's interesting here is that I'm can interact with the the room with ultraast. So, what I'll do instead here if we have a little difficulties with the the voice chat, uh I'll go back here and let's do something else with this room. Now, it feels a little empty. So, I'll say uh why don't you uh fly uh the dots to their seats for instance? It would be nice because uh those are empty so far. Time to bring the dot. And here they are. So, we're just changing this world in real time as we go. Pretty cool. Um maybe we can do something a bit more risky now. Uh and you know, why don't we just turn the camera to the room to the audience and I'll say uh put the live stream on the big screen. And let's see what happened there. Where we There we go. Wow. So, if you want to uh wave at the audience for those of you watching on YouTube, thanks for thank you for tuning in. We have completely refreshed the Codex CLI with tons of improvements you've been asking for. So, let's start with this empty project here in React. You know what? We're going to do ultra fast anyway, but this time uh we'll do it with simply um the the command line. So, we'll say uh build an app that picks three attendees at random. I want to give them free tickets for next year. So, let's see what happens there. So, here obviously it would be even faster and better with voice, but we've really brought like birectional audio in the terminal. Uh I wish I could show it to you, but we we have like all of these powered by GPT live. So, the same as in the app. So, this is not typically dictation. You could just like react in real time with all of this. Now, a few seconds in the making here and boom, our app is now ready with ultra fast. Make it uh six attendees. >> Why not? Don't blink. It should be fast. And boom. It's already changed, right? So, okay. Um let's bring this full screen. And should we click on this button? >> All right. Let's do it. Uh let's see who's coming back to Dev Day 2027 now. Six winners. Congrats. [applause] My dot will take it from here and email you the details later. Show us how you play the game. What's interesting here is that now we're instantiating a browser use connection. So that means that Astra will figure out how to control the game and learn how to play it in real time. So, in a second, it should be able to like start the game, choose a ship on its own, and if you take a look at the screen here on the left, you'll see the decisions that the model is making. But I love watching Astra actually figure out a game that was like, you know, designed for us humans, but then figuring out how to play it. Pretty cool, right? So, before I go, I wanted to show you one last demo that brings all of these modalities together. Our friends at HuggingFace kindly uh loaned us an early preview of their new programmable robot Micro Duck and that one's name is Lavender. Now, last try I uh last night I asked Codex to wire everything up here. So, let's take a look if we can connect to it, look at the audience, and make a cool drawing. All right, you're in this picture. Let's see what happens. Hey Lavender, can you quack if you can hear me? Uh, are you uh excited to be at dev day? Definitely excited. And here is the photo of all of you that you just made. Finally, with all of this together, we want to make it easier to sell your product to more businesses. So today, we're launching the OpenAI marketplace. We have 30 plus launch partners today including code rabbit, notion, burcell and more. And our enterprise customers can now use part of their existing open commitment to buy your products. This gives you another way to reach customers already working with us. And of course, if you have an open commitment yourself, you can spend it in the marketplace too. Through our partnership with base 10, you can even access open source models in the marketplace starting today. So thank you [applause] We shipped a lot of stuff this morning. New ways to work with AI with dots in space. New models with GPT 6.1 Soul and Ultraast. The decisions API, the agents API, codecs in the cloud, lots of new ways to help you build a business, drive consumers to you, and a bunch of other things. It's a big day for us and we're excited to see what you're going to do with all of
Assistir ao vídeo original no YouTube
Assuntos: Agentes de IA, Dots, Muse. Publicado no YouTube em 2026-09-29.
Seleção automática por assunto e idioma. O vídeo pertence ao canal de origem.