OpenAI DevDay 2024 | Structured outputs for reliable applications

[@HackingWithRJ]

Atty and Michelle, you presentation was tight and your delivery was spot on! From a dev's perspective who need convincing that this is worth using, Michelle's explanation at 25:00 is really key. FWIW, consider front loading that on future explanations.

[@real-ethan]

I would say function calling & structured output is the best thing ever of LLM.

[@TechLoveMusic]

Guys, we developers are the first to see the future, what an honor OpenAI has given us. Let's do it

[@NathanOen]

This is amazing. I had goosebumps watching this video. It's such a powerful tool, elegant design, and research.

[@The_Collective_I]

19:20 - not too far from agentic workflow that’s fully automated, this is promising. 25:28 - I just realised she’s incredibly pleasant to listen to, both professional and professionally but friendly presented. It would be a huge improvement if we had Sam Altman replaced with her for all the important presentations. 36:07 - 🧐 cumbersome but I’ll wait until after I actually test it. 39:34 - the agentic improvement is seriously impressive. 40:19 - AGI is certainly shaping up to be positive if this is how we are going to get there. 40:39 - thank you 🙏🏻

[@ai._m]

Thanks for the erectile timeline. Get out of the basement once in a while.

[@Calbefraques]

This was so valuable, I have a feeling this work was fundamentally required for o1, and we are now all benefiting 😊 This innovation has potentially the ability to upgrade every UX to a interoperable, lightweight and fast API. Bringing context to all the data moving around. Agents having an ability to exchange a cache of how to structurally interact with what they see. The fact index is a tree means that selecting the appropriate index cache can also be an inference step, opening up the ability to scale down the effort to compile novel versions. With most UX being derivative. I’m very impressed, and love the philosophy surrounding this work effort. The ending comments about our collective ability to see and make the future was lovely ❤

[@ehza]

The idea of token masking is so cool. Nicely explained too. Thank you OpenAI.

[@jmg9509]

13:20 16:13 - Can use function calls to control the client UI 39:29 - Agentic flows can work 100% of the time

[@oliverzhang6102]

This sounds trivial (compared to O3 or Sora), but it is really useful. 100% accuracy! Amazing! And I can't wait to update my code now to implement this!

[@faaranmohd]

This is awesome and much needed . Great work

[@RandomGuy-up4bv]

They literally said "you will help us to reach AGI, thankyou for building us."

[@bahadircolak]

thank you for this great work, as a developer I'm super excited to try them all :D

[@siva18k]

Great work love structured output

[@Cloudvenus666]

Pls OpenSource that fictitious convex app, as I like to see how you guys made the generative ui work without pre-building components with that schema or point me to a documentation that describes the concept.

[@shaxzodrashidov673]

It's just wonderfull, amazing news

[@ajithboralugoda8906]

Great Presentation! good to know the insights Thank you.

[@Vinod_Kumar827]

Very well explained

[@martinomg]

Pretty much all of current models work most of the time, sometimes they have some json formating errors but that's it. There's a lot of tools to extract json. Also I normally use them to output multiple code blocks at the same time. The amount of times I have triggered a format error with my json schema validator (I use ajv) can be counted with my fingers 😅. Most of the errors I see are not adding quotation marks to the keys.

[@wesleymogaka]

That's exactly my sentiments. Even 3B models can output json, which can easly cleaned using a simple python function

[@Joooooooooooosh]

31:10 Some regular expression implementations support balancing expressions which would work, but Regex only still wouldn't be the right solution.

[@MohammedAnnus]

amazing presentation

[@ONESTTEFTEO]

Any idea to build a useful LLM like Sonnet 3.5

[@mulongoduncan9308]

People missed this: OpenAI has not only showcased groundbreaking development in AI but also its talent from all walks of life. Ethnicity, Gender, Age; all balanced. I love how smart you're. Keep this burning 💥

[@danielbrockman1221]

explaining basic properties of regular expressions was not something I expected from an OpenAI video

[@ИванИванов-б8у4и]

Гении презентации...чтобы не заснуть нужно очень стараться

[@spooky.giggles]

Justice for OpenAI whistleblower Suchith Balaji

[@89gregpalmer]

Does anyone know if some version of structured outputs is available for llama models?

[@mkbrk]

I've said it before, I'll say it again: structured outputs move the needle on GDP

[@bhagat7572]

Justice for Suchith Balaji...

[@MorrisHsieh-]

Is this a new vid or recap on Dev day in Oct?

[@maximilianalexander2823]

its from oct

[@ak-gi3eu]

Can u talk about the Indian who died ( murdered )who worked in open a.i for justifying about privacy

[@kparag01]

What is her name

[@MUHAMMADAHMAD-c7m]

Amazing! Can I get the example code?

[@aliettienne2907]

22:42 If tokens are made up of fragmented words which are map to full language content then tokens should help to improve general guessing of LLM models. I wonder what eles will be better than such structured design (tokens design). 💭🤔💭🤔💭🤔

[@abdulmuqtadir3535]

Please can we please get the access for app and repo 12:19

[@saumyaranjannayak2101]

This is super cool!

[@FuzailShaikh]

Why would we ever need strict property to be false?

[@nikunj-openai]

you wouldn't - but we needed to keep the option there for backwards compatibility with functions that existed before structured outputs was launched.

[@jmg9509]

@@nikunj-openai I had the same question, and I think @nikunj-openai gave a reasonable answer.

[@FinanceLogic]

@@nikunj-openai to not overfit it down the wrong thinking path with your prompts and assumpstions. Or so it can be flexible and creative etc.

[@athyuttamre]

There are also some features of JSON schema that strict mode doesn’t support e.g. min length, extra properties, optional properties, and so on. If those are important to you, you can still use response formats (and expose your schema to the model in the way it was trained) but not force those limitations during constrained decoding.

[@mipad553]

Does mac m4 support egpu

[@abdulhassansayed6099]

Justice for suchir balaji

[@EndTimesStream]

Amazing

[@Daniel-rk2qz]

Am I getting something wrong? I thought these were already in place what’s new with this?

[@Nitesh14D]

wow

[@real-ethan]

How function calling implemented? Token mask?

[@Joooooooooooosh]

Yes

[@quintentwo]

Why didn't you guys edit out the alarm that was going of at the beginning. Really annoying to concentrate

[@elkafaachannel]

I don't see why someone would use function calling over response format. Function calling seems like a subset of response format. If I get a response with a format that I wanted, I can then use the response to call a function or any other use case.

[@JTMoustache]

Choosing from a set of well defined and modular functions is often easier for the model than handling highly variable context-dependent outputs, even with a fixed schema imposed.

[@athyuttamre]

The model has been fine-tuned on the concept of tools / functions, so the quality of function choice and function bodies will be better than using plain response formats. Like all features of LLMs, what’s in the training data affects the model quality, so always good to align your usage with the data!

[@Muslimkidstvpoem]

ChatGPT was launched on November 30, 2022 as a prototype by OpenAI, an artificial intelligence research company:

[@14-Peaks]

*Justice for Suchir Balaji*

[@siva18k]

Could you share the code for recruiting app?

[@mudassarm30]

I did say it last night, "Why the hell you are not doing what I am saying you to do!!"

[@MohammedAnnus]

2024 was all about chatbots and 2025 is all about AI Agents

[@siva18k]

Pls share resume app code

[@ChadKovac]

You could almost do the same talk today that you did yesterday and have it already be obsolete...

[@Philosophy_IQ]

damn she kinda bad tho

[@saamarthyadav8674]

What do you mean 😢

[@NatureLover36963]

Killer 😢😢😢 Ban open AI in India..

[@RussoConcerned]

Good. We can now get rid of the CEOs. They cost too much.

[@user-jm6gp2qc8x]

Alright clickbait.

[@AKASHROY-i9f]

I guess this guy is Indian

[@jiuyi7273]

nb

[@SajidAfridi-t7l]

Crazy’s

[@js913]

Is she ai

[@SingularityReacts505]

first again😅😅😅😅😮

[@nobody_cares_you_were_first]

Nobody cares

[@SjarMenace]

Omg so cool

[@SjarMenace]

What a boring presentstion get to the point

[@rinrin-rl8ye]

能不能不用咖喱英语

[@bowenwang]

[@user-mdshamsnur2003]

I would say function calling & structured output is the best thing ever of LLM.

[@will_strong_forme]

Amazing