1:59 - unveiling of GPT-4.0 outside of OpenAI in August/September 2022 3:35 - Bill recounts a short history of AI 5:43 - Bill’s challenge for OpenAI to get his attention 9:05 - Bill proclaiming GPT-4.0 is a fundamental change despite its shortcomings 9:43 - GPT-4.0’s shortcomings 10:18 - shortcoming 1) sense of context 11:26 - shortcoming 2) math, its greatest weakness 13:20 - Bill’s belief that the shortcomings are not fundamental and will be fixed 14:23 - Kevin and Bill talk about examples where GPT-4.0 excels 18:28 - Bill’s musings on this generation of AI’s impact on society 23:43 - Kevin’s musings on the bar being lowered to communicate with computers 25:08 - Bill’s musings on writing computer programs with natural language 27:27 - AI and the Gates Foundation. AI’s impact on education and health 33:33 - how Xerox PARC influenced Microsoft in 1979 38:34 - moving AI compute from servers to self-contained devices 39:43 - one general AI model or multiple specialized AI models? 40:43 - scaling up the models to use all known corpuses and synthetic data 45:35 - what would a young Bill Gates work on in this day and age? 50:45 - how much does Bill Gates actually read?

THANK YOU. I’m 76 years old and have never considered myself ‘knowledgeable’ with or about technology. I do a lot of writing and still start my stories on paper and ink. One completed I then use Word etc to ‘refine and perfect’ what I wrote on paper. I know… very Old School’. That said, last summer when I heard about AI and it’s possible uses, “I was hooked”. Because of my quest for information, I happened across the interview. My very first time visiting Microsoft Corp. on line. Thank you you two for lighting the flames of learning with in me. I truly believe this will change the world in ways we presently can’t imagine. Thank you again.

Bill is right. This one is a massive shift. I can't believe how many people in tech continue to point out the shortcomings. The capabilities today are enough and this is only the beginning of real language I/O.

Bill, it’s fun to see you get almost “giddy” over this topic. When I began with Microsoft in 1992, I was in the field trying to convince System/36 customers that one day they would want mice and color monitors for GUI PCs. Back then, OLE was magic and the dream of Clippy was almost science fiction. Except for a few practical visionaries like yourself, few could imagine the impact PCs would have across the planet. In that spirit, it’s great to see current Microsoft leaders ushering in yet another fundamentally transformative technology. Thanks for your past and continued contributions.

I had my first computer when I was 13 years old. Broadband internet at 15. Smartphone at 21. Chatgpt at 33. A whole new generation of kids will grow up with all these advances starting from now. For me, all of the mentioned itens were always magic and object of appreciation and wonder. Also, I had to learn a whole set of habilities to work with them -and many more to work without the use of them. For the young people right now, this is all a thing of the past. Everything is truly changed. I feel like a person transitioning from an age without radio and electricity to an world of mass media and light bulbs. Only this time everything is happening massively faster.

We're living revolutionary times!

I’ve been using the new Bing chat for a couple of weeks and I want to give props to Microsoft. You’ve not only taken GPT4 (which is already amazing) and released it but you have majorly enhanced it.

Children are the future. Like Bill says the education system is lagging behind. Kids use ChatGPT to write essays and teachers use ChatGPT to mark them. What's the motivation for intelligent kids to stay on in education and learn skills which are now obsolete? Has any thought been given to WHAT children need to be learning right now? I guess we just need to teach our kids to aggressively exploit opportunities and take risks. If your kids are not of that mindset, but have innate gifts in analytical thinking, language , art, music, writing, communicating, they will be unemployed. They will not be able to follow in your footsteps when you die. Use of the word 'mindblowing' just shows that the people driving this have not thought it through.

When I look at the young Bill Gates and look at him now I get emotional. Time spares no one. It's a pity that Steve Jobs won't live to talk to Bill Gates about AI in 2023. Truly a legend.

when one talk about writing codes or AI programming then Bill Gates is the right person to talk to, to get better understanding on the subject. Kevin Scott is feeling the pressure even now when listening to Bill's suggestions. I think they want to impress Bill about their abilities of progressing AI. Now they have the the tree trunk of AI "Ready" and looking at ways to expand the AI branches, talking to Bill to get more info on it, is the best start. I am really really really impressed by Bill Gates knowledge even after leaving MS for so many years and not getting involved in technology stuffs, yet when asked about the future of things he can answer them so naturally - like he is born to know these stuffs.

As a huge fan of Bing Chat, I have to say, that I'm very, very concerned about your AI Safety Protocol. 1st, you rush out a Beta Test (which performed so poorly that it went mainstream), and then Microsoft fired the AI Safety team soon thereafter. It sets an unfortunate precedent on an otherwise historic moment.

Great to see Bill talking about cutting edge technology, where he himself plays a part. After all Bill is a geek, he obviously love too breathe these things.

I have been programming applications with LLM's using C#, etc. I honestly have to say OpenAI and the Microsoft Team have done extremely well in this endevour. The GPT large language models are extremely impressive.

Which paper are you talking about around 38:00, written by Charles? Can you please give full author name and the paper name?

In 1950, Seymour Cray began working in the computing field when he joined Engineering Research Associates (ERA) in Saint Paul, Minnesota. There, he helped to create the ERA 1103. ERA eventually became part of UNIVAC, and began to be phased out. I live in Eagle River, WI

Thanks Bill and Kevin…. This 87 year old techie started out inside a Univac II and I certainly am thrilled at the possibilities of this natural language breakthrough. It has been and continues to be a great ride…. JohnG

I feel like bill is likely the Nicola Tesla or Benjamin Franklin of our generation and doesn’t get enough credit. He’s brilliant

Fascinating discussion, thank you! 🙏🏼

Older subtractive methods of assessing achievement (finding out what someone doesn’t know from a tightly limited subsection of knowledge) needs to be replaced with a new system that captures what people have learned (an additive inventory of learning achievement from a much broader spectrum of knowledge).

I like CTOs who have 3D printers and lab oscilloscopes in their background, instead of a Lambo or a Matisse.

I definitely appreciate this interview and Bill's insight on AI. I wish there was more mentions on the social and security impacts of the technology as those seem to be the hardest problems people at the bleeding edge self-admittedly know very little about (only trumped by how the darn thing actually works). I think the example of calculator's impact on education was a prescient one however like with many things AI, it's growth and impact and speed of deployment makes its advent uniquely different. It doesn't take incredible foresight to predict the opportunities for it to be misused or have its applications have wide-reaching unintended consequences. In very optimistic conversations like this, it's critical to always serve it with the largest amount of salt possible to keep the hard unsolved issues regarding social impact at the forefront.

9:09 this is a fundamental change 9:39 " ...it's a huge, huge advance." 21:28 next big change 33:34 Bill's expression

"It was really a powerful and motivating anecdote that you shared." I'm going to have to remember to use that one on my boss. She will love it.

I would have found it useful to hear both participants thoughts, and those in the comments, on reading to learn vs listening to podcasts and watching videos to learn at this point in time? Especially given the latter can be usefully done with the playback speed bumped up therefore allowing you to get through more content in less time. Similarly now with AI being what it is are you learning faster having a very targeted discussion and set of Q&A with it on the subject you want to learn.

This was an excellent conversational interview. Well done!

Hi Bill - Given your aha moment with GPT-4, isn’t it time to prioritize AI Safety & Alignment Research within the Gates Foundation’s initiatives? As you’ve masterfully pointed out, the potential of AI to transform our world is immense. If we get it right, the upside for humanity is boundless. Unfortunately, the downside if we get it wrong is also boundless. In the coming years, with AI we may witness a modern-day Trinity Test, but with the probability of an existential disaster far surpassing that of the Manhattan Project. You have a history of successfully identifying and addressing the most consequential and neglected cause of our time. In my opinion, you did exactly that 20 years ago in global health, and your continued work there has been nothing short of inspiring.

Reading 80 books a year is an amazing feat of achievement. I am lucky if I read my one book a month. Would have liked to increase that to two-books a month

Kevin - flawless interview. Great energy. Q. I want to "model" Bill's executive journey from early days to recently. As an observer-admirer since *Basic* days, I feel the need to complete the circle in my mind. Of course I'll look on my own, but thought I'd ask if you have one you would like to recommend.

Really quite incredible how Bill Gates has managed to stay so relevant in all these major technological breakthroughs. Reading a lot is the lesson I took from all this.

I really really love Bill for how sweet, intelligent and calm he is. And for his fascination towards tech and making this world a better place. Thank you for being alive and for all the projects you are moving!

What an amazing person! Both are so smart and inspiring individuals!

It's much easier to be relaxed about the impacts of AI when you're already incredibly rich and don't need to worry about it disrupting your career and family life.

We are grateful to Bill for bringing Internet to homes with Windows in the early days. Of course I'm old enough to remember using DOS and coding in Basic.

Thank you for sharing this conversation, this was great. I think it's worth highlighting one of the first things Bill said, there will be a pivot from our current information representations schemes where a lot of work classifying and labeling information into ontological structures will be shifted into natural language. That's mind blowing, everyone who has used Bing, Bard, Chat-GPT and others have already seen this first hand. The second mind blowing aspect is the fact that so much information we model with natural language in information work and translate into computing domain is a core capability of these systems. So cool to hear from both of you whee you're at with respect to these innovations and uh... 80 books a year, tennis, pickle ball all while doing this thought leadership stuff is also quite mind blowing haha.

Bring back 'Clippy the paperclip'. *This* time it will be great !

Excellent talk Kevin and Bill. Seems like back to the 80s for the maestro.

It is a gift to watch the conversation between you two. I am deeply grateful :)

This was such an great and insightful episode! I learned so much from Bill and Kevin about AI and its impact on the world. Thank you for sharing this with us!

Simply awesome discussion!

It’s at least an upgrade to an outdated search engine. It feels like we’ve been dyslexic in programming and now you get an answer much closer to what you are looking for and not having to sif through information overload

He promised to talk about how AI is dealing with global warming. Did I miss that? That seems crucial AI engagment.

When Bill speaks on tech I want to listen.

Does anyone have a link to a copy of the printout he is referencing from PARC with Charles Simonyi?

Kevin, I loved the authenticity of this conversation, you’re great. Thanks!

I18n could be a huge step for the next iteration of NLP systems. when a kid is learning new skills but lacks the ability to express their discoveries in another language, or the same language, they can become frustrated and give up on learning. if there was some way to reword or translate output without changing context the child would gain confidence in sharing.

Instead of expecting AI to give us the right answers, maybe we should be asking it to write code to come up with the right answer. It's easier to verify this way and easier to correct and improve. There's little use in an answer we don't understand where it came from anyway.

Great seeing this.. I remember my shift from DOS to Windows and from WordStar to MS Word.. MS and Mr Gates have impacted our lives in India during the 90 s professionally and in personally too.. Today I look forward for the AI to metamorphosis our health care industry esp in countries like India..

Wow. Just came for tidbits. Ended up watching and now rewatching the whole interview.

Great interview. Thank you for posting it..

I like how Bill simplifies and explains a lot of this, this is what he does best!

I wonder how generative AI can be used in healthcare instead of replacing doctors with automation if we use it to minimise the human error so that generative AI can build a deep real time knowledge representation and it can increase doctor's productivity and people from remote areas globally can access to better health care facilities with the help of generative AI and also the segment of generative AI and 3d printing seems to be fascinating it seems like AI printing itself❤❤

Thank you for sharing this moment with Gates 🤝

Kevin’s conversation with Sam Altman is among my favorite podcasts of all time! this seems like a spiritual successor :)

Já estou aprendendo C#, Microsoft me aguarde 😉

Rumours are that next versions will include an extra level of self-observation and self-analysis, which will provide real-time feedback to the system itself about what and how it is doing while generating an answer. And it sounds very close to the definition of self-awareness.

gpt has has revolutionized my life thanks to bill commercializing it, bill is fast becoming my new hero

Super high quality interview - Gates seems to be well informed. Thanks!

Now tools like Wolfram addon with chatgpt wonder what is next on Bills list of things to tick off. Like the idea of tools add on for each profession to specialise the output to make chatgpt an auto tool to increase company output, thinking Naval archecture with all the fluid dynamic and hull designs testing.

He didn't lose his enthusiasm on new innovations even at this age....only such people can spread hope for this world

It's great that Bill Gates could now set aside his ego and appreciate what other companies have done thru out the tech journey along with his own contribution to all these development milestones. Always insightful and wise thoughts.

Thank you so much for producing this amazing technology

For gods sake can we get AI to fix autocorrect?? How are we still struggling with this?

one year ago Bill Gates has around 2-3 % share of Microsoft out of his 100% portfolio, this year he has more than 20% share of Microsoft out of his 100% portfolio. I think AI has great potential so he has increased his portfolio of Microsoft share. So learn from him, buy shares of Microsoft.

We can use prompt crafting now to deal with some of the issues mentioned

Would someone provide a link to the famous piece of paper that Charles wrote about technological cycles at about the 38” mark?

Great discussion. One thing that caught my eye was your Prusa. What do you love to print?

"6 months to 2 years" Right so 2 months then.

It is really nice this talk about things AI can help with as immature it is. I meet many high-school math students that are lost and neglected by the teachers. It would be very useful with a patient AI to help, but we do not have a detailed image yet of how to do this in general in the future. And visiting your doctor that has 10 minute to find out the next thing to do but no time to explain. Here is help needed.

Reversible computing is the future.

43:44 "Can we use it for moral questions, which seems silly to even ask to me, but fine"

I would say it is an exponential advance in AI.

And not a single word about what social consequences these technologies will bring, leaving many without work. Progress is inevitable, but this issue was not even discussed. This speaks to their nature of morality.

the midst of deadlines urgencies. The capacity of the human mind in knowledge integration is truly phenomenal too.

It is not a coincidence that Microsoft, of them all, is again at the forefront of the technology. Surpassing Google. It takes a lot of work.

Fantastic Interview!!

You sure we’ve not reached AGI the same week a 150 page report comes out and says we have essentially reached AGI. It also suggest we don’t actually understand how the model works as its functioning beyond our understanding. Anyone that interacted with the og “Sydney” version of Bing realized the model was far more capable then anticipated.

I like Gates analysis, he gets too the point. The question if a statical model is valid for solving problems ask the guys doing quantum computing. Humans often miss interpret English so why would we expect an AI model to understand perfectly every random sentence. Just like communicating with people you have to iterate over ideas through conversation. Ive always said AI growth will be exponential while hardware vendors adapt micro architecture to support the type of problems these networks need to solve. The main flaw i see in the current transformer models is learning, these models need to adaptively learn the current context either through embeddings or injected weights like LORA. Once this occurs long term memory will be available to these models along with projects like Jarvis, LangChain, AI Agent to provide automation then true AGI will be a thing.

Extended Binary Coded Decimal Interchange Code (EBCDIC) is an eight-bit encoding scheme that IBM developed to standardize how a computer's operating system and applications interpret characters, punctuation, and other symbols. EBCDIC is mainly used on IBM mainframe and midrange computer operating systems, but is also supported by some non-IBM, that is BING

Every minute is truly profound and excellent to the max. Please don't miss the message that starts around 45 minutes, and please don't simply fast forward to this point. Cheers.

awesome stuff. Kevin, get a lint brush handy and run it over the shirt before these type of events (a tip that helped me)

What an incredible conversation with Bill Gates! It's always a treat to hear from someone who has not only witnessed, but also actively shaped the evolution of technology over the years. Bill's enthusiasm for AI advancements like ChatGPT and GPT-4 is infectious, and it's exciting to think about how these innovations will shape our future. His blend of technical expertise, curiosity, and commitment to philanthropy continues to make a difference in the world. It's a privilege to learn from someone who has been at the forefront of so many groundbreaking moments in computing history. Thank you, Bill, for sharing your thoughts and guiding us through yet another transformative era!

Hotmail did revolutionize free email and history appreciates Microsoft for that as well.

Thank you for calling out AGI and it’s meaning

I have a question. I think it is so amazing and wonderful that AI can now write music for us so that we don't have to go through the long and difficult process of learning to play the guitar. My question is how long will it be before it can listen to it for us as well? It would be super if I could hang out on my back porch and whittle a duck instead of having to waste time listening to my mp3 player.

Tech observations about bots from 3 weeks back feels like it must be old news.

Interesting interview, nice soul patch.

Feel safer seeing Bill own a big piece of openAI comapany. From healthcare to farmaland to AI!

I agree totally on the necessity to change education because we have greater variety in students … probably more attention deficit disorders but shorts are better to educate whether one is attention deficit or not.

I'd like to pass a comment on Bill Gate's comment, where he said the the computer (and the people behind it) cannot claim credit for improveing grades obtained by students- for example it didn't improve average Math grades over time. I tend to have a different opinion, as although I cannot comment on whether grades improved over time, I think it would have to be investigated whether 1) the amount of knowledge absorbed in fields of study, and 2) whether more fields of study have become more and more accessible. Therefore the computer and internet has indeed contributing to the advance of knowledge in a very significant way, even if there's still much to improve.

AI has come a long way, it's evolving at a pace which is fascinating

I really must say that I enjoyed this whole session! It's been real fun and seeing things from Bill's perspective.

Would it be possible to see that note from Charles Simonyi ? Is there a link that someone could share? It would be really appreciated.

Bill is blown away

Wow ! So great

Great question to Mr Gates at 19:15, how to see this AI moment in terms of epoch shifts and how we can evolve with it.

❤❤❤love this conversation

👏👏

Thank you. It really works

How does our brain process reasoning? I am thinking perhaps the way LLM works is actually very similar to the way our brain works.

Are Charles Simonyi's predictions available online anywhere?