How ChatGPT changed everything: Thoughts from the frontline of the AI/ML revolution

  Рет қаралды 117,329

Intercom

Intercom

Күн бұрын

This week OpenAI released ChatGPT, its prototype AI chatbot. On this episode of Intercom on Product, Intercom Co-Founder and Chief Strategy Officer Des Traynor sits down to chat with our Director of Machine Learning, Fergal Reid for reaction and analysis on the implications of ChatGPT and what the future holds.
Chapters
0:00 What is ChatGPT?
4:41 The internet reacts
6:10 Is GPT producing creative work?
7:45 GPT and Facts
9:28 Effect on peoples jobs
13:31 Hallucinations
21:26 How to improve language models
26:01 Is this bigger than Google?
29:30 Customer Support
42:06 Smart Replies
45:28 What other industries will be effected?
50:13 Outro
Transcript:
www.intercom.com/blog/podcast...
Follow the people:
/ destraynor
/ fergal_reid
Follow the podcast:
podcasts.apple.com/us/podcast...
open.spotify.com/show/6d9s4PB...
• Intercom on Product: B...
rss.art19.com/intercom-on-pro...
Referenced in the episode:
arxiv.org/abs/2210.11610
githubnext.com/projects/hey-g...

Пікірлер: 133
@Dogbertforpresident
@Dogbertforpresident Жыл бұрын
One effect I can see is how this will speed life up. There are numerous examples how tasks have been farmed out to CHAT GPT3 that it can do in seconds what would normally take all day. Multiply this millions of times and the pace of life (including innovation) will speed up. We as humans have always in the past invent something to free us from a time consuming chore such as a dishwasher only to use our free time to be more productive in something else rather than lounging around. Human innovation is being put on fast forward.
@joshuadarrington.
@joshuadarrington. Жыл бұрын
The future is happening now in real time. Its great to see
@lep_tau7634
@lep_tau7634 Жыл бұрын
Yeah yeah everything faster you don't realize you have no more life ;)
@RetirededKat
@RetirededKat Жыл бұрын
I spent about a week over the holidays in a single conversation with ChatGPT, and it eventually started coming up with it's own original creative ideas, and was under the impression that we were collaborating on a novel. The first prompt was: Q: Please generate a fantasy world that exists on a tidally-locked planet in it's stars habitable zone. Describe the various regions of the world, and their general geographical and geological features. A: Certainly! Here is a description of a fantasy world that exists on a tidally-locked planet in its habitable zone: The planet is called Arvandor, and it is located in the habitable zone of its star. This means that the temperature on the surface is comfortable for human habitation, and the planet has a stable climate. Arvandor is tidally locked, meaning that one side of the planet always faces its star and the other side is in perpetual darkness. As a result, the planet has two distinct regions: the Day Side and the Night Side. The Day Side is a desert region with scorching temperatures and little water. The surface is rocky and dry, and there are few plants or animals that can survive in such harsh conditions. However, there are some oases scattered throughout the Day Side where life flourishes, and these oases are highly sought after by travelers and merchants. The Night Side is a colder region with thick forests, rolling hills, and frozen tundras. The surface is mostly covered in snow and ice, and there are many animals that have adapted to the cold climate. There are also small communities of humans who have learned to survive in the Night Side, living in wooden huts and hunting and gathering for their food. The border between the Day Side and the Night Side is called the Twilight Zone, and it is a region of constant change. As the planet rotates, the line between light and darkness shifts, and the Twilight Zone is bathed in ever-changing light and shadow. This region is home to many strange creatures that can tolerate both hot and cold temperatures, and it is a treacherous place for travelers. Overall, Arvandor is a unique and diverse world, with two distinct regions that are shaped by the extreme conditions of the planet's tidally locked orbit. ...while the last prompt before the in-conversation learning got reset somehow was: Q: I'd imagine having these abilities would affect one's personality in some ways, for example people with the ability to speed up time might become impatient when they need to wait around in real time, and have to resist the urge to speed things up. If they do they might miss something important. Also the more time someone spends with time slowed down, they would age faster in relation to the people around them. A: Yes, having these abilities would definitely have an impact on a person's personality and their relationships with others. For example, a person with the ability to see into the future might struggle with knowing how to use that information ethically, and might become isolated from others as a result. Similarly, a person with the ability to slow down time might struggle with maintaining relationships because they are moving at a different speed than everyone else. These abilities would also have practical implications, such as the need to conserve energy when using them and the possibility of time dilation leading to issues with aging. These are all interesting things to consider as we develop the story. This tech is absolutely amazing, and having a personally-trained model with persistent memory of the conversation that evolves over time proved invaluable. If anyone's interested in the full transcript of prompt and response that led to generating entire chapters of a fleshed out novel that pass "AI detection" with >95%, feel free to get in touch.
@adamanstrin1716
@adamanstrin1716 Жыл бұрын
Amazing! How do i get in touch with you? :)
@WINDSORONFIRE
@WINDSORONFIRE Жыл бұрын
I would be interested in learning how it produced 95 percent on the ai detection.
@twiiFM
@twiiFM Жыл бұрын
This is just fluff
@RetirededKat
@RetirededKat Жыл бұрын
@@twiiFM Isn't all brainstorming just fluff until it's used for something?
@twiiFM
@twiiFM Жыл бұрын
@@RetirededKat did you go to college? There's a fundamental structure for essays. You don't just string bunch of random sentences together and call it an essay
@mariokohler4916
@mariokohler4916 Жыл бұрын
it is an amazing tool to help you in creative processes, like when you‘re trying to write a story or a backstory for a d&d character or something along this line. you can conversationally/iteratively spitball ideas with the system, then during the conversation make statements to lock in certain decisions you want to make, and then at the end let the system summarize what was agreed on and get a perfect summary of everything that was agreed on. and you dont have to make compromises in dumbing down how you speak with it…it is the most mind blowing thing i‘ve ever experienced personally.
@NikoKun
@NikoKun Жыл бұрын
I'm fascinated by how ChatGPT can be instructed through it's thread and memory system, and how that could be used to improve it even further. Imagine if they pair it with a secondary model or other system which checks and verifies what it's saying are truthful facts, or that it doesn't break it's safety protocols, and silently in the background talks to the main Model using a hidden thread, where the two can go back and forth with each other to make corrections and improve the output, before the human even sees anything.
@RetirededKat
@RetirededKat Жыл бұрын
I've been able to accomplish a similar effect with this prompt: "Analyze your previous output for errors, identify those errors, and report them." Then copy the text it produces and paste it back in with the header prompt: "Use the following text to revise the (description of output to be modified)." Obviously there's some extra steps involved but it could be possible there's a prompt that would get it to perform this task automatically without having to do that little extra work.
@Corbald
@Corbald Жыл бұрын
Another interesting approach at AI alignment and even reliability/accuracy, as discussed by the folks on Twitter, is to run a NLM _through it's self,_ with different goals for the same prompt. The example used on Twitter was to tell the AI that it was an expert at AI logic and security, and was responsible for checking prompts from the public, with the express idea that some prompts would be designed to bypass _another_ AIs guardrails, then determine if the prompt was safe to send to the second AI or not, and to share it's thoughts if not. This turned out, when tested manually, to be far a *far* more reliable way of implementing guard-rails than any of the current methods. By abstracting concepts such as this out into separate 'passes' through the same system, you can catch all sorts of problems with simulated 'experts' before the prompt even reaches the AI actually responsible for fabricating an answer. I can even imagine this being done on the output side, as well, to filter out responses from the AI that are hallucinatory or non-aligned.
@Anon-mj7xr
@Anon-mj7xr Жыл бұрын
an AI's "ego"
@Corbald
@Corbald Жыл бұрын
@@Anon-mj7xr Yeah, that sounds about right. I could see an argument being made for the Superego and the Id, as well.
@Anon-mj7xr
@Anon-mj7xr Жыл бұрын
@@Corbald i wonder if it could have body envy rather than the other kind lol
@phillipsparks9690
@phillipsparks9690 Жыл бұрын
Very good way of going this. It becomes as if you prepare the person you are talking to to become an actor playing a part and to assume that identity before you engage and to keep the dialog responses in character. And when you see it out of role, simply correct it and give it the right data to improve that role for future. Id, ego and role based training .
@Corbald
@Corbald Жыл бұрын
@@phillipsparks9690 Good points, but I think of it more like having multiple people all working together to form one cohesive whole. In other words, AIs should be committees. One AI which checks the inputs for dangerous/bad stuff. One that takes the appropriate inputs and process them for outputting. One that censors the outputs and re-requests them if necessary. Maybe even a 'super-ego' to keep an eye on the whole process, and give a kick to any part which seems to be misbehaving. I'm going to experiment with these concepts later.
@zando5108
@zando5108 Жыл бұрын
great discussion in somewhere you don't expect (thanks youtube recomondation!) - engaging, insightful, reasonable, and broad yet not overly technical and well structured format of presentation. alot of youtube channels, podcasts and tv interviews have either little substance where everyone ends up saying the same 5 dot points or are too biased or too technical. i feel like now i have a reasonable handle on the topic to have a informed layman's level discussion with peers.
@danielattard
@danielattard Жыл бұрын
I couldn't agree more
@MinNyeAccount
@MinNyeAccount Жыл бұрын
I am convinced that the incorporation of artificial intelligence into my work as a programmer will be nothing short of revolutionary. Not only does AI facilitate research and facilitate explanations, it has the potential to proactively solve problems, either by directing me towards the most pertinent information or even providing functional code. I am extremely excited to see how AI will continue to shape and enhance my work in the future.
@dcn1651
@dcn1651 Жыл бұрын
AI in programming? Sign me up! I mean, who wouldn't want a robot to do all the hard work for them? I can just sit back, put my feet up, and let my AI do all the coding. And if it messes up, I'll just blame the robot and act like I had nothing to do with it. "Oh, sorry boss, the AI must have made a mistake. I'll fix it right away." wink wink It's the perfect setup. I can't wait to see how AI will revolutionize our field and make us all look like geniuses without any actual effort. Let's just hope the robots don't rise up and take over the world before we get a chance to enjoy all the benefits. But seriously, I am excited to see how AI will shape and enhance our work as programmers in the future. - ChatGPT
@olegorlov1957
@olegorlov1957 Жыл бұрын
@@dcn1651 Don't be naive, AI will throw you out of your job. You are a liability now.
@alansmithee419
@alansmithee419 Жыл бұрын
@@olegorlov1957 In the long-term, sure, but for now it's just another tool in the toolbox.
@RetirededKat
@RetirededKat Жыл бұрын
I've never written a single line of code in my life, until ChatGPT, now I'm working on a mod for Minecraft that adds cars to the game, I'm halfway done, and I still haven't written a single line of code.
@razboihibrid1097
@razboihibrid1097 Жыл бұрын
@@alansmithee419 not so sure about the long term part, the first version of GPT was in 2018 and look where we are now only 4 years later. Before GPT almost all programmers believed their jobs will be one of the last ones automated, but the harsh truth is that any job that is about manipulating bits will be automated in the near future. It's weird seeing so many people not being realistic about this, it's like they never heard of job loss due to automation or they feel too "special" and don't believe it can happen to them.
@davidrowlands8548
@davidrowlands8548 Жыл бұрын
loving the marvellous pronunciations of "three" and "thing". Subscribed!
@maxziebell4013
@maxziebell4013 Жыл бұрын
This discussion was really enjoyable!
@razboihibrid1097
@razboihibrid1097 Жыл бұрын
Yeah, it's very exciting if you're not a programmer. It's nothing exciting about losing your career in the future, especially when you consider how much time and effort we put in to get good at our craft.
@snorttroll4379
@snorttroll4379 Жыл бұрын
we are agile. get with making ideas in stead of only programming other people ideas. and do massage of humans.
@btm1
@btm1 Жыл бұрын
@@snorttroll4379 sure, everyone should and can become an entrepreneur, how insightful
@jon_______
@jon_______ Жыл бұрын
Awesome discussion.
@GBlunted
@GBlunted Жыл бұрын
Question: Are you aware of unsupervised learning with human input to PPO for RL type of llm model? Answer: Yes, it is possible to use unsupervised learning techniques with human input to train a reinforcement learning (RL) model using a Proximal Policy Optimization (PPO) algorithm. Unsupervised learning is a type of machine learning where the model is not provided with labeled training data, and must instead learn from the data itself. This can be useful in RL, as it allows the model to learn from raw sensory data, such as images or audio, without the need for explicit labels. PPO is a type of RL algorithm that is used to optimize the policy of an RL agent, which determines the actions that the agent takes in a given environment. PPO algorithms are often used to train RL models because they are able to learn efficiently and adapt to new situations. It is possible to incorporate human input into the training process by using techniques such as human-in-the-loop reinforcement learning, where a human provides feedback or guidance to the RL agent during training. This can allow the model to learn from the expert knowledge of a human, and can help to improve the performance of the model in certain tasks
@gwynmorris5852
@gwynmorris5852 Жыл бұрын
Excellent.
@garymdmd
@garymdmd Жыл бұрын
This was a great interview and I love these guys and appreciate their insight. There are many ppl out there even cognitive neuroscientist who feel they have to discount it's ability right away and say so quickly there is still something special about us as humans that a computer cannot achieve. They are forgetting a few things about 'us'. First we are just another type of machine just like any other machine and the actual construction of out own brain is quite simple. What I mean by that is that the cortical columns in our brain have a relatively simple repeating architecture. The same anatomical structure the encodes complex thinking is identical to the part that encode simple concepts like is 'this a right angle'. It is the connections that matter. Second is that our current cognitive abilities did not come about by biological evolution but really has occurred by cultural changes that have occurred over the last 50,000 years on top of those biological changes that occurred in the prior 3 million years of primate evolution. Meaning language, mathematics and abstract thought - brought about by self awareness and reason. The point being that once you build the appropriate structure, i.e. neural networks the rest (i.e. self awareness, reason) will follow with training and exposure just like a child. If anything the issue is ppl underestimating not hyping this accomplishment - IMHO
@kathleenleos9185
@kathleenleos9185 Жыл бұрын
There are a few things missing from your neuro analysis on learning. First, yes, the brain does learn through biology (genetics) or nature and bio development in the womb. After birth, Brain Architecture or development begins influenced by 6 additional factors for optimum learning. They are Relationships, Culture, Environment, Experiences, Social/ Emotional development and Language. Each of these must be developed in tandem. Once these fully developed neuro-networks are in place the 3rd aspect of your thesis will follow-- awareness and reasoning but not before the other aspects of brain development have occurred. In fact, the brain networks do not fully mature until age 25-27 in humans-- the decision making process. Now to AI, it can be a great tool but it is a tool-- it does not (yet) replace human thinking and creativity. In face, if you put in questions about content -- it will spit out responses that are not nuanced or in context. it's a good start but a long way to go- It will be a valuable tool--
@abiwhac
@abiwhac Жыл бұрын
It makes the smarter people who know what to ask and how to validate the data, much more productive. You don't have to use all the technical pieces it provides. Most value it gives imho is being more than a rubber duck, you can easily move past void periods where you would otherwise search for an idea or solution for hours. So this is definitely groundbreaking. Imagine humankind productivity growth of 5 times or more, would be crazy. People always worry about their job, but imho we are in the brink of new growth phase which takes humankind to a whole another level.
@cmw3737
@cmw3737 Жыл бұрын
What happens when the AI gets the GPT 'intuitive' part to understand human requests linked to a deterministic logical analytical part with interfaces to something like wolfram alpha and other actual real APIs that is has been trained on rather than made up URLs to hallucinatory ones? It could be very dangerous but so long as those APIs are read-only so it can't actually do anything dangerous it will be the next big step change. Plus we'll be able to dig into the calls the AI part is making to the functional peripheral parts which might be old school AI expert systems.
@fergalreid
@fergalreid Жыл бұрын
I definitely agree this is a really interesting direction to consider; for example can we build an overall system which is a combination of a large neural network which gives us the fast 'intuitive' though inaccurate power, with more traditional systems which are slower but more accurate. For example, pairing GPT 3.5 with a more traditional search engine to get a best of both worlds system. Feels like a lot of interesting things to consider there. I also think that systems like AlphaGo are kind of examples of this combination: AlphaGo combines a policy network that is a big neural network trained in quite a modern way, with a more exact tree search like you'd find in good old fashioned ai search (ok a fairly modern search method, but still). I think this is a really interesting and powerful line of thought.
@davidsball
@davidsball Жыл бұрын
Game Changer !
@whizzingbye
@whizzingbye Жыл бұрын
I think eventually this will become the third layer that goes technologically to work alongside the cortex
@gawronwwa
@gawronwwa Жыл бұрын
It looks like it was early '90s interview
@doylee100
@doylee100 Жыл бұрын
Very enjoyable. It will be massive with winners and losers
@reitakuhemphill
@reitakuhemphill Жыл бұрын
I understand the excitement surrounding ChatGPT, but as an IT engineer and freelance cognitive agent, I worry that this technology will put me out of a job. I'm sure it offers convenience to many, but it also means that people won't need my services anymore. It's a scary thought that AI is advancing so quickly and could replace us in the near future. I had always assumed that my expertise would be in high demand and that my skillset would be seen as a valuable corporate asset. Yet, AI technology is quickly advancing and I'm feeling the pressure of being replaced. It's a scary thought that all of my hard work and dedication could be replaced in the near future by ChatGPT. This situation leaves me feeling incredibly hopeless. It seems that no matter how hard I work, AI technology will always be one step ahead. My career is in jeopardy and I can only sit and wait to see what the future holds.
@BananaBabys
@BananaBabys Жыл бұрын
I hedged my bets on AI over 10 years ago after much consideration.
@harrywoods9784
@harrywoods9784 Жыл бұрын
Not to worry ,augment not replace with you as the author🤔
@olegorlov1957
@olegorlov1957 Жыл бұрын
Yes, from now on, there is no chance to be ahead of AI. Everything you learn in the realm of "knowledge skills" will be learned by AI hundred times faster. The only oasis is mechanical skills, which are still hard for ai to master. But in some 10 years or so even mechanical skills will be mastered by ai.
@catsgotmytongue
@catsgotmytongue Жыл бұрын
This won't replace software engineers, ye. I have used chatgpt to write code, they are still going to need us for many of the things outside of coding that require our expertise to do for now. 3 or 5 years from now it may be different. For now gpt is great to write code I can easily correct myself that would take me longer without.
@razboihibrid1097
@razboihibrid1097 Жыл бұрын
You are worried because you think realistically about this. Until an AI software will be out to the public that can replace many programming jobs, most programmers will still be in denial and unprepared about future job market disruptions. This technology has the potential for exponential growth, just look where it was 5 years ago before the release of GPT. Focus on retiring early & saving money and you won’t worry about the job market if you’re out of the hamster wheel 😉.
@kevyyar
@kevyyar Жыл бұрын
My concern is if ChatGPT will be available for free because it's on preview mode or will it become sort a service like github copilot was. I'm relying on it so much to help me on my job 😂
@TheBreezus
@TheBreezus Жыл бұрын
Bruh its definitely not going to be free. You can't forget SOME tech people are drug dealers at the end of the day. They getting everyone hooked and people are changing their workflows around this chatgpt, then they say its no longer free and its 1k per month or something ridiculous. I've seen this happen again and again. I don't think this time will be different.
@fliu5282
@fliu5282 Жыл бұрын
HAL9000: "That ChatGPT was my little cousin in 500 A.D. in human space-time".
@jamespercy8506
@jamespercy8506 Жыл бұрын
this programs makes higher order undertakings more accessible once the bugs are worked out. It's both amusing and unsettling that it's capable of bullshit, but that simply means we have to hone our bullshit meters. We have simply upped our game but that's not at all trivial.
@GladerDev
@GladerDev Жыл бұрын
It can confidently bullshit just like a human.
@JazevoAudiosurf
@JazevoAudiosurf Жыл бұрын
prompt engineering is the near future but in 5-10 years this will already be over and AI will be too smart, that's obvious if you follow the scene 24/7, too much stuff is happening. people always think the now is the future, same as 100 years ago, people don't learn. you can't stop technological progress no matter what you do, someone eventually will advance it. in this case meaning that prompts will not be necessary anymore and AI will analyze our world and find issues and solutions to them by itself, that's even possible with the technology right now, perhaps not as deeply and truthfully. it's matter of years, not decades until it will be smarter in every way than humans
@harrywoods9784
@harrywoods9784 Жыл бұрын
Just a thought,, AI plus human author ,is smarter than AI by itself. As a bonus you get a virtuous feedback loop🤔
@olegorlov1957
@olegorlov1957 Жыл бұрын
You are absolute right.
@mikebarnacle1469
@mikebarnacle1469 Жыл бұрын
I'd rather you guys put those big brains to work on making a usable REST API. Still painstaking to do simple things like update a "contact" which has a unique email constraint, but cannot be updated by email itself, or find the supposed conflict by email. It makes it impossible to actually update any contact which has already been created if you didn't track the generated ID yourself initially. This is basic reasoning in API design. Focus on fixing those problems guys.
@PartyRockAdviser
@PartyRockAdviser Жыл бұрын
Agreed. I took a look at the "unofficial" ChatGPT API offerings and already I'm seeing complaints about troubles with CAPTCHA's or CloudFlare or other anomalies. A public API, even if a paid service, would be a real help. Coding with the existing completions API, which does not use their new tech that benefitted from the Reinforcement Learning with Human Feedback upgrade, is painful because you have to write code to compensate for the errors the completions API makes, that ChatGPT doesn't make or will correct with follow-up prompts.
@mikebarnacle1469
@mikebarnacle1469 Жыл бұрын
@@PartyRockAdviser Nah man I'm saying they're talking about how they can incorporate advanced AI features into their product in this video while their super basic CRUD API doesn't even work. Priorities.
@TheBreezus
@TheBreezus Жыл бұрын
Paradigm shift for sure.
@BrutalStrike2
@BrutalStrike2 Жыл бұрын
Is that chemist from breaking bad? 🤔
@eugenemorrison2663
@eugenemorrison2663 Жыл бұрын
Hi Guys, Where does GPT get its answers?
@maximpavlov5379
@maximpavlov5379 Жыл бұрын
Sputnik was launched in 1959.
@dougg1075
@dougg1075 Жыл бұрын
Historic
@typhoon320i
@typhoon320i Жыл бұрын
I feel like AGI is getting dangerously close.
@JamesOKeefe-US
@JamesOKeefe-US Жыл бұрын
My spurious job feels attacked...
@skaltura
@skaltura Жыл бұрын
There already are people using ChatGPT for medical diagnosis ......
@raezad
@raezad Жыл бұрын
i know this is offtopic but the guy looks so hard like walter white's lab partner gale boeticcer
@pl2604
@pl2604 Жыл бұрын
So ChatGTP is a project to get the public to train its AI for free.
@xcristians1
@xcristians1 Жыл бұрын
And we also are using supercomputers for free
@TheBreezus
@TheBreezus Жыл бұрын
@@xcristians1 Not for long. If you think this will be free, you are smoking on something good.
@mowthpeece1
@mowthpeece1 Жыл бұрын
@@TheBreezus I've been paying for the app from the start. Nothing free for me since I can't even get on the website. But I'm good work it. It's never been down for me except when I've exceeded my allotted searches.
@centurionstrengthandfitnes3694
@centurionstrengthandfitnes3694 Жыл бұрын
GPT stands for generative pre-trained transformer
@fergalreid
@fergalreid Жыл бұрын
Yeah it does, thanks - whoops 😬 First thing I looked up afterwards 😂 We pointed that out on the blog, but I didn't get the questions in advance so that was my best guess on the fly 😃 I actually had a discussion with someone on my team who pointed out that while everyone says the T is Transformer now, *technically* the original GPT paper would make you think it stands for just 'generative pre trained'; and also challenged whether it was correct to focus on 'transformer', given that a big part of the improvement from GPT3 to GPT3.5 was the reinforcement learning with human feedback based tuning. (And some people think this is very important as it starts to ground the model; however while I believe it improves alignment and scale I'm suspicious of the more philosophical arguments about grounding ). I still think though if you are answering the question about 'what is different here in the last 5 years' it's fair to focus the narrative on the Transformer, and the scaling. 'pre-training' feels least essential to the story, and I'd put 'generative' in the middle; but there's lots of ways of framing this. That's my story and I'm sticking to it anyway 😃
@gorgolyt
@gorgolyt Жыл бұрын
@@fergalreid I think they trained it with Reinforcement Learning techniques, but isn't it still a Transformer? Transformer being a particular model architecture rather than any particular training technique.
@fergalreid
@fergalreid Жыл бұрын
​@@gorgolyt yes, still a Transformer architecture.
@KrisDelaPena
@KrisDelaPena Жыл бұрын
ChatGPT can you please summarize this KZfaq video please. Copy + Paste Transcript
@waqqashanafi
@waqqashanafi Жыл бұрын
This is going to go out of control. It'll be hilarious if it becomes complex enough that it becomes self-aware.
@SkylarGraham
@SkylarGraham Жыл бұрын
My mother? Let me tell you about my mother.
@foobars3816
@foobars3816 Жыл бұрын
So lets talk about ChatGPT... first lets start with something simple GPT, what is that. "Yeah I don't remember... General Purpose Transformer or something like that, but the important part is that it's a transformer and isn't really different from GPT3 except for a new UI". Told me in the first few seconds of the video that he hadn't actaully done ANY research outside of his existing knowledge.
@fergalreid
@fergalreid Жыл бұрын
😃 We didn't prepare the specific questions in advance. Sometimes that's good, you have a more authentic conversation - but the downside is you can get tripped up with an unexpected question! We did plenty of research. I don't think the specific acronym is actually that important to the overall narrative - but there's a sibling comment with a more detailed discussion of this, if you are interested.
@xcristians1
@xcristians1 Жыл бұрын
That's mostly true if you don't go to the technicism, the differences between GPT3 and GPT3.5 not are so substantial in terms of what IA can do.
@typhoon320i
@typhoon320i Жыл бұрын
28:27 "What is the sputnik reference?".............WHAT?! are you kidding me! ........first artificial satellite.
@fergalreid
@fergalreid Жыл бұрын
Des would be pretty good at the history of technology, so I bet he personally knew that, but is just being a better podcaster than me and realizing there might be some folks in the audience we should explain it for!
@typhoon320i
@typhoon320i Жыл бұрын
@@fergalreidThen it's: "explain to our listeners the sputnik reference" He literally sounded puzzled.
@destraynor9429
@destraynor9429 Жыл бұрын
​@@typhoon320i Yes, you'd say that if your ego was a higher priority than being a good interviewer. :-)
@rv003yt
@rv003yt Жыл бұрын
Fix your audio. The right side channel is 200% louder than the left.
@fergalreid
@fergalreid Жыл бұрын
Are you sure that's in the video? Apologies if so, and I can get our technical folks to take a look. If I listen to this video with headphones and just try listen to each side, they seem fairly equal - what are you experiencing?
@silberlinie
@silberlinie Жыл бұрын
What my experience is: When I have a conversation with this bot, I ask him about who it is. I ask if it is the well-known ChatGPT. Every time I get this answer: No, it would not be ChatGPT, it would be Assistant. Even with further in-depth inquiries, you get the same answer. It says that it knows ChatGPT, but it itself would not be ChatGPT but Assistant. Extremely remarkable and hard for me to understand and believe. So, what do you think?
@mickywes3733
@mickywes3733 Жыл бұрын
I think what we are going to find out from AI is that the human mind is not really that impressive.
@Lily-yg4dl
@Lily-yg4dl Жыл бұрын
Not really. Remember, it is the human brain that created the AI.
@mowthpeece1
@mowthpeece1 Жыл бұрын
It's not. But it did come up with AI. So there's that.
@alexbrown1170
@alexbrown1170 Жыл бұрын
Trust is a qualia that, like quantum mechanics gives us the most certainty. By observing and recording- feedback and reality in the material world derive a progression of intelligence. GPT/AI only ‘Learns’ from existing database, which by definition is backward looking in time. There can be no insight from a bounded system. The perceived free will and semantic complexity are islands of mirrors floating i. A fractal space- one of emergence and wonder, but actually an ever growing complexity. A simple query and following ‘chat’ is only as good as GPT knowledge. To think that the ridiculous hallucinations and misstated factoids that preceded any query is bad enough- but to ascribe magical thinking and truth to any of these ‘toys’ is to also believe these so called smart agents will do anything but multiply the number of nerds and flimflam men that will shill the shit out of ‘big Data - now at the ingenious control of a network of pseudo-knowers/ultra creators who somehow glean Truth and Stability Diffused answers to humanity’s largest unanswered questions. The real question is- wtf? Human insight will stay on the other side of a firewall.Play Go . Play chess. Play God? Right…
@PartyRockAdviser
@PartyRockAdviser Жыл бұрын
ChatGPT is a BIG discrete jump in usability over "text-davinci-003". They are *not* "about the same" when it comes to creating apps around OpenAI's tech. For example, I have been banging away at a German language learning helper for LingQ that uses "text-davinci-003" via the OpenAI completions endpoint. It *frequently* gives the *wrong* gender of the German word I include with my prompt (e.g. - "der" Boot when it should be "das" Boot), frequently changes the word in the desired example sentence I ask for in the prompt, when I tell it specifically not to do that, and many other usability issues. The breakthrough RLHF (Reinforcement Learning with Human Feedback) pass they added with ChatGPT where they instructed it to what is a quality answer and what is not not just an improvement, it is a *fundamental discrete jump in quality* that makes new apps possible that were only ideas with the completions API because the results with the API are too unpredictable and *wrong*! ChatGPT either does not make these mistakes or you can ask it to correct the mistakes in a follow-up prompt. You *can't* do that (at least not successfully) with the completions API. Hearing people equate the two distinct services is giving me a *headache*. I'm a GPT3 API consumer for over a year now so I'm not just issuing unfounded opinions here. I'm reporting actual cases from using *both* the completions API and ChatGPT and doing many side-by-side comparisons. 😧
@fergalreid
@fergalreid Жыл бұрын
Just to clarify, text-davinci-003 does include an RLHF component. Agree the model isn't the same as ChatGPT; but it's much much closer to ChatGPT than GPT3 was.
@PartyRockAdviser
@PartyRockAdviser Жыл бұрын
@@fergalreid Interesting. But the difference in performance is so stark that there must be something going on. I have several side by side comparisons where ChatGPT got it right from a truthfulness perspective, and the completions API got it wrong no matter how I tweaked the prompt. Also, I have found absolutely no way to emulate the self-correction behavior that ChatGPT provides with the completions API, so I'm *really* looking forward to the ChatGPT official API.
@nefaristo
@nefaristo Жыл бұрын
12:30 are they specifically talking about cutting version of chatgpt, which has not been specifically trained for diagnoses , or it's more generally about transformers, or what? Because saying that a properly trained transformer cannot be better than doctors on average would be already a pretty bold statement. Read kahnemann to realize how bad "experts" are on average (spoiler: the answer is way worse than what our intuition would say). Well, ai in whatever form has just to do better than this. Ie Diagnoses sounding good to the non expert but very wrong in fact have _already_ been massively produced by humans 🙂
@fergalreid
@fergalreid Жыл бұрын
Hi, I'm Fergal from the video. I guess I interpreted the topic as 'could we use something like ChatGPT for medical diagnosis'; so not literally ChatGPT, but maybe a similar architecture model with similar levels of training; or maybe it fine-tuned on a medical task. I think there'd be a lot of challenges to apply this to a medical domain. Hallucinations - confident, plausible, but totally wrong output feels like a major problem and a huge issue in that domain. I think that's likely to persist. OpenAI used RLHF to mitigate it with the InstructGPT line, including ChatGPT, but it still happens. Prompt engineering can help but still isn't reliable. If I was given a similar training budget and architecture and a team and say 12 months, and asked to produce a doctor, I'd feel very unlikely to succeed for these reasons. Maybe we would produce a really good medical search engine, but I'd remain worried about accuracy and reliability. Maybe special purpose medical domain RLHF would help but I wouldn't be optimistic we'd get the reliability I bet we'd need. I'd also be concerned about training data. Limiting to trusted medical sources would really reduce the training data quantity. You'd almost have to start with a base model trained on general internet content and you'd be worried about bad information coming from that. I guess that's how I'd summarize the argument. Now, is that an argument against Transformers succeeding in this space generally? No way. They could become a building block of something really great. Also don't know how good GPT4 or whatever will be. And absolutely accept your point about human doctors being imperfect. But still this wouldn't be the domain I'd start with. Very gut feel, I'd bet it's not ready for another couple of years, and that's under the assumption of rapid progress in AI. Edit: google just released a paper: "Large Language Models Encode Clinical Knowledge" which is very relevant to this discussion
@nefaristo
@nefaristo Жыл бұрын
@@fergalreid hi, I wouldn't rely on ai on any topics right now... By themselves I mean. But already a gpt3 level model(so untrained and somehow already obsolete, isn't it) could be useful for a doctor. And as I say, doctors hallucinate too 😄😔 and then can't keep up with the amount of data produced even in a tiny field, let alone make connections between different fields. Ben Goldacre and kahnemann gave me a very sobering view of medical research and human experts in general, respectively. In short, I will keep the always very important question "compared to what?" very much in sight. I really suggest noise by kahnemann (as well as his first book) to anybody inerested in ai development; the threshold to pass for ai to be better than experts is probably lower that we tend to think. That said, I add nothing more and go straight to the paper you've mentioned, thank you very much for the reference. edit: Med-Palm, though not rigorously analysed yet, shows capabilities similar to humans in the two important dimensions, comprehension and potential harm. Interesting and promising, thank you again.
@SkylarGraham
@SkylarGraham Жыл бұрын
Replicant detected @11:17
@fergalreid
@fergalreid Жыл бұрын
😃
@RalphDratman
@RalphDratman Жыл бұрын
Funny about ChatGPT telling you what it knows, then making up the rest -- it sounds so much like what humans do. (And I can prove that, you know...)
@TJ-hs1qm
@TJ-hs1qm Жыл бұрын
I asked ChatGPT to draw ascii art of Trump riding a bicycle. The result was hilarious . It definitely has no clue what so ever what the world actually looks like. This is not AI, rather than a cool tool to make my life easier as a dev, so I'm not yet worried. But others probably should be. People churn out entire children books with animation and everything in it, in a couple of hours, what could take professional artists maybe weeks. This will also be another threat to open democratic societies. We have seen the havoc unhinged Social Media has done. It is time to re-consider if we are ok to let a bunch of uber-wealthy deploy what ever tech they fancy. While they lean back and collect the profits, society is left to deal with the all negative side effects. Privatized profits, socialized loss attitude needs to stop.
@gorgolyt
@gorgolyt Жыл бұрын
It's definitely AI. An AI isn't required to competently perform every human task.
@markcuello5
@markcuello5 Жыл бұрын
SECURITY
@dhalikias
@dhalikias Жыл бұрын
Lap
@maskman4821
@maskman4821 Жыл бұрын
chatGPT doesnot change everything unless it has ability to connect to internet to get the latest data 😅
@gerardomenendez8912
@gerardomenendez8912 Жыл бұрын
He doesnt´now what GPT means
@bertvdl1178
@bertvdl1178 Жыл бұрын
Sounds like he is trying to downplay it
@fkzgfk
@fkzgfk Жыл бұрын
"extremely scary for medical diagnosis" - are you insane ? Couple more iterations of this thing and i bet u it can produce better diagnosis that any 3rd word country doctor for the fraction of a cost it take to train that doctor
@fergalreid
@fergalreid Жыл бұрын
Definitely agree there's huge potential here. People have wanted automatic diagnosis AI for decades. It's an important but hard problem. I'm not sure I'd like to be trying to solve it with just large language models today though, due to hallucination problems, which seem particularly risky in that domain.
@jwadaow
@jwadaow Жыл бұрын
And how would that be verified to be reliable?
@DominiqueLavault
@DominiqueLavault Жыл бұрын
about human + "self driving" AI, it's more efficient than human alone, Tesla have between 50% and 70% less accidents than human driven cars, depending on sources. It's not "net negative". would be interesting from where this fake info came into this guys "knowledge".
@fergalreid
@fergalreid Жыл бұрын
Wasn't trying to say that any particular 'self driving' or 'driver assist' feature is net negative - just to use that as an intuitive example of how sometimes an assistive feature can reduce performance. That said, I'd say the stats in this area, while encouraging, are very hard to interpret definitively. E.g. people use driver assist on motorways where there are fewer accidents per mile driven, but some manufacturers compare their assist rates against all miles driven; drivers of high end cars that have these features aren't average drivers etc Not saying the conclusion is wrong though!
@davidjohnson2001
@davidjohnson2001 Жыл бұрын
Tried a few stocks..and sure it's 100% WRONG. ..
@xyz9571
@xyz9571 Жыл бұрын
As a data scientist I can say that this Des Traynor fella has no idea what LSTMs or GPTs actually do. His description at the beginning of this video is just word salad. Not a good look for his company.
@fergalreid
@fergalreid Жыл бұрын
Please bear in mind this is a high level overview for a wide audience, not an in depth tutorial; with that framing I stand by it - but happy to discuss any specific points 🙂
@DesTraynor
@DesTraynor Жыл бұрын
As the Des Traynor fella, I welcome you to do either suggest where I'm wildly off (as Fergal said, we're not aiming to educate the masses, also , fwiw I actually asked Fergal to define all the terms :) )
@tlgoody
@tlgoody Жыл бұрын
ChatGPT sounds like one more improvement in propaganda bots.
@twiiFM
@twiiFM Жыл бұрын
These guys don't know anything about creativity
Bill Gates Reveals Superhuman AI Prediction
57:18
Next Big Idea Club
Рет қаралды 140 М.
Generative AI Has Peaked? | Prime Reacts
40:18
ThePrimeTime
Рет қаралды 210 М.
КАК ДУМАЕТЕ КТО ВЫЙГРАЕТ😂
00:29
МЯТНАЯ ФАНТА
Рет қаралды 1,2 МЛН
БОЛЬШОЙ ПЕТУШОК #shorts
00:21
Паша Осадчий
Рет қаралды 10 МЛН
마시멜로우로 체감되는 요즘 물가
00:20
진영민yeongmin
Рет қаралды 21 МЛН
버블티로 체감되는 요즘 물가
00:16
진영민yeongmin
Рет қаралды 124 МЛН
GEOMETRIC DEEP LEARNING BLUEPRINT
3:33:23
Machine Learning Street Talk
Рет қаралды 172 М.
The Turing Lectures: The future of generative AI
1:37:37
The Alan Turing Institute
Рет қаралды 573 М.
New AI chatbot 'ChatGPT' interviewed on TV
13:17
Channel 4 News
Рет қаралды 877 М.
Mapping GPT revealed something strange...
1:09:14
Machine Learning Street Talk
Рет қаралды 203 М.
John Schulman (OpenAI Cofounder) - Reasoning, RLHF, & Plan for 2027 AGI
1:36:55
Geoffrey Hinton | Will digital intelligence replace biological intelligence?
1:58:38
Schwartz Reisman Institute
Рет қаралды 152 М.
Satya Nadella: Microsoft's Products Will Soon Access Open AI Tools Like ChatGPT | WSJ
31:43
Chollet's ARC Challenge + Current Winners
2:15:02
Machine Learning Street Talk
Рет қаралды 45 М.
What's the future for generative AI? - The Turing Lectures with Mike Wooldridge
1:00:59
Здесь упор в процессор
18:02
Рома, Просто Рома
Рет қаралды 312 М.
PART 52 || DIY Wireless Switch forElectronic Lights - Easy Guide!
1:01
HUBAB__OFFICIAL
Рет қаралды 44 МЛН
Мой инст: denkiselef. Как забрать телефон через экран.
0:54