I think given no point when both are correct may bias the final result. Let's say, you've done 20 tests, 15 are the same results, 1 gpt4o is better, 4 Claude Sonnet is better. The score is then 4-1 for Clause Sonnet but actually it's more 19-16.

Summary: 1. both are great. 2. don't use either for fact finding. 3. Since they are both free, use both simultaneously.

Claude Sonnet is wayyy better for complex tasks and assistance in debugging.

The GDP 2018 question was actually answered correctly. According to every source I found on the internet, Germany was 4th and the UK was 5th.

Beautifully done on the video bro.

it sounded a little biased towards Claude

This was the best comparison video on KZfaq. Great job man, subscribed.

for the coding tests you should do a plagiarism check to check if it is straight ripping someone’s code

I pay for both, primarily for coding, and haven't used 4o since Sonnet came out.

Your channel deserves sooooo Much more attention😮

Great content man. This channel is going to blow up soon

Claude premium plan gives less messages / dollar. It’s significantly more consistent in long and complex convos, but you reach the 5h message limit quickly

Claude 3.5 and GPT-4o both have their strengths, and it’s fascinating to see how they differ. Claude feels more human, like it’s really trying to understand what I’m asking, but then I’ve noticed with the memories function in GPT the model I think knows a lot more when I’m trying to ask now so now has much better answers like Claude 3.5. My issue is sometimes it hits those frustrating blocks and says it’s unable to answer my question, which drives me nuts even when it’s nothing controversial and it clearly would know the answer. I noticed in one of their talking points that is one of their big things. They are working on as it is overly restrictive and they know it so improve that. GPT-4o, on the other hand, is super analytical but occasionally needs me to rephrase my questions to get the best answers. I’ve been using both for a while now, and here’s what I’ve found: Claude’s artifact mode is mind-blowing, it’s nice if you’re on an iPhone or iPad since no android app. GPT’s memory function is a game-changer, making it more accurate over time as it learns from our interactions. Wouldn’t it be amazing if they combined the best of both worlds? I’d love to see a deep dive comparison between custom GPTs like “Scholar” and the standard GPT-4o, especially for fact-based questions. Does the customization really boost accuracy?

Great job on the video dude! I also agree with your results for yourself at the end that discusses how you plan to use them. I like Claude but without those extra things, Chat GPT is my daily driver.

Claude genuinely seems so exciting

Great video. Thank you. Subscribed

Isn’t the biggest improvement with GPT-4O the audio conversational voice chat skills? Not converting audio to text prompts, but actually understanding the tone of the voice itself etc. It comes across as pretty nuanced in the demos I’ve seen.

19:32 You forgot to give the point to GPT-4o in the tally.

GPT’s recognising Obama’s prank is astonishing

The question is, what do you mean by writing a better text? I'm afraid that you evaluate texts too positively, where there is understatement, and a lack of logical structure with opening and closing. You perceive it as an aura of mystery. That's why Clodie cheated on you, because what he couldn't do, you interpreted as good writing.

Excellent video, I think you did a good job of being objective. Just a note, if you're looking for conversation and support, tell GPT you're looking more for an emotionally supportive answer than a solution based answer. Then what you get out of it is very similar to Claude. Claude still deserves the point because your average user likely won't think to try that, but the option is there for people that want more conversational GPT.

Sure, here is a summary of the video in points: * This video compares two large language models, Claude 3.5 Sonnet and GPT-40, by giving them a series of head-to-head tests. * The winner is determined by the video creator, Patrick Storm, based on his subjective criteria. * Claude 3.5 Sonnet wins in creative writing, dialogue generation, sentiment analysis (partially), conversational skills, and summarization (when length is considered). * GPT-40 wins in factual question answering and image generation (because Claude 3.5 Sonnet doesn't have an image generation model). * They tie in summarizing a research paper and coding (when the prompt is simple). * Overall, Claude 3.5 Sonnet performs better based on the video creator's evaluation.

Ask Claude 3.5 Sonnet: "List the first 12 people in order that landed on the moon." The result is correct, and it shows that the 11th person was, in fact, Eugene Cernan. It pays to ask questions that force a step-by-step process of answering.

00:03 CLA 3.5 Sonet outperforms GPT 40 in benchmarks 02:27 Claude 3.5 Sonet outperforms GPT-40 in speed and live code demonstrations. 04:46 CLA 3.5 Sonnet outperforms GPT-40 in creative writing tests 07:13 Comparison of performance between CLA 3.5 and GPT-40 models 09:52 Comparison of Claude 3.5 Sonet and GPT-40 12:27 Difference in code review of Claude 3.5 Sonnet and GPT-4o 14:57 Comparing GPT-3.5 Sonnet and GPT-4o 17:28 Comparison of GPT-40 and Claude 3.5 Sonnet performance on trivia questions 19:49 GPT-40 performed better in factual accuracy 22:04 Claude 3.5 Sonnet outperformed GPT-40 in understanding and summarizing human emotions. 24:18 CLA 3.5 Sonet offers better performance and cost saving

I'm pretty sure limes float if they have been squeezed and sink if they haven't.

Instant subscribe!

This video was really well made, and I enjoyed it through the entire video! I thought I was watching someone with 200k plus subs, based on the quality of this content. Keep it up, I’m subscribing now!

This is not a well thought out test. There are actually standardize methods to compare AI models. Look for GLUE, COCO, MS MaRCO, SQuAD, etc. It depends on what aspects do want to compare.

ChatGPT-4o is my quick search engine. Claude 3.5 Sonnet is my main workhorse. The artifact feature in Claude 3.5 Sonnet is so good.

still waiting on an android claude app. * tick tock *

In round 5 UK was the correct answer

They both actually got it correct about the 5th highest GDP in 2018.

This was a great video, good pacing and structure without any empty ai hype bullshit. Very pleasing production and you got a beautiful room for filming!

You did not increase the width of the menu bar in Claude's case to see if the buttons re-appear

I appreciate your work, but I found this video biased and inconsistent in judging the two models' responses. In two or three tests, you verbally preferred ChatGPT, yet you didn't award any points and declared a draw. This doesn't seem unbiased to me.

Your video is great! I can understand the difference between Claude 3.5 Sonnet and GPT-4o. Also, I canceled GPT-4o because Claude 3.5 Sonnet is better than GPT4o. When I want to create an image, I use Gemini1.5 Pro.

I agree, Claude really needs voice chat added.

Oh! Big thank you for the light theme! You’ve just won a subscriber.

What should they have done with the 1 second interval question to keep to 1 second exactly?

Nice

Pretty impressive for a fairly small KZfaq channel! If you can get the visibility I expect your channel will do very well. Unfortunately for that to happen you need to go pretty far down the clickbait KZfaq algorithm there's just no other way to build views and subscriptions

In this type of showdown finding which is the best, I think that would be useful to the evaluator not know who is creating the answer to avoing being biased for personal preferences. There were few answers where I disagree, so maybe I'm biased too. For coding, DeepSeek 2 is outstanding.

The question is, what are the gotchas in the JavaScript timer coding problem?

The link in "Link to text responses from the video" seems to point to something else.

Could have been a good comparison, but wasn’t - image gen and facts make absolutely no sense; reasoning was missing entirely. It did point out a few important things, though, so thank you.

It is funny to me how people do comparisons like this. Yours was very well done and quite entertaining. However, the speed at which these models leap frog one another makes this kind of a moot point.

so does this mean no autrey?

GPT 4 is massively better in context, writing and everything that needs interpretation: GPT 4 bunny history: Under the pulsing neon of 2147, Detective Eli Ramos adjusted his Temporal Badge. The rain-flickered holograms cast shadows as he stepped into the alley where time had fractured. The chrono-meter beeped-1932, Chicago. Eli's target was Alvin Holloway, a time fugitive masquerading as a bootlegger. Using a purloined time device, Holloway had been jumping decades, altering events for personal gain. Eli slipped through the temporal gate, his trench coat merging seamlessly into the milieu of mobsters and flappers. The smoky speakeasy was loud with jazz, the air thick with conspiracy. He spotted Holloway immediately, charm and danger rolled into one. "You can't keep running, Alvin," Eli said, cornering him by the bar. "And you can't stop me," Holloway smirked, reaching for his concealed device. Quick as a blink, Eli drew his Temporal Disruptor. A beam of blue light, and Holloway froze-the device dropping, useless. "You're out of time," Eli quipped, cuffing Holloway. Back in 2147, the chief commended him. But Eli knew better. Time was a loop; his next case was just a ripple away. Somewhere, sometime, another fracture awaited. But for now, under the eternal city lights, Eli Ramos took a well-deserved breath. GPT 4o: In the bustling heart of Neo-Victorian London, Detective Arlo Sinclair adjusted his bowler hat and checked his pocket watch. The gears inside whirred, signaling it was time. With a flick of his wrist, the watch’s face shifted, revealing a hidden dial. He twisted it, and the world around him shimmered. Moments later, Arlo stood in the shadowy alley of a different era-New York City, 1942. The scent of fresh rain mingled with smoke from the distant war effort. He scanned the street and spotted his target: a man in a pinstripe suit carrying a briefcase too important to be left in this time. Arlo followed, his every step silent as he closed in on the man. When the moment was right, he sprang, snatching the briefcase. The man barely had time to react before Arlo twisted the dial again. The city melted away, replaced by the futuristic skyline of 2147. In his hidden office, Arlo placed the briefcase on a sleek table. Opening it, he smiled at the sight of the stolen schematics, safe from those who would misuse them. Time could be twisted, but justice always straightened its course. Arlo leaned back, ready for the next case. "Ai que tudooo," he murmured.

How about Claud 3.5 to gpt 4? , which is better 😅Thanks

imagine if we had their child, Claude Pete 4.5

I found this interesting.

Hey Patrick, I wanted to reach out with some advice for an AI startup I just released but I can’t find your email, what’s the best way to reach you?

I was using ChatGPT4o for creating artistic literature; poems and song lyrics etc.. then Claude 3.5 came out.. than i was blown away. It is litterally a LLM (Large Language Model) because it understand a lot of world languages than GPT, It creates beautiful lyrics than GPT.. so in that field the winner is obvious.. but there are some fields that it was not better.

My experience is GPT is still better than Claude in logic, reasoning and problem solving (for coding, math, data analysis,...)

10:31 - what's that extension 😆

I don’t know if I can agree with this fellow. I tried using Claude 3.5 sonnet and it got a picture breakdown, incorrect by the timeline that was present. No problems wit chat. And at that point, I just didn’t wanna trust Claude.

You can actually tell Claude to generate and image and it will make an SVG

although yes reasoning should absolutely be in

I was always using gpt-4o for my tasks until i discovered Claude. I code with claude and let GPT- 4o debug it. Perfect combo for me. Claude understands python and web design way better than GPT-4o.

7:15 In the image-recognition-tests I'm not sure if they really thought by themselves about this or if they found the image on the internet and found e.g. a forum or so where it's already explained. So the "just" had to reframe it.

Claude is a good demo but the chat length 😬

why no math section?

ChatGPT is way better at haikus than Claude sonnet. Using Claude for haikus reminded me of the ChatGPT 3.5 days. I've had the opposite experience with the actual stuff I do, 4o is better than Claude for my uses and I've done extensive tests. My prompts tend to be much more intensive than the ones you're asking, more detailed.

really nice! better than most other reviews

While you are correct about image generation being only available in gpt4o, it would have been good if you had a section on image generation using code. I quite often get GPT to create graphs or simple line graphics, which can be done easily in code. Eg: draw a graph of x to the power of 1.7, or draw an alien sprite from Space Invaders.

claude 3.5 sonnet lost it’s EQ OPUS had though….so it’s not reliable as a conversational model. OPUS is still worth it if you get tired of sonnet 3.5’s robotic bland responses. try comparing them if you don’t believe me. this is not subjective, it’s fact that sonnet 3.5 sacrificed emotional intelligence for more specs.

Your list of questions was not balanced. You focused too much on the language problems (where Claude 3.5 Sonnet is clearly ahead) and completely ignored the logic, reasoning and math problems (where GPT-4o would crush its opponent).

image generation should be minus points lmao

Maybe i switch to Sonnet

been using claude for 6 months now.. never seen a reason to use anythign else..

Claude tried to rhyme awash with splash. Interesting that it didn’t incorporate pronunciation. In time I suspect all AIs will incorporate many different types of knowledge.

Claude is better at Coding really really fast.

Its always true that competition between companies is good for us. But in this case, competition between these AI companies is not good for us(as a normal human being, as well as from a developer pov)💀

Claude doesn't even search the internet for information is all from training

i think you need more complex coding tests than pong

While they keep saying "coming in few weeks" sonnet gonna beat them in thier own game 😂

Why compare 4o for coding?

for coding claude 3.5 sonnet is much better in my tests

chat gpt can generate images.

I have a video on my Chanel integrating all Ai models into LINUX, ChatGPT, Gemini, Claude and more.

Nice work. Also try to break the reasoning. For instance: “a farmer and a sheep on one side of a river. The farmer has a boat that can take one animal at a time. What is the fewest number of trips the farmer can take to have his animals on the opposite side of the river?” - this usually breaks reasoning of LLMs.

Germany was 4th not 5th. They were both correct and you were wrong. According to the WEF that is.

Claude is way better than gpt4o in coding

The answer was Leafy, trees are leafy. No points.

Claude has no access to the internet.

the fact 4o can search the web makes it better imo

Gpt4o doesn't generate images, it instead uses dalle 3. I don't think that's a fair assessment of a language model when it has to rely on an image model, and shouldn't be awarded points for that.

First of all GPT-4o is free

Videoes like these are pointless for the simple fact its nothing more then comparing two software apps with one being a half step either behind or in front. Unless Claude can take that full step forward which it failed to do this time around then ChatGPT will just sprint forward again with another great leap. I can only afford one and for now sticking with ChatGPT as it has more protential in what I need it for

he is biased for claude

I have to say that the way you presented this showed a heavy bias towards Sonnet 3.5. In each of the ties, EACH should have gotten a point, this way it validates each model in the function you were requesting. This is hardly subjective with the utter skewering of the results to Sonnet.

This is so biased towards Claude.

It doesn't look like they stuck to the 200 word limit.

Claude cannot draw

Bro 4o is trash. Even 3.5 turbo is better.