How to Use NVIDIA ChatRTX | AI Chatbot Using Your Files

Рет қаралды 77,629

Күн бұрын

In this step-by-step tutorial, we dive deep into NVIDIA ChatRTX, an exciting AI tool from NVIDIA. Whether you're a beginner or an experienced user looking to refine your skills, this video covers everything you need to get started. We'll look at how to install and configure various AI models. Plus, we explore how to effectively prompt the AI for both text and image outputs using CLIP.
Host: Kevin Stratvert
📚 RESOURCES
- Get NVIDIA ChatRTX: www.nvidia.com/en-us/ai-on-rt...
⌚ TIMESTAMPS
00:00 Introduction
01:28 Get ChatRTX
02:15 Main interface
02:55 Select AI model
05:05 Select dataset
05:45 AI default model
06:33 Folder path dataset
08:24 Prompt Mistral model
11:46 Prompt CLIP OpenAI model
13:11 Shutdown
13:43 Wrap up
📺 RELATED VIDEOS
- Playlist with all my videos on NVIDIA: • NVIDIA
📩 NEWSLETTER
- Get the latest high-quality tutorial and tips and tricks videos emailed to your inbox each week: kevinstratvert.com/newsletter/
🔽 CONNECT WITH ME
- Official website: www.kevinstratvert.com
- LinkedIn: / kevinstratvert
- Discord: bit.ly/KevinStratvertDiscord
- Twitter: / kevstrat
- Facebook: / kevin-stratvert-101912...
- TikTok: / kevinstratvert
- Instagram: / kevinstratvert
🎁 TOOLS AND DISCOUNTS
✅ 🎙️ Voicemod AI Voice Changer | 5% off | link.xsolla.com/KZBi89AY
✅ 🌐 Squarespace Websites | squarespace.syuh.net/XYaqYM
✅ 🔍 Grammarly | grammarly.go2cloud.org/SH3nL
✅ 🛍️ Shopify | shopify.pxf.io/XY9rPa
✅ 📋 Notion | affiliate.notion.so/rffva4tr71ax
✅ 🖼️ Figma | psxid.figma.com/lqjg97licpry
✅ 🤖 ElevenLabs Text-to-Speech | try.elevenlabs.io/taqepq60mptr
🎒 MY COURSES
- Go from Excel novice to data analysis ninja in just 2 hours: kevinstratvert.thinkific.com/
🙏 REQUEST VIDEOS
forms.gle/BDrTNUoxheEoMLGt5
🔔 SUBSCRIBE ON KZfaq
kzfaq.info?...
🙌 SUPPORT THE CHANNEL
- Hit the THANKS button in any video!
- Amazon affiliate link: amzn.to/3kCP2yz
⚖ DISCLOSURE
Some links are affiliate links. Purchasing through these links gives me a small commission to support videos on this channel. The price to you is the same.
#stratvert #nvidia #chatrtx

Пікірлер: 155

@KevinStratvert 2 ай бұрын

Get the latest high-quality tutorial and tips and tricks videos emailed to your inbox each week: kevinstratvert.com/newsletter/

@AdamsTaiwan 2 ай бұрын

In 2022 I got a system with a good price for RTX3050 ITX Aero 8G. Never thought it would work well with this app. Thank you for this video. I hope someday it can read all my years of OneNote notes.

@ThePortraitArt Ай бұрын

Does it support subfolders in dataset and how the size of the dataset relates to CPU and Rem usage.

@andre1987eph 2 ай бұрын

play at 2x speed, he's milking it

@jryde421 2 ай бұрын

Thank you

@noobicorn_gamer 2 ай бұрын

Someone give this more likes

@rothauspils123 Ай бұрын

1.5x speed almost sounded normal

@JulioBarragan Ай бұрын

is he real?

@RafaPolit Ай бұрын

I was going to write the same thing: it seems this could have been a 3 minute video with the same information.

@fifamobile__23 2 ай бұрын

Unfortunately, my journey ended at system requirements😅. I'll catch y'all on the next one

@stylie473joker5 2 ай бұрын

Typical Nvidea lol locking software from old cards

@techbasengr 2 ай бұрын

same here ):

@fifamobile__23 2 ай бұрын

@TechbaseConsultantServices quite unfortunate 😕

@luizcamillo9933 2 ай бұрын

Same here

@CaptBirdBrain 2 ай бұрын

Exactly. Me too. We just got Copilot at work and it's pretty good but since it is hosted outside of our local PCs, you have to point it to certain documents. It doesn't actually learn your data. Which from an enterprise security standpoint, makes sense, but this sounded promising because it runs directly from your computer. Unfortunately, neither my work or personal PCs has Nvidia GPUs. At least I didn't waste my time watching this video. One cool feature of copilot, if you have a microsoft account, you can use the Copilot in the edge browser to summarize YT videos (assuming they have a transcript) without watching them. It will even give you timestamps if you want to jump to a certain section. That alone is a huge time saver.

@Justakatto 2 ай бұрын

ok this is huge imagine how useful this would be for studying???? like, you can just feed all your notes to the AI and ask it questions and have it ask you questions as your own AI study partner!! OH and you could feed it like the past 5 years' of exam papers to basically deduce which areas of the curriculum that you need to focus on more and stuff like that that's amazing.. ground breaking even

@bravexcallofduty7629 2 ай бұрын

hey dumkump ikr this is an awesome news can yu give me more ideas and ways how i can use this to help me in my studiies, thanks

@ScottWinterringer Ай бұрын

useful... we have had this for over a year... and its opensource...

@hope42 2 ай бұрын

💯Important: how to present system requirements when demonstrating a local AI model. Kevin nails it and everybody should do exactly what he does. He saved me so much time since I don't even have that series of Nvidia. He also presents CPU, memory, VRAM requirements which is so important to to helping us geeks go down a rabbit hole we shouldn't have been in. Anyone been there? All AI KZfaq channels showing how to run local models need to copy Kevin, in the style of Kevin haha. Mr step by step! The most important step upfront in the beginning of steps is system requirements. Si? 😮

@ScottWinterringer Ай бұрын

or dont use this... as this is a junk vs the opensource community

@diverstory 2 ай бұрын

Wow, amazing stuff! Thank you so much

@shinn-tyanwu4155 Ай бұрын

Excellent presentation thanks 😊

@1enonly 2 ай бұрын

Thankyou kevin !

@michaellavelle7354 2 ай бұрын

Excellent presentation. Thank you.

@KevinStratvert 2 ай бұрын

Glad you enjoyed it!

@joshteckcompany 2 ай бұрын

This is so nice

@youMEtubeUK 2 ай бұрын

Used it a few times, have a 4090, but it’s limited on the number of document and size. So still use Gemini 1.5 pro for 1m tokens books or a bunch of 25 pdfs where it could list and summarise all 25. Local RTX couldn’t.

@pedrobarros2554 Ай бұрын

Whats rtx limits?

@ThePortraitArt Ай бұрын

Does it support subfolders in dataset and how the size of the dataset relates to CPU and Rem usage.

@MapedMod 25 күн бұрын

try it out. it is free

@Kumodot 2 ай бұрын

Is it possible to add Metadata to the photos also (inject on exif) with the tags generated by the AI ? I was trying to do someting like that with ComfyUi

@vladyslavkorenyak872 2 ай бұрын

This is a good improvement. I hope they don't abandon it and keep developing it. Fine-tuning, multiple agents, bigger models, etc. If it could parse through a lot of data and reference with more precision, it would be a wonderful assistant.

@KevinStratvert 2 ай бұрын

Agreed!

@ScottWinterringer Ай бұрын

why? we have had this for a long time.... localGPT

@fslurrehman 2 ай бұрын

Please explain how to use RAG with phi-3, and llama locally using a PC. Also how to install phi-3 on mobile and use it locally.

@streamdungeon5166 2 ай бұрын

Creatives are usually hating on AI. Now imagine how useful this is going to be for writers referencing across a huge amount of world building materials! I will use it that way and I am already salivating!

@musicmane4146 Ай бұрын

Stealing others content 😅

@streamdungeon5166 Ай бұрын

@@musicmane4146 Did you post in the wrong place? I fail to see the context. I was talking about referencing my own world building text. Sometimes it's better to read before you respond 😂

@minimal2224 2 ай бұрын

Guys…I think Kevin is a GPT…his content is to well put together with clear direction. A human could never 🤖

@KevinStratvert 2 ай бұрын

haha, maybe in the future I'll be able to trick our AI overlords to keep me around.

@user-uw9ir7fl8l 2 ай бұрын

i may be hoping too much from my rtx 3050 8gblol all the best kevin

@Shift-consulting 2 ай бұрын

Thanks a lot for showing that tool. Is it working with sub-folders and the files there as well, or just with the files in that specific folder?

@claytonhouser7578 Ай бұрын

It works in sub folders. But only basix text and pdf folders

@herolooter3868 2 ай бұрын

Which one i download 35gb or 12gb version?

@bamh1re318 2 ай бұрын

great intro to RTXChat! Now I have to pony up for a computer with RTX 3060 or 4060,

@KevinStratvert 2 ай бұрын

Make sure it also includes at least 8 GB of GPU VRAM.

@alitalalhaidar6488 2 ай бұрын

What's the maximum amount of data present in a folder it can handle?

@agua9999 2 ай бұрын

KEVIN‼️ i subscribed after watching your awesome SQL tutorial. Can you please do a TABLEAU for beginners in the same style? THANK YOU❣️ 🙏🏻

@PawFromTheBroons 2 ай бұрын

Having this query and analyze XLS* files would be invaluable.

@KevinStratvert 2 ай бұрын

Then it'll be like the ChatGPT data analyst, which would be amazing!

@ScottWinterringer Ай бұрын

@@KevinStratvert localGPT like this..... which we have long had...

@alitalalhaidar6488 2 ай бұрын

Can you have more than one folder path in the same session?

@skistenl6566 Ай бұрын

It seems like there are many people like me can't even install it because of this error "An error occured while creating MiniConda environment." NVIDIA's announcement just says keep the default installation path, which I did but got same error. Does anyone know how to fix it?

@internetnickname8923 Ай бұрын

Is it worth downloading other language models if I need to analyze data and afterwards write code in python or will mistral handle it?

@relexelumna5360 2 ай бұрын

Why i dont see Add new models, even though i already install and its 32.7gb size? How do i get that?

@rosemaryng7994 2 ай бұрын

So this is quite similar to Microsoft copilot. But cheaper upfront?

@mydetlef Ай бұрын

And next time when I ask Mistral on the Net it shows me the same numbers and files?

@user-yo9pk9it8u 11 күн бұрын

Your video is very helpful! btw can it draw pictures? thanks!

@BibhatsuKuiri 2 ай бұрын

i dont have "add new model" tab.. how to get that ?

@KevinStratvert 2 ай бұрын

Did you download and install today? The latest bits landed this morning.

@MWulffy 2 ай бұрын

Does it only work in other languages than english ?

@mainasahi7935 2 ай бұрын

You are brill. any chance you could do a tutorial on Substack

@irprocess Ай бұрын

Just tried the software, but it doesn't work as expected

@john_blues 2 ай бұрын

I installed this today. Early impressions(I may update this if I don't decide to delete it): I am using CLIP to search images. RTX 4090. *It does scan subfolders. *It sucks at truthfulness/identification. I asked it to show an image of a lion. I had an image in a sub-sub folder. It show the image, but also 2 images of people. 😵‍💫 *'Show me an image of a car'. Showed 1 image of a person in front of cars, and a folder full of images that had nothing to do with cars. *It never seems to return a null result. So, it's very hit or miss. Which for me means I can't use it for anything useful yet.

@john_blues 2 ай бұрын

Using Mixtral: Can you read any files in this folder? I'd love to, but I'm afraid I can't. You see, I'm a text-based AI model, and I don't have the ability to access or read files on your computer. I'm here to help you with text-based tasks, not to browse your files. lol. It did answer my questions. It's just funny that when I asked it directly, it gave me that answer.

@pamesa 2 ай бұрын

Hi Kevin. All my files are on One drive. When I tried to use Chatrtx it start to download to my computer all the files

@KevinStratvert 2 ай бұрын

That's expected. It needs a local copy of the files first. If you keep your files in the cloud only and don't also have them synced on your PC, it'll need to download them first.

@josephchoo1153 2 ай бұрын

just wondering if this chat AI able to read epub files?

@tanteju944 2 ай бұрын

Does this "AI" work also as face recognition? I would like to create a list of al photographed persons on my thousand of fotos and videos.

@john_blues 2 ай бұрын

The CLIP model can, sort of. It's very hit or miss. I assume you mean can you have it find all photos that contain faces, not specific faces.

@Rehan_Production 2 ай бұрын

❤❤❤❤❤❤❤

@WickedMagic 2 ай бұрын

I am so confused to why it works so smothely for you. When I ask the same questions it, simpy answers that it deosn't know the information. Even when telling it which file it is, it just proceedes to inform me how I can open the file.

@eraser465 2 ай бұрын

How do you go about getting a copy of the CLIP model?

@KevinStratvert 2 ай бұрын

You should be able to click on the drop down to add models and you'll see CLIP there.

@alexandrunistoroiu452 2 ай бұрын

Guess it works anyway regardless the gpu! Did you try? Wonder if there will be a linux version...

@SHISUI1185 2 ай бұрын

What about code projects??

@saranglee7011 Ай бұрын

Heated up my 4090 more then me playing Crysis 4 all maxed out.

@iiFr3on 20 күн бұрын

can it help you with coding?

@user-yi2mo9km2s 2 ай бұрын

Its installer has problems since v0.1, Nvidia never fixed until now. Mine is 4090.

@JonNewlyn 2 ай бұрын

This looks like it would be great, but my install failed. I realise it's 0.3 version, but did you have any issues installing?

@james.telfer Ай бұрын

I noticed large spikes in RAM and swapfile use just as it was completing the install. Try ensuring you've for plenty free. It failed on mine first couple of tries as I had swapfile set to only 16GB

@JonNewlyn Ай бұрын

Great it worked!

@amlaaaa479 2 ай бұрын

Will this become available for iOS?

@allHeueldingse 2 ай бұрын

i want an on cpu or maths copresasor wirh a sac for emulating rtx and cuda over òver gl or gpu's'asm

@studiophantomanimation 2 ай бұрын

This sounds like it would be useful for writing a multi book fantasy series

@KevinStratvert 2 ай бұрын

Excellent use case!

@Codegix 14 күн бұрын

There is the same UI called Msty that has the same feature. ChatRTX is a bit outdated

@Rabid-Pinocchio 2 ай бұрын

First, GREAT info in your vids. Really useful stuff so thank you. I'm a little off topic but I wanted to find a recent vid. I found one of your instructional vids from about a Year ago re. WhisperAI. fyi Whisper now works with Python 3.11 but not 3.12. In your video you prompt a "-U" command to update but that doesn't seem to do anything so I'm guessing that I'm up-to-date. I've seen some referance to Whisper alternatives that are "faster", "more accurate" etc. Since Whisper seems to be working, more-or-less fine I am of the 'if it a'int broke, don't fix it' ilk. That said, do you have any more recent data re Whisper than the >1Yr. old information? Thanks in advance.

@anthonytsang1360 2 ай бұрын

Hey Kevin, i have an asus laptop with nvidia rtx 3060 with 6gb of ram. Upon installing i get an error message saying that the chatrtx requires a minimum of 8gb of gpu memory. Any solution to this?

@KevinStratvert 2 ай бұрын

Unfortunately, not. You need a min of 8GB of GPU VRAM.

@vp5335 2 ай бұрын

Can it read excel and show graph data ?

@KevinStratvert 2 ай бұрын

Not currently. XLSX is not yet a support file type, but hopefully soon.

@virtual_space399 2 ай бұрын

Sir any math solving problem free ai..

@chriscanhigh2991 2 ай бұрын

an error has occured while creating miniconda environment :( How can i solve it please? i need the requirements.

@learnanddevelopment7453 2 ай бұрын

Me too Bogus app

@twilightfilms9436 2 ай бұрын

Can you ask questions in English related to documents, books and papers you have in other languages like French, German, and old languages like German gothic? I’m asking this as a tool for historians and researchers……thanks in advance.

@umairanees2613 2 ай бұрын

Might be huge for researcher and scholars. I have hundreds of research articles in my PC and no convenient way to extract required information.

@KevinStratvert 2 ай бұрын

That's a great use case!

@julianekassler4970 2 ай бұрын

I uninstalled and download it again to make a clean install. I find it annoying that there are almost no infos about the update that lets you add your own models or where you see clip. It doesnt show up and nVidia doesnt even maintain a change log list.

@james.telfer Ай бұрын

Follow up request: how to install different LLMs. Had a look on Huggingface but haven't worked out how to install those. Also ChatRTX doesn't seem to reference all items in a folder when answering, just the first one that seems to have an answer. So if you need a summary of multiple files, it won't do it.

@peteratkin3788 Ай бұрын

I suspect its a deliberate limitation, noticed this my self was hoping to use this to scan a client directory, with such a limitation this has limited use case, or maybe your expect to program such things your self, maybe time to hire a programmer.

@ssmd7449 2 ай бұрын

Does AMD have an equivalent 😅

@intermixhector2902 Ай бұрын

learning listening reply

@stylie473joker5 2 ай бұрын

Does it work with windows 10 ?

@KevinStratvert 2 ай бұрын

The system requirements call out Windows 11 but the user guide specifies 10/11. It’s worth a shot 🤔

@stylie473joker5 2 ай бұрын

@@KevinStratvert Thanks downloading now !

@CeceliPS3 6 күн бұрын

"CLIP failed to download". RIP.

@Strawberry_ZA 2 ай бұрын

Installer is still broken - if you want to change the default installation path it becomes unresponsive, TOO BAD!

@justsurfin5013 2 ай бұрын

So, NotebookLM?

@patrickbuswell 2 ай бұрын

My consumption of chocolate chips cookies has tripled since I started watching your videos. 🤬🤬

@InspiredDailyStories 2 ай бұрын

LLM eat alot of GPU so if you don't have it might as well use the free web base bots.

@ScottWinterringer Ай бұрын

I have no idea why I would use this over other opensource items that do a lot better job and I can use any model I wish...

@srirammurthy2739 2 ай бұрын

Please help me on how to train organisation specific python codes, by the way, is the ChatRTX generate code?

@joshteckcompany 2 ай бұрын

How can I create better content?

@cpt.ahab_it7044 17 күн бұрын

I am hoping they made the 16GB 4060ti with AI in mind.

@SAVONASOTTERRANEASEGRETA 2 ай бұрын

I honestly expected something much better from NVIDIA. The software is very heavy and above all incredibly slow. And I have a very respectable PC.

@crazykkid2000 2 ай бұрын

Bro ai is resource heavy extremely

@Anthony-dj4nd Ай бұрын

Sucks that they blocked out older card users in order to try and sell they're new hardware 🕵️

@EBackwards 2 ай бұрын

I'm going to call it now... AI Model X needs 6GB of Memory. AMD/Nvidia says that 6GB Model needs 16GB's! Want another Model that does more, oh that needs 32GB's! (Really needs 10). What better way to force people into buying their new hardware! Just over inflate the requirements for LLM's in order to sell more hardware.

@waiyankyaw8395 2 ай бұрын

Yeah! First comment 🥳

@v.w.singer9638 2 ай бұрын

It looks interesting, but I honestly can't think of any real use for it. For example, with thousands of images on my HD, it would be faster to browse thumbnails by directory than trying to describe something in an image in a way that wouldn't get me hundreds of results. Or looking for a character in a book (again thousands), especially if I can't remember the name in the first place, or the exact situation.

@mikemorrison7774 2 ай бұрын

SO.... you can only look at ONE folder at a time??? that's pretty much makes it useless.

@lowqchannel 2 ай бұрын

i want video generation with RTX free software

@KevinStratvert 2 ай бұрын

Me too! Although that'll probably require a GPU upgrade 🤣

@velvetjones8634 2 ай бұрын

ComfyUI

@JavierOropeza08 2 ай бұрын

rip 2080ti, looks like I might need an update

@solomonali7229 2 ай бұрын

World go cookies

@graphguy 2 ай бұрын

Cool but data types is pretty limiting … no excel , no images.

@graphguy 2 ай бұрын

Corrected… the current website says: Chat With Your Files ChatRTX supports various file formats, including txt, pdf, doc/docx, jpg, png, gif, and xml.

@fransoualee6529 2 ай бұрын

Nvidia: 8GB VRAM minimum requirement... while also telling everyone that their 8GB VRAM GPU are more than enough.

@KevinStratvert 2 ай бұрын

🤣

@aivy-aigeneratedmusic6370 Ай бұрын

Nvidia could create the best system with the best interface. But they don´t. Right now several Github Projects are better, support more file types and have more features.

@garyrichardson475 2 ай бұрын

I’m still waiting for Kevin’s apology or explanation about his last short in which he was pushing a “get paid for promoting games” scheme. Check out his most recent entry and KZfaq Shorts. Until he does that, he’s lost his credibility with me.

@KevinStratvert 2 ай бұрын

Hey Gary, thanks for the note and feedback. Check out my community page for more information. Thanks. 🙏

@caseyczarnomski8054 2 ай бұрын

This software is buggy. I downloaded it and during setup I got errors that whisper and the other add on will not install during setup. Trash.

@ArvindhCM-fu6tv 2 ай бұрын

Seems ChatRTX didn't get the memo that my G14 packs an RTX 3060. . Oh well, the disappointment is real!

@WaqasAli-dq9wg 2 ай бұрын

Let's try to reconnect for competition 😊

@statesman6379 2 ай бұрын

This is how Microsoft gets your credit card numbers, soc, and passcodes.

@KevinStratvert 2 ай бұрын

I don't think I'd store that type of information unencrypted on your PC 🫤. That said, this runs locally without a need to connect to the internet and is unaffiliated with Microsoft.

@Alex29196 2 ай бұрын

Kevin, I've begun to question your content because you endorse this product used by only 5% of users, which has been shown to be far less efficient than any LLM inference interface. Good luck with promoting Nvidia.