100% Private & Local PDF ChatBot (without langchain)

No video

100% Private & Local PDF ChatBot (without langchain)

Рет қаралды 32,534

Abhishek Thakur

Күн бұрын

Пікірлер: 52

@abhishekkrthakur Жыл бұрын

Please subscribe and like the video to help me keep motivated to make awesome videos like this one. :)

@PRIYAKUMARI-xp2qr Жыл бұрын

What a genius statement: Open source models are going to beat the closed source models soon, can't wait.💫

@prafullsharma8052 Жыл бұрын

in dreams

@abhishekkrthakur Ай бұрын

@@prafullsharma8052 still in dreams? :)

@prafullsharma8029 Ай бұрын

@@abhishekkrthakurreality is they won’t beat closed source if they continue using closed source for data tagging . You and I both know , since you are with HF, you won’t admit it .. may be focus on doing something better instead of replying me

@abhishekkrthakur Ай бұрын

@@prafullsharma8029done with better things. thanks for the suggestion. now its time to do the useless thing and respond to your useless comment. i believe you didnt read the paper where you can read what kind of data was it trained on. anyways, do something useful, its been a year and you are stuck on this without any proper references 🤣🤣🤣

@prafullsharma8029 Ай бұрын

@@abhishekkrthakur right , I believe you haven’t read the same, most of these models are just boasting with useless Benchmarks…. Using benchmarks according their model’s suitability.

@shivamroy1775 Жыл бұрын

Amazing content, love it when the videos are long and Abhishek takes the time to explain and code everything.

@byob801 11 ай бұрын

Great video, I liked seeing you put this together and explain along the way. Very interesting to a novice like me. Thanks so much!

@pasqualmas8584 Жыл бұрын

Crazy video! Subscribed! If it could be i would like that in the first minute you show the result for knowing better what will you do in 38minutes 😂

@abhishekkrthakur Жыл бұрын

ill take care of it in future videos :)

@krzysztofwos1856 Жыл бұрын

The `sentences.append(window)` in the `embed` function should go before the `if`.

@yusufkemaldemir9393 11 ай бұрын

I am confused with the fine tuning llama 2 video and %100 pdf video you have. I have hundreds pages of pdf that I want to make query and get correct answer. Do I need to follow your fine tuning llama2 video for peft and then follow this pdf video? Or just use this pdf video as reference? What is your opinion?

@DB-in2mr Жыл бұрын

open killed the closed star 😎

@nikhilthapa9300 Жыл бұрын

Thanks for the tutorials, could you please do tutorial on multiple instance learning using Neural networks ?

@ikjb8561 Жыл бұрын

Abhishek, great videos! I know you are using rtx 3090 for your local setup. How are you able to load Falcon40B on it?

@dr.aravindacvnmamit3770 7 ай бұрын

Very clean explanation!!!!

@quantadotonium3654 5 ай бұрын

Amazing! Thank you.

@alexdelaiglesia1926 Жыл бұрын

I couldn't ask this on time during the stream xD. Could you share your thoughts about the debate of using proprietary APIs vs deploying your own open source LLM (I mean, taking into account costs, privacy, etc.)? Thanks!

@nayanjitsarkar9281 Жыл бұрын

I was about to ask the same question. Would really love to know from you Abhishek sir

@yazidridwan6917 10 ай бұрын

this !, i'm considering making my thesis on this

@abirmohammed17 11 ай бұрын

@abhishek Thank you for this tutorial. Can you please suggest what should be added in the parser if the pdf file is know to have tables with data only?

@user-zr2qb3uk8f Жыл бұрын

can you explain in the line of if he pdf document contains a mixture of tables and text in sequence such that the tables and text paragraphs make sense when are embedded together?

@vaibhavsaxena6482 Жыл бұрын

Hidden gem. Can we also use this for other languages?

@mohsenghafari7652 6 ай бұрын

hi. please help me. how to create custom model from many pdfs in Persian language? tank you.

@aminkarbassi Жыл бұрын

Thanks for this video. You say that you have the 7B model running on your local machine, can you please specify the specifications of your local machine?

@iknoorsingh7454 Жыл бұрын

Great work, Abhishek! Any idea how to prevent randomly generated output by 7B model - Is prompt engineering the only solution?

@sauravchat2002 Жыл бұрын

Even I have the same question. Wasted a whole day trying to figure this out but without any luck.

@themusicalmarvel5149 11 ай бұрын

Retreival Augmented Generation. The generated outputs should be checked against a vector DB to prevent hallucinations.

@chiragv2294 Жыл бұрын

Sir, What is cheaper option? Using open ai API or deplying falcon 40 b on cloud?

@muhtalhakhan 5 ай бұрын

how to get this kind of detailed terminal?

@pratiksaria5830 Жыл бұрын

Thank you very much sir

@nullvoid12 Жыл бұрын

Want to work for hunggingface, how can I apply and get noticed? Awesome content btw!

@dreamhunter999 Жыл бұрын

So cool!👍

@Sudip_Sarkar_Charles_Edwards 9 ай бұрын

Wow. Keep it up.

@sauravchat2002 Жыл бұрын

Quite curious to know your local machine configuration. Is that something that can be disclosed? Or have you already mentioned it in the previous videos? The reason I am asking is currently I am operating with a 8 GB ram on windows 10 and that feels like config from a different era :) on which most of the things won't run.

@abhishekkrthakur Жыл бұрын

i run code for my videos on a machine with 32gb ram and 3090 gpu.

@shivamanand4334 Жыл бұрын

Can we replace my gpt 4 calls in my deployed flask app with this? Offering clients far more usage for same price?

@joeljunior7426 Жыл бұрын

thank you master.

@mariocuezzo8027 Жыл бұрын

how i could add a webui to this code?

@musifmuzammir354 Жыл бұрын

Can't we reduce the hallucination by reducing the temperature value??

@abhishekkrthakur Жыл бұрын

sure. playing around with parameters is upto the viewers and is almost always helpful :)

@ryanpopa3312 Жыл бұрын

do you store the code in github?

@zerophase2338 Жыл бұрын

Nice flexibility on offer here.

@soodisin Жыл бұрын

Can you please post the code as well

@abhishekkrthakur Жыл бұрын

updated in description :)

@soodisin Жыл бұрын

@@abhishekkrthakur What are your views on Azure Open AI vs Open AI. My knowledge is Azure uses Open AI models as well, so is there a chance that the data on Azure Open AI has the same privacy issues as Open AI?

@MuhammadGhazalli Жыл бұрын

@@soodisin Let me help to answer, for Azure they will capsulate your data and won't gather it. Your data will not move anywhere.

@yusufkemaldemir9393 11 ай бұрын

@abhishekkrthakur this is not running on M2 Macbook locally. I am not using Docker.

@vobbilisettyveera2973 Жыл бұрын

raise ConnectionError(e, request=request) requests.exceptions.ConnectionError: HTTPConnectionPool(host='0.0.0.0', port=6000): Max retries exceeded with url: / (Caused by NewConnectionError(': Failed to establish a new connection: [Errno 111] Connection refused')) please help me with this

@mohamedfaridhkaderm4576 6 ай бұрын

did u get it resolved ?