No video

Use Open AI (ChatGPT) On Your Own Large Data -Part 1

  Рет қаралды 68,864

MG

MG

Күн бұрын

Пікірлер: 103
@mingtakwong8664
@mingtakwong8664 Жыл бұрын
Great video! Is it possible to identify the source document the answer refers to? How?
@MG_cafe
@MG_cafe Жыл бұрын
yes you can and here I have explained how in part 2 : kzfaq.info/get/bejne/iMmUpMeIqr_bYnU.html
@kalaiarasankalai9471
@kalaiarasankalai9471 Жыл бұрын
⁷😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊😊
@GothicDragonX
@GothicDragonX Жыл бұрын
Dude, that intro is epic. I like it. At first thought you were twins, but then I focused on finding a shadow between both sides and where it cuts off, and I found it. The dialogue alone sold me at first.
@MG_cafe
@MG_cafe Жыл бұрын
haha, you made my day, Thanks so much buddy!
@ericolendzian
@ericolendzian Жыл бұрын
1:15 into this video and I have no idea how good it is going to be at the end, but man can you act. The synchro is un believable. The best I've seen of people doing this kind of videos.
@shahram9217
@shahram9217 4 ай бұрын
MG, I'm so proud of you as an Iranian!
@sumangupta871
@sumangupta871 7 ай бұрын
Hi, thanks for the nice video.. It would be great if you prepare a end to end tutorial video explaining the codes to develop such application from scratch.
@seanconnollymv
@seanconnollymv Жыл бұрын
Thanks MG! The are very informative and helpful. What is often left out of videos is the fact that many developers want to create SaaS platforms using the techniques you present. This generally involves a multi-tenant / user scenario. Yes this adds complexity, but it would be great if you could elaborate on siloing customers data in a saas model approach using cognitive search and openAI.
@emrahe468
@emrahe468 Жыл бұрын
Amazing intro, that summarizes the problems we are currently having about chatgpt
@Tap2EarnTips
@Tap2EarnTips Жыл бұрын
What are the operating costs of Azure? I've seen some implement embeddings with langchain & pinecone, even though your method seems simpler.
@xvmx.mp3
@xvmx.mp3 Жыл бұрын
Please make a video on how to do this locally in Python with Conda or venv. Thanks for the great video btw.
@rajivkumar2385
@rajivkumar2385 Жыл бұрын
killing ending.. salute your motivation
@craigdallen
@craigdallen Жыл бұрын
Excellent video.. Thank you!!
@yixuangong5369
@yixuangong5369 Жыл бұрын
What a great video! I have one question regarding embeddings, I found current embeddings model is not working well in handling document with tables, do you have any ideas how to handle tables?
@MG_cafe
@MG_cafe Жыл бұрын
Thanks so much , please check out the video I posted : chat with your tabular /SQL data
@TeylorMoretoGuaitolini
@TeylorMoretoGuaitolini Жыл бұрын
Great video! Thank you so much.
@JeanCharlesChabot
@JeanCharlesChabot Жыл бұрын
Very well done, congratulation ! Very high quality presentation and information ! 🙏❤🙏
@sethitsseth
@sethitsseth Жыл бұрын
I subbed because of the message at the end
@MG_cafe
@MG_cafe Жыл бұрын
you made my day, thanks so much!
@AntonioKrizmanic
@AntonioKrizmanic Жыл бұрын
I love this video. However, please be careful - the way this is implemented and the way the methods are used results in some major problems. 1) There are some (surprisingly high) costs - I have spent 60$ on the search alg in the background of the site application that gets deployed on Azure. This has happened with less than 20 documents with less than 2000 tokens uploaded. There is no justification for such a cost other than the implementation not being that great or the algs/chains in the background being needlessly complex. 2) The control you have over the little, but important parts of your implementations is not optimal. Examples and history have to be manually given to the prompt, you have no power over the way in which the files are sliced when the embedding is happening, you have no control over the size of the docs being retrieved from your index (dataset of text slices). 3) The flexibility is not that great and you need to go the extra mile to change the models used (for translation, embedding and chat), you do not know how many instances of them are running in the background, nothing. I know this is extremely convenient, but I think it is cheaper and overall better to spend three days on learning LangChain than it is to depend on this solution - automatic example generation and selection, easy to use prompt templates, different kinds of history generation that can be combined into one that culminate into one great solution for building ChatBots.
@Just-My-Opinion
@Just-My-Opinion Жыл бұрын
Is langchang able to run private? I believe azure openai is HIPPA compliant
@nhannguyenvanhoang9638
@nhannguyenvanhoang9638 Жыл бұрын
I'm totally new to microsoft Azure, so which Azure's products (storage accounts, database,... ) should I choose in order to process this kind of model, and could you share the approximately price to run the model on monthly basis
@MG_cafe
@MG_cafe Жыл бұрын
you dont host the model. Microsoft will host and handle everything and you just call these models through API and get charged for it
@arunthakur03
@arunthakur03 11 ай бұрын
Great Stuff!!
@narniashasta
@narniashasta Жыл бұрын
Thank you. Is there a similar way to solve the exact problem on AWS?
@turgutylmaz1043
@turgutylmaz1043 Жыл бұрын
Great Video Thanks ! Can I use the question part as an API for my application ?
@massibob2004
@massibob2004 Жыл бұрын
Really good. How can we display the source of the document which contain the answer ?
@MG_cafe
@MG_cafe Жыл бұрын
Please check out part 2
@massibob2004
@massibob2004 Жыл бұрын
@@MG_cafe I did. But I meant, without azure search 😉
@adilmajeed8439
@adilmajeed8439 Жыл бұрын
Great stuff, whats the possibility of using this as an api using power app so instead of using stand alone application
@joeish
@joeish Жыл бұрын
I tried to deploy, all went well until I tried to use it. It just kept throwing errors at me.
@MG_cafe
@MG_cafe Жыл бұрын
double-check if you have the models deployed in your Azure OPen AI service with the same name chosen oni form deployment
@vish515
@vish515 Жыл бұрын
Thanks a lot for the awesome video. I have successfully deployed it. I also added one document. It has not computed the embeddings yet. Any idea on how long does that take? I used Bank of America report, that was used in the video..
@evie3311
@evie3311 Жыл бұрын
thanks for the information. Is it only open for Company accounts? I was stuck in "Request Access to Azure OpenAI Service"
@akshaysaju6223
@akshaysaju6223 Жыл бұрын
if i want to convert one programming language to another will this method useful?
@machinegun1879
@machinegun1879 Жыл бұрын
what type of subscription do you have? what is the minimum subscription needed to do this?
@mhabert
@mhabert 11 ай бұрын
How to deal with general questions related to my own documents ? Example: suppose i upload documents of a meeting transcription, and I my questions are: "how many people asked something during the meeting?" or "who many people participated in the meeting?" I understand that the embedding solution is good for specific questions, but my doubt is, can it deal with those type of general questions?
@salimmimouni6465
@salimmimouni6465 Жыл бұрын
you need to set up an azure account, it is a hell and should take 2-3 working days. After half a day, I still cannot figure out where to find/define the key access to the blob storage service...
@MG_cafe
@MG_cafe Жыл бұрын
Open your storage account in the portal, click on the key on the left side and you should be able to see the key. if you already have azure evnoremnt with Open AI, it should be just several minutes to deploy this solution
@renetachon
@renetachon Жыл бұрын
Is this process suitable for sensitive data that should not be shared?
@papariding5865
@papariding5865 Жыл бұрын
Really informative, I would like to use azure sql instead of redis. is it possble?
@MicrosoftAzureAI
@MicrosoftAzureAI Жыл бұрын
How different is this from the Add your data option in Azure Open AI that is available?
@JohanNordberg
@JohanNordberg Жыл бұрын
I’m what ways is this different from connecting Cognitive Services Search to Azure OpenAI?
@duckbreeder
@duckbreeder 9 ай бұрын
謝謝!
@MG_cafe
@MG_cafe 9 ай бұрын
Thanks so much !
@basemshoukry7018
@basemshoukry7018 Жыл бұрын
Is it possible to integrate ChatGPT with my existing database that contains around 40K products? I'm planning to create a chatbot using ChatGPT which can intelligently respond to user queries based on our current product availability. I'd appreciate any guidance or tips on how to achieve this.
@MG_cafe
@MG_cafe Жыл бұрын
Yes it is possible . Please check chat with SQL data video I uploaded
@madanmaram276
@madanmaram276 Жыл бұрын
Azure open ai fine-tuning is still unavailable, did anyone facing this issue, plz help me how to resolve this? My resource group region is South Central US not able to do custom fine-tuning..
@ramvideo1
@ramvideo1 Жыл бұрын
OpenAI has private trained model for enterprises. Does it have Role-based access control for the Privately trained data in OpenAI? (like employees can access only their data; another employee cannot access his/her data)
@drazmix
@drazmix Жыл бұрын
The questions look less open than what is possible via chatgpt3 or chatgpt4. It's as if you had to look for a direct quote from the text. Should we deduce that these data uploaded on the clood do not allow to ask questions as freely as on chatgpt itself ?
@MG_cafe
@MG_cafe Жыл бұрын
The questions were just for demo purpose but you can certainly question much more complex scenarios as you ask from ChatGPT. also check out Part 2 : kzfaq.info/get/bejne/iMmUpMeIqr_bYnU.html
@RandyEsguerra-ef2lv
@RandyEsguerra-ef2lv Жыл бұрын
Great video! Is it possible to feed data to chatGPT via API?
@MG_cafe
@MG_cafe Жыл бұрын
This is what this demo does
@shubham1993ification
@shubham1993ification 10 ай бұрын
Will this work with CSV files as well?
@crazymohan2008
@crazymohan2008 Жыл бұрын
I can do this with a CSV file that has problem & solution columns?
@MG_cafe
@MG_cafe Жыл бұрын
definately you can
@umeshwartiwari5378
@umeshwartiwari5378 Жыл бұрын
बाते अच्छी हैं लेकिन विज्ञापन भययुक्त है।
@1242elena
@1242elena Жыл бұрын
Amazing 😍 any updates?
@HombresTopG-bf9se
@HombresTopG-bf9se Жыл бұрын
Sent application to get the Azure Chatgpt permission. They expect a lot of company information, including company website, company phone number etc... Seems like they don't want anyone to just be playing around with it.
@Udayanverma
@Udayanverma Жыл бұрын
How can I set this up locally? I don’t wish to use any cloud service. Pl suggest
@MG_cafe
@MG_cafe Жыл бұрын
in the same github, try the local deployment option
@dilipkumaryadav9733
@dilipkumaryadav9733 Жыл бұрын
Can WE use sharepoint as data source?
@MG_cafe
@MG_cafe Жыл бұрын
Yes , check this out : kzfaq.info/get/bejne/f8mnlc11xNS8d2g.html
@darkmatter5310
@darkmatter5310 Жыл бұрын
Thanks a lot MG! One issue I am facing after setup environment and upload documents; for Index I am getting error: Traceback (most recent call last): File "/usr/local/lib/python3.9/site-packages/openai/api_requestor.py", line 672, in _interpret_response_line data = json.loads(rbody) File "/usr/local/lib/python3.9/json/init.py".... it is long list of error. What I am doing wrong?
@eje6265
@eje6265 Жыл бұрын
Can people outside of enterprise customers still get access to Azure OpenAI?
@Garycarlyle
@Garycarlyle Жыл бұрын
Could this be used for large data sets from a spreadsheet?
@adamlimh
@adamlimh Жыл бұрын
Is it more advantageous to utilize GPT-3.5 instead of Davinci for improved performance?
@xvmx.mp3
@xvmx.mp3 Жыл бұрын
From my own experience, yes.
@adamlimh
@adamlimh Жыл бұрын
​@@xvmx.mp3 i tried to deploy GPT3.5 on OpenAI engine but did not work
@indianguy6683
@indianguy6683 Жыл бұрын
Is it possible to feed openai with search console api data of my site and get seo insights from it ?
@saiprasad9183
@saiprasad9183 Жыл бұрын
hii their it was great exploitation , I have a doubt where dose the embeddings store and will we able to access them
@a1b2c3452
@a1b2c3452 Жыл бұрын
How secure is this?sharing data with OpenAI?
@darrenfinch9815
@darrenfinch9815 Жыл бұрын
Ive been trying to convert data into a table, less than one page of data, Chatgpt only does less than half, not worth using it at this stage
@MG_cafe
@MG_cafe Жыл бұрын
GPT4 has higher token limit which can help further
@silentobserver964
@silentobserver964 Жыл бұрын
I thought what you’re doing here is not limited to the token size?
@midlifecrisis920
@midlifecrisis920 Жыл бұрын
Great video. I had a question. Does exposing your data to chatgpt make it public? Is it possible for me to not allow access to my data and yet train it using chatgpt algorithm? Much appreciate a response..
@gj4927
@gj4927 Жыл бұрын
If you’re using the API they don’t store data or train their base model with your data… unless you opt in to allow them.
@Data_scientist_t3rmi
@Data_scientist_t3rmi Жыл бұрын
Hello, is it free to use ? i have azure but i do not know how much that will cost me. can i deploy it in local ? if yes is it free ?
@MG_cafe
@MG_cafe Жыл бұрын
You need to have azure open AI service deployed which is not free and it will be charging based as you go usage
@user-ft5jj4lx2y
@user-ft5jj4lx2y Жыл бұрын
Is there a way to do website links?
@MG_cafe
@MG_cafe Жыл бұрын
Which website?
@jagatchaitanyaprabhala8668
@jagatchaitanyaprabhala8668 Жыл бұрын
its document embedding not word embedding
@holliday69
@holliday69 Жыл бұрын
You guys are hilarious.
@DihelsonMendonca
@DihelsonMendonca Жыл бұрын
⚠️ I'd like ChatGPT read all my book's library, so that I could research easily.
@MG_cafe
@MG_cafe Жыл бұрын
certainly possible :)
@ashishjohnsonburself
@ashishjohnsonburself Жыл бұрын
Can I use chatgpt with cognitive search ?
@MG_cafe
@MG_cafe Жыл бұрын
Absolutely you can ! :)
@ashishjohnsonburself
@ashishjohnsonburself Жыл бұрын
@@MG_cafe is it like we use cognitive search to get all the relevant docs and then pass it on to chatgpt for completion of the query ?
@MG_cafe
@MG_cafe Жыл бұрын
@@ashishjohnsonburself Exactly! Check this put : github.com/Azure-Samples/azure-search-openai-demo
@ashishjohnsonburself
@ashishjohnsonburself Жыл бұрын
@@MG_cafe Thanks for this link. I'm building enterprise grade solutions(where scalability matters) to the customers. Should i go with (Cognitive search+chatgpt) combination or (redis + chatgpt) combination or (langchain+chatgpt) combination ?
@ashishjohnsonburself
@ashishjohnsonburself Жыл бұрын
@MG if my question doesn't make sense, please do let me know. Thanks
@shaliniksshaliniks8934
@shaliniksshaliniks8934 Жыл бұрын
.......durgaparamesvari devi.......
@mjlone6016
@mjlone6016 Жыл бұрын
😊
@will201084
@will201084 10 ай бұрын
Aka give your data to the AI machine
@brsrkr
@brsrkr Жыл бұрын
iranians?
@Because_Reasons
@Because_Reasons Жыл бұрын
Hilarious
@ttclac
@ttclac Жыл бұрын
Hi, your video is awesome! I need this for my company. Do you freelance? Pls contact me if you do. Thank you.
@MG_cafe
@MG_cafe Жыл бұрын
Please send me an email , happy to help you : mo.Ghodrati95@gmail.com
@ttclac
@ttclac Жыл бұрын
@@MG_cafe ok I’ll email you. Thank you!
Use ChatGPT On Your Own Large Data - Part 2
24:23
MG
Рет қаралды 30 М.
OpenAI Embeddings and Vector Databases Crash Course
18:41
Adrian Twarog
Рет қаралды 451 М.
白天使选错惹黑天使生气。#天使 #小丑女
00:31
天使夫妇
Рет қаралды 14 МЛН
This Dumbbell Is Impossible To Lift!
01:00
Stokes Twins
Рет қаралды 36 МЛН
Gli occhiali da sole non mi hanno coperto! 😎
00:13
Senza Limiti
Рет қаралды 22 МЛН
Кадр сыртындағы қызықтар | Келінжан
00:16
A Hackers' Guide to Language Models
1:31:13
Jeremy Howard
Рет қаралды 522 М.
Chat GPT Tutorial For Lawyers with Simon Gibson
32:36
From The Courtroom To The Boardroom
Рет қаралды 18 М.
Creating Simple GPT Agents & GPT-4o Use Cases
1:55:07
The AI Advantage
Рет қаралды 35 М.
Mind-maps and Flowcharts in ChatGPT! (Insane Results)
13:05
AI Foundations
Рет қаралды 334 М.
ChatGPT Explained Completely.
27:39
Kyle Hill
Рет қаралды 1,2 МЛН
You need to learn AI in 2024! (And here is your roadmap)
45:21
David Bombal
Рет қаралды 691 М.
ChatGPT Excel Analysis Tool & Read Any Spreadsheet | Complete Guide
11:43
ChatGPT For Lawyers: 101 Disruptive ChatGPT Prompts For Lawyers
1:36:34
Sam Mollaei, Esq. - My Legal Academy
Рет қаралды 36 М.
白天使选错惹黑天使生气。#天使 #小丑女
00:31
天使夫妇
Рет қаралды 14 МЛН