Find out more: social.ora.cl/60065B0Xr
This episode of First Principles covers the mechanics behind Oracle Cloud Infrastructure (OCI) Generative AI Service and how it makes it easier to work with large language models (LLMs) for AI applications. SVP and Chief Technical Architect for OCI, Pradeep VIncent, explains Oracle's upgrades in flexible fine-tuning of LLMs and improved GPU cluster management for simplified and cost-effective integration of LLMs to AI applications.
00:00 - Intro to OCI Generative AI Service
01:29 - What are Generative AI Models?
02:01 - Transformer Model Architecture
02:38 - Encoder-Decoder Transformer Model
03:35 - Gen AI in enterprise applications
04:05 - Gen AI key to success
04:05 - Achieving high accuracy of LLM outputs
06:08 - Retrieval Augmented Generations
06:30 - Basic OCI Gen AI Workflow
08:38 - Dedicated GPU RDMA clusters
09:34 - Customer Data Privacy and Security
10:45 - Fine-Tuning the Models
11:41 - Efficient Fine-Tuning w/ T-Few
12:10 - How T-Few Fine-Tuning Works
13:15 - Inside the Transformer Layer
14:42 - OCI Gen AI's cost effective inferencing
15:29 - Packing many models in single GPU cluster
17:45 - Key Takeaways
Like what you learned? Subscribe now social.ora.cl/60025k87j
Contact Cloud Platform Sales - social.ora.cl/60075enwz
Oracle Cloud Infrastructure (OCI) - social.ora.cl/60055GhEx
Join us at Oracle CloudWorld - social.ora.cl/60035eVvJ
Cloud Storage - social.ora.cl/60025HEQg
Cloud Compute - social.ora.cl/60095H6gX
Cloud Networking - social.ora.cl/60095HDoc
Multicloud - social.ora.cl/60015HDY1
Cloud Economics - social.ora.cl/60015H6IT
What is Cloud Computing? - social.ora.cl/60055HEIH
Follow us here:
LinkedIn: social.ora.cl/60035eXuF
X (Twitter): social.ora.cl/60025dtSA
Instagram: social.ora.cl/60095eXDN
Facebook: social.ora.cl/60065enQp
#GenerativeAI #Oracle #OCI