Integrating Foundation Models into Your Code with Amazon Bedrock
Рет қаралды 70,419
Күн бұрын🌟 Get started today with Amazon Bedrock: aws.amazon.com/bedrock/
Discover Amazon Bedrock and learn how to integrate generative AI models from leading AI startups and Amazon into your applications. In this video, AWS Senior Developer Advocate Mike Chambers steps through how to use Boto3, the Python SDK for AWS, to make text generations with models such as Anthropic Claude and A121 Labs Jurassic. To follow along you will need the latest Boto3 library, and AWS account, and permissions to call the Amazon Bedrock service.
Follow AWS Developers:
👾 Twitch: / aws
🐦 Twitter: / awsdevelopers
💻 LinkedIn: / aws-developers
Follow Mike!
🐦 Twitter: / mikegchambers
💻 LinkedIn: / mikegchambers
00:00 Introduction
00:23 Generation with Jurassic
05:13 Generation with Claude
08:50 Invoke with Response Stream
10:58 Outro
#amazonbedrock #generativeai #aws
@wenijinew 9 ай бұрын
The great thing you've done is make complex technology seem like a piece of cake. It's like a magic. Thanks
@amazonwebservices 9 ай бұрын
That's AWSome to hear! 😀
@romain_tpifs 9 ай бұрын
Fantastic video Mike! very clear, easy to follow along. Exciting!
@GEB-Loop 8 ай бұрын
This is a fantastic and very useful demo of Amazon Bedrock capabilities. Thank you for posting this!
@easybusinessou 9 ай бұрын
You’re incredible! Can’t wait to see more from you.
@AnupWarrier 9 ай бұрын
Crisp explanation Mike! Well done!
@bluehorizon6357 9 ай бұрын
Such a clear and concise explanation. Thank you
@amazonwebservices 9 ай бұрын
We're so glad you enjoyed! 😀 🙌
@LabEveryday 9 ай бұрын
Great job Mike!
@mostafaalmahmud 9 ай бұрын
Nice explanation. Well done, Mike!
@khanna-vijay 7 ай бұрын
Excellent Mike, you make it look very simple. quite insightful nuggets.
@amazonwebservices 7 ай бұрын
That's true! 😀 🙌
@omkarphatak6444 7 ай бұрын
This is super useful Mike thanks.
@DataEngUncomplicated 9 ай бұрын
Great Video, Well Done Mike!
@SuperDanut 9 ай бұрын
Great introduction to this very promising new service! Thanks Mike
@amazonwebservices 9 ай бұрын
That's AWSome to hear! So glad you enjoyed! 😀 🙌
@debobratabose8853 9 ай бұрын
Awesome Mike ... Looks very simple ... If you have other use cases as to what base models to use for what kind of prompts it will be really very useful so that we know whether we should use AI21Lab, Anthropic or Amazon etc
@mikegchambers 9 ай бұрын
Thanks. Great idea for a video.
@ganapathytechtips5243 9 ай бұрын
Fantactic one. As usual awesome way of explaining from Mike !!!
@amazonwebservices 9 ай бұрын
Absolutely, agree! 🤩 🤝 ❤️
@skyisblue5029 9 ай бұрын
'Really loving this easy-to-follow content, great job!
@amazonwebservices 9 ай бұрын
That's AWSome to hear! 😀
@khalidelgazzar 8 ай бұрын
This is one hell of a video. Awesome 😎 thank you!
@amazonwebservices 8 ай бұрын
That's really great to hear! You're welcome, Khalid! 😀 🙌
@ZachDTravels 3 ай бұрын
Excellent video. Thumbs up
@Patrick-hl1wp 7 ай бұрын
awesome tutorial, thank you
@manninaki 9 ай бұрын
Thanks for video. Really interested in fine tuning for custom models too
@user-hl1et6xk8l 2 ай бұрын
Thank you -- it is very useful and helpful !!
@amazonwebservices 2 ай бұрын
That's great to hear! You're welcome! 😀
@mquanit 7 ай бұрын
Hi Mike, I loved how you presented this demo with python. Can you or anyone please share documentation with Javascript, I am about to create something using Bedrock and JS
@davidmartinezhernandez3275 8 ай бұрын
More video with Mike please!!!!
@mikegchambers 7 ай бұрын
Yes!!!!!!
@parisaghanad8042 6 ай бұрын
thanks!
@777imtiaz 9 ай бұрын
Nicely explained! Do you have an option to fine tune the models (fine tunable) using PEFT or other techniques?
@awssupport 9 ай бұрын
Hi there! If you'd like, feel free to ask our community of experts on re:Post for insight: go.aws/aws-repost. 👥 For additional options to get help, please check in, here: go.aws/get-help. 🛠️ ^LD
@bmarko 6 ай бұрын
thx!
@Torben-jp4sr 3 ай бұрын
Hi - I successfully followed this example. But now I want to continue the conversation thread. How can I do that?
@user-em3ej8fm9t 5 ай бұрын
This is really nice and detailed explanation. do we also need the model access for the play ground to explore the bedrock service ??
@awssupport 5 ай бұрын
Thanks for the inquiry. The information regarding Model Access can be found in the Amazon Bedrock docs here: go.aws/3OofT2j. Hope this helps. ^BD
@footballaipredictions 7 ай бұрын
Very cool, is there .NET equivalent anywhere? Polgot notebook or something along those lines. Most examples seem to be in Python, can convert it granted but just after a helpful starter.
@bruceli8139 3 ай бұрын
This video is a bit outdated now. First, they have moved "view API request" button into the three dots at top right corner. Second, the "propmt" in body of kwargs has been changed to "inputText". Or maybe just because I'm using modal , not the ?
@awsdevelopers 3 ай бұрын
Yes, there have been some updates since this was published! We're working on new videos, so that you're up-to-date with all things Amazon Bedrock :)
@AndresLeonRangel 8 ай бұрын
cool stuff.
@tomasmali6267 9 ай бұрын
Very valuable tutorial Mike! But one piece is missing, where and how did you connect the API amazon token/profile?
@awssupport 9 ай бұрын
Hi, Tomas. Our re:Post community may be able to assist on this one. Be sure to post your question, here: go.aws/3PZwmeq. ^CM
@user-yc4dy5ke1m 9 ай бұрын
did you figure it out?
@mohammadamirulikhmalbinhas7406 8 ай бұрын
have u tried changing the AWS account region? follow which profile region u install the bedrock@@user-yc4dy5ke1m
@dzafer27 3 ай бұрын
This is great
@amazonwebservices 3 ай бұрын
Thank you!👍
@DanielWeikert 8 ай бұрын
Has anyone tried that? Could not resolve the foundation model from the provided model identifier. Does not work for me even though I have access to the model according to aws
@awssupport 8 ай бұрын
Hi, Daniel. 👋 We have a re:Post community of industry experts eager to help with these technical questions. You can reach out to them through this link, here: go.aws/aws-repost. 🗒️ ^ZP
@kenkrueger65 6 ай бұрын
The Bedrock UI has changed. The "View API request" button has been removed. Any ideas for how to get a properly formatted JSON body?
@Appelsappel 2 ай бұрын
Its hidden behind the three dots now, a little bit higher
@nithinmoorthy5911 9 ай бұрын
I'm confused, is there an enviornment file somewhere where you set the keys that points to your Bedrock instance?
@awssupport 9 ай бұрын
Hello, Nithin! 👋 I've shared your question internally with our team for review. In the meantime, you can find more information on Amazon Bedrock here: go.aws/3rBVcbb. ✅ ^MO
@nachovichoZX 7 ай бұрын
I was able to follow the tutorial until the part about the "View API request" button that does not appear for me. How else can I access the API request?
@mikegchambers 7 ай бұрын
Oh you are right! The team have moved the button, and swapped it to the CLI format. You can find "View API request" under the three dots menu in the top right of the playground. If you would like to see JSON like I used in the video, then you can find that under "Base models" then select the model, and scroll down. Things move so fast!
@nachovichoZX 7 ай бұрын
@@mikegchambers Now I can see it, thank you very much for answering my question!
@callmefred 7 ай бұрын
Where do you authenticate (with your own account's credentials) in this scenario?
@awssupport 7 ай бұрын
Hi! 👋 While we cannot provide you with an answer immediately, we've reached out to our service team on your behalf. 👍 We'll get back to you as soon as we hear back from them. ^RF
@jyotsnamasand2414 3 күн бұрын
The ‘View API Request’ option shows the AWS CLI version. Has the json version been removed?
@awssupport 3 күн бұрын
Sorry for any disconnect here. I found you an official doc that might provide further context into Amazon Bedrock API requests: go.aws/3XSaxSE. If that's not helpful, I'd recommend reaching our to our community of experts on re:Post, for additional technical insight: go.aws/aws-repost. ^AD
@vikassalaria24 9 ай бұрын
#amazonbedrock #aws Can we use RAG kind of architecture with foundation models. How to create embeddings .Does Amazon Bedrock provides capabilities to create embeddings vector database and then that index can be used to retrieve information and that info to be given to LLM to generate more relevant content.
@awssupport 9 ай бұрын
Hi Vikas, I think this AWS Bedrock overview website could benefit you! Specifically, if you scroll down to "Benefits" you may find answers to your questions. Another good option is re:Post: go.aws/aws-repost. You can view and post to our AWS industry experts in a forum type environment. 💻 ^DC
@Ryanfboyer 9 ай бұрын
Check out the Knowledge base feature in Bedrock .can't remember if it's GA or not.
@dipteshbosedb 9 ай бұрын
Wonderful walkthrough, but where did you setup the APIs?
@awssupport 9 ай бұрын
Hi, Diptesh! 😊 You can access the Amazon Bedrock API using the AWS Command Line Interface (AWS CLI), an AWS SDK, or a SageMaker Notebook. Check out this handy document: go.aws/469gdsF. If you still need some tech assistance, see our re:Post article for some options: go.aws/tech-support. 🤓👍 ^RW
@tomasmali6267 9 ай бұрын
I was asking the same!
@edogbeatz 9 ай бұрын
I have been struggling for 3 days to find how to add Knowledge Base from sidebar. Can someone help me with this issue?
@awssupport 9 ай бұрын
Sorry to hear this, Edgar. This doc can help you out: go.aws/3LQVktX. If you need additional help, reach out using the resources found here: go.aws/tech-support. 🧰 ^RS
@timselaty 9 ай бұрын
Since Amazon's support is unhelpful, the Knowledge Base (and Agents) are currently in preview. You like do NOT have access to it yet.
@Eugeniocaraujo 8 ай бұрын
Im using ClaudeV2 but I cant find how many tokens Im using per request, in Jurassic it came with the response, how does it work for ClaudeV2?
@awssupport 8 ай бұрын
Hi there! I found this announcement that details Claude 2 can take up to 100,000 tokens in each prompt: go.aws/3QHZW8S. I hope this helps, but if you need help, feel free to check out AWS re:Post for input from our community: go.aws/aws-repost. ^RM
@Eugeniocaraujo 8 ай бұрын
Thanks for the support@@awssupport . I know it can generate text using up to 100k tokens, but in my requests I'm using it limited to 4k and I'm pretty sure it's not consuming 4k each time it generates a response to me correct? Like in Jurassic I was able to limite max amount of tokens to 4k and in it's response it was saying it "only" used 3.2k tokens to generate the response. I was wondering how could I get the exactly amount of tokens used in the Claude V2 response?
@awssupport 8 ай бұрын
Hello! Unfortunately I wasn't able to find any info specific to viewing token usage in your Claude response. However, I suggest asking our community of engineers on our Amazon Bedrock forum on re:Post for additional help: go.aws/aws-repost. ^RN
@its_shxblvrbs1786 4 ай бұрын
Is it free to use in our applications?
@AshishSharma-tx2nc 7 ай бұрын
How to implement the claude api in javascript
@awssupport 7 ай бұрын
Hello Ashish! 👋 For assistance with your query, you're welcome to post it on our re:Post community of experts, here: go.aws/aws-repost. ^RZ
@sailochanar3546 4 ай бұрын
while running this code i got unable to locate credentials error ,how to resolve it .please suggest.
@awssupport 4 ай бұрын
Terribly sorry to hear you're facing this issue. 😔 We highly recommend reaching out to our community of experts & engineers to get help with this. 🤓 Please do so, here: go.aws/aws-repost. 👈 ^RF
@sailochanar3546 4 ай бұрын
can we use Aws Bedrock fms with free tier account@@awssupport
@awssupport 4 ай бұрын
Currently, there is no Free Tier offering for this service. 😔 To learn more out our Bedrock service pricing, check out this page: go.aws/3TlVdL4. 👈 ^RF
@sailochanar3546 4 ай бұрын
Thank you for the info👍@@awssupport
@awssupport 4 ай бұрын
It's our pleasure! 🤗 ^RF
@user-ow6wl3pl1k 9 ай бұрын
Thanks, but i got error: Unknown service: 'bedrock-runtime'
@awssupport 9 ай бұрын
Sorry to hear, Orel! You may want to share details on AWS re:Post: go.aws/aws-repost. Our community of experts & enthusiasts can look over your configuration to help troubleshoot. 🤝 ^RM
@mikegchambers 9 ай бұрын
Hey! Thanks for trying out the code. Can you make sure you’re using the very latest version of Boto3. Let me know if you’re still having problems then.
@RP_USA 9 ай бұрын
@@mikegchambers I am having the same exact error. I have boto3 1.28.57 (Windows)
@RP_USA 9 ай бұрын
I believe the correct code should be: response = client.invoke_model(**kwargs) instead of: response = bedrock_runtime.invoke_mode(**kwargs)
@Ryanfboyer 9 ай бұрын
Boto3 packages were updated yesterday afternoon. Once you update to latest, it works fine.
@shashipal3589 9 ай бұрын
Hi pls provide github resource
@awssupport 9 ай бұрын
Hi there! You'll find our Amazon Bedrock workshop, here: go.aws/3PUK4PE. I'd also recommend looking through our resources to get started: go.aws/3FfIimp. ^RM
@sergiyshevchenko8055 9 ай бұрын
@@awssupport there is no code nor ipynb
@awssupport 9 ай бұрын
Sorry to hear about this trouble, Sergiy. Here's a link that might be just what you need: go.aws/3ZCiU3k. 🔗 If not, feel free to share additional details on what you're looking for. ^AK
AWS Developers
Рет қаралды 12 М.
Abonia Sojasingarayar
Рет қаралды 3,6 М.
Amazon Web Services
Рет қаралды 14 М.
Tiny Technical Tutorials
Рет қаралды 9 М.
Typecase
Рет қаралды 7 МЛН
Immersed
Рет қаралды 82 МЛН