How to Use Python with AWS S3 | Python Boto3 Tutorial

Рет қаралды 22,855

Күн бұрын

Let’s see how you can perform some of the more important operations in your S3 datastore using Python Boto3 library.
Boto3 is the Python library to interact with all AWS services. Here we look at one service in particular, AWS S3. AWS S3 is a simple storage service where you can store structured, semi structured and unstructured data.
It’s pretty common to store S3 for Photos and Videos, as well as use S3 as a data lake - a central data hub where all data flows in.
In this video, we cover all the important operations that you will need. Here are the operations with their timestamps:
00:00 Intro
01:00 What is S3?
03:05 Boto3 Introduction
04:04 List all buckets
05:15 List all objects
07:30 File Upload
12:47 File Download
16:53 Presigned URLs
24:25 Create Bucket
26:17 Copy objects between buckets
29:00 GET object metadata
30:00 Summary & Outro
Check out the code over here: github.com/irtiza07/s3-boto3-...
#aws #s3 #python #boto3 #tutorial
Visit me at: irtizahafiz.com
Contact me at: irtizahafiz9@gmail.com

Пікірлер: 42

@AsadAdeel Жыл бұрын

Clear, to the point without wasting time, thanks for quality content

@irtizahafiz 8 ай бұрын

Glad you found it helpful!

@stevenparker6742 9 ай бұрын

Gave me just what I needed to get started as all I needed was the basics. Very easy to follow. Thanks.

@irtizahafiz 8 ай бұрын

Thank you! I will start posting again soon, so please let me know what type of content interests you the most.

@navyasreeveluri Жыл бұрын

thanks for the video... I have zero knowledge on python and your tutorial helped me to at least start through...

@irtizahafiz 8 ай бұрын

Glad you found it helpful! Cheers!

@rahulprajapat6211 Жыл бұрын

Thank you for this wonderful tutorial

@irtizahafiz 8 ай бұрын

Glad you found it helpful! Cheers!

@mehnaz499 2 жыл бұрын

very well explained.

@mathisart Жыл бұрын

Very good video.

@gabrielamalaspina7187 5 ай бұрын

thanks, man! this was really helpfull

@irtizahafiz 4 ай бұрын

Glad it helped!

@imalkagunasekara8725 Ай бұрын

Great

@nicholaicorbie Жыл бұрын

What about setting up credentials to access the bucket from the code?

@irtizahafiz Жыл бұрын

You can use AWS CLI tool. I believe it's there in one of the comments of the video.

@Fullon2 2 жыл бұрын

Hello. What is the most efficient way to read multiple json files in the bucket ? content_object = s3_bucket.s3_resource.Object(s3_bucket.bucket, file) file_content = content_object.get()['Body'].read().decode('utf-8') I use the above code, but if the volume of files is high, it gets slow, any tips ?

@irtizahafiz 2 жыл бұрын

Hi! I am not sure. I will have to look into it. If I have any ideas I will let you know : )

@aztecGin 8 ай бұрын

Hi! I tried to follow you in VSCode I can't use client.list_objects_v2() that method doesn't exist nor list_buckets() Could you please elaborate why I don't have these? I have boto==2.49.0 boto3==1.28.83 botocore==1.31.83 installed

@swati123verma 2 жыл бұрын

how do I do a partial read on S3? I have tried the Range but it didn't work out. Any idea

@irtizahafiz 2 жыл бұрын

Hi! I am not really sure. If I get the time, I will look at it and get back to you.

@AS-fj7ox Жыл бұрын

Dude.. thank you very much for the tutorial. This is a well needed knowledge my only take is that your material is sunk into a huge yellow background for no specific reason. like the cup of coffee on the right corner is almost as big if not bigger than the video itself. also the image is too small, I think for the same reason. please mind that in your next episodes.Thanks!

@irtizahafiz Жыл бұрын

Hi! Thank you for the feedback. I did remove that in my later videos : )

@TheSanyamkumar Жыл бұрын

How are you authencating the AWS access key, secret key and session key here?

@irtizahafiz 8 ай бұрын

I configured it beforehand using AWS CLI

@Ibrahim-ld7vl 2 жыл бұрын

Very helpful video thank you. What is the vscode theme name is?

@irtizahafiz 2 жыл бұрын

I believe it’s Dracula.

@DeepakKumar-uz4xy 2 жыл бұрын

where are the credentials? how did you accessed without credential

@irtizahafiz 2 жыл бұрын

You can setup your credentials ahead of time using this CLI tool: docs.aws.amazon.com/cli/latest/userguide/cli-chap-configure.html

@arunlakhera Жыл бұрын

When I deploy this code on AWS AppRunner, the code is not able to store file on S3 ..Any idea ?

@irtizahafiz 8 ай бұрын

Not sure. Maybe it's a AWS permission thing?

@DariuszMakowski Жыл бұрын

Thanks for not showing how to set up credentials! Awesome tutorial.

@irtizahafiz Жыл бұрын

Sorry. I configured it using the AWS CLI tool.

@marcellodimarinoazevedo 11 ай бұрын

People usually avoid talk about that or simplify using environment variables with access and secret keys, without telling that it needs to be avoided in PRODUCTION environments. They do not show how to use roles with STS and its implications in code.