AWS Glue PySpark: Rename Fields
Рет қаралды 2,778
Күн бұрынThis video is a technical walkthrough on how to rename a single field as well as multiple fields\columns in a DynamicFrame in aws glue job with PySpark. This video will use a dataset as an example to see how we can achieve this in AWS Glue 3.0 leveraging python.
Timeline:
00:00 Introduction
00:46 Rename a Single Fields
02:32 Rename Multiple Fields
GitHub Repo link:
github.com/AdrianoNicolucci/d...
@zramzscinece_tech5310 Жыл бұрын
Your vides are really nice and informative. Pls try to keep a good length at least 30 min so that one video covers most of the aspect.
@DataEngUncomplicated Жыл бұрын
Hi zramz, thanks for your suggestion. I decided to go a different route for this series, I'm making short videos for the most common transformations that need to be transformed instead of one long 1 hour video, this will make it easier for people searching for the right transform rather than trying to skim through a very long 1 hour video. I hope this makes sense
@cory1630 Жыл бұрын
Any idea how to transform the name of nested structures like ArrayType?
@Nayak_Bukya_08 29 күн бұрын
how to get input file name of a record in spark dynamic dataframe ?
@DataEngUncomplicated 26 күн бұрын
I don't think this method is possible in a dynamicFrame.
Jason Derulo
Рет қаралды 58 МЛН
TESLA CAR WORLD
Рет қаралды 77 М.
AWS Glue Tutorial for Beginners| Learn everything about Glue in 30 mins| Glue Data Catalog| Glue ETL
AWS Made Easy
Рет қаралды 8 М.