Really nice explanation about in general how Merge operation works, thanks!

Great. Thank you for this video 🎉🎉

I did almost the same thing, but the job throws an error: "column "original_id" is of type integer but expression is of type character varying Hint: You will need to rewrite or cast the expression". All columns and data types are mapped correctly in a Change Schema transform, and I can see the data in the preview. The exception makes no sense.

Most useful video, thank you for making it. one quick question this can also be called SCD1?

Can you please make a video to implement a SCD2 type load using AWS glue

Hi! Thank you for your tutorials they are very helpful. Could you do something using kinesis stream, glue 4.0 pyspark stream, and iceberg but having different sources writing to the stream? I cannot find examples of having different schemas being written to the stream and how to store them to different tables for example users registry and transactions being written to 2 different tables. I read that KPL is a good idea when having multiple sources of data could you explain about that?

Can u also create a tutorial for covering data movement including CDC, from Aurora DB using Activity Stream to Amazon Kinesis, Glue Streaming Job and finally the target into Redshift (with insert / update / delete). Thanks in advance

what is there in dojo glue role. what policies should be attached and its trust relationship. do we need to do any role updates at redshift side ?

Is this statement available on Redshift already or just using AWS Glue?

Replicating the tutorial with the exact same source and target, same schemas, names, etc. I get an exception: Error, customerid does not exist in table payments... wich is ridiculous