@AdnanKhan-kf2bm 8 ай бұрын
Thank You Very Much for Explaining the concept in simple way. I had no idea about Meta Data driven prior watching your video , Now I have a fair idea about it, Thanks again.
@BigDataThoughts 8 ай бұрын
thanks
@AnandKumar-dc2bf Жыл бұрын
Can you do one video or 2 on real-time issues in Apache spark
@sarfarazhussain6883 Жыл бұрын
One quick Q, let's say my schema or Metadata has a column "ID" as Long and using that I already created my table in Lakehouse, after a month application team changed the ID from Long to String, how am I going to handle it without reprocessing the entire table?
@BigDataThoughts Жыл бұрын
yes for data type change you would need to reprocess(its a destructive change). Using a metadata framework doesn't mean that there would be no reprocessing at any point of time but it ensures we reduce code changes for many scenarios. Typically constructive changes like adding a new column.
mrpaulandrew
Рет қаралды 15 М.
Google Cloud Tech
Рет қаралды 6 М.
Software Development Engineer in Test
Рет қаралды 1,1 М.
BigData Thoughts
Рет қаралды 9 М.
KratosBI
Рет қаралды 1,7 М.
LearnITEveryDay - Azure ETL Solution made Easy
Рет қаралды 2,4 М.
Databricks
Рет қаралды 6 М.
Software Architecture Academy
Рет қаралды 70 М.