Why I QUIT Data Engineering

Рет қаралды 3,029

Жыл бұрын

Welcome to my channel! In this video, I'll be sharing my incredible journey from a software engineer to a data engineer and then back to being a software engineer. Join me as I delve into the fascinating world of engineering and discuss the valuable insights I gained along the way.
Throughout my career, I've had the privilege of working in both software engineering and data engineering roles, allowing me to gain a deep understanding of the intricacies involved in each field. I'll be sharing my experiences, challenges, and the valuable lessons I learned during my transition from one role to another, and ultimately back to where I started as a software engineer.
As a software engineer, I thrived on building robust applications and solving complex problems. However, my curiosity led me to explore the realm of data engineering, where I discovered a whole new world of possibilities. The challenges I encountered in this domain pushed me to expand my skill set and delve into the world of big data, data pipelines, and data processing.
In this video, I'll provide insights into the key differences between software engineering and data engineering, including the tools, technologies, and methodologies that are unique to each discipline. By sharing my experiences, I hope to offer guidance to fellow engineers who may be considering a similar transition or seeking to broaden their skill set.
Join me on this journey as I discuss the exciting projects I worked on as a data engineer, the technical skills I acquired, and the impact it had on my career trajectory. Additionally, I'll explore the reasons that led me to transition back to software engineering and the valuable lessons I carried with me.
Whether you're a software engineer, data engineer, or simply interested in the field of engineering, this video will provide you with valuable insights and a unique perspective on the journey between these two disciplines. Make sure to subscribe to my channel to stay updated with more exciting content and hit that notification bell to never miss a video.
Thank you for joining me on this incredible journey from software engineer to data engineer and back again. Let's dive into the world of engineering together and unlock new possibilities!
#SoftwareEngineer #DataEngineer #EngineeringJourney

Пікірлер: 18

@AchuVlogs 2 ай бұрын

I've been in data engineering for about 4 years now and I can totally relate to what you mentioned in the video. I love building new applications, but 80% of the time feels like I'm just fixing things that keep breaking in the pipeline. I'm thinking of switching to a backend software engineer role since the skills are somewhat transferable.

@ishaqhamin 2 ай бұрын

The skills are massively transferable. And you’ll get to build a lot of cool stuff. Even the maintenance is a lot more enjoyable then flicking through pipelines. Good luck with it. P.s. I’ve been looking at Golang which is growing hugely for a backend language and pays very well.

@mickyman753 28 күн бұрын

Hi , I'm a fresher, just spent almost a year in my new job and hardly getting to do new development/coding, mostly it's some lambda functions for some automation or some other kind of functionality or the aws CDK code for Infrastructure as code, I'm feeling bored but I don't know what should I do now, I have tried react in depth also explored nodejs, and recently did springboot with java , i enjoyed node and Java wasn't bad , but since I don't have work experience in software development nor my skills will be as good as someone who's into software development for a year moreover people here in my country are asking system design dsa and tech related in depth questions, so need to preoare hard for that , I am thinking to learn sql in depth by doing it in depth (I don't even do sql a lot snd mostly it's adding few pyspark transformations) , then I'll try to make my springboot better since my company already have people working on springboot although i don't know if I'll enjoy it , then will try to switch to a company with thah experience. can you give me some advice. I'm almost 24

@ishaqhamin 28 күн бұрын

Hey. So, yeah. That pretty much is what data is all about config, firefighting and more. It can get quite boring unless you are working for a startup. I would recommend trying an internal move first, I did that and moved from the data team to full stack development in customer services and tooling. If you enjoy Java and springboot then definitely follow it up, Node is quite popular and so is Go. I think your first opportunity will be to try for an internal move. Also, do not worry about years of experience, what matters is your willing to learn and get stuff done.

@mickyman753 28 күн бұрын

@@ishaqhamin also I was thinking to move to software development first internally and not sweating on which future technology would I get the job on , so would try to develop my springboot knowledge with microservices since my company mostly has Java openings . But I was thinking since even my current job requires SQL and might be in future SQL might help me and in my work although I'm not getting a lot of SQL, I was thinking to build a habit of solving 1-2 SQL questions everyday and make it to intermediate level, do you think is this right or I'm jumping into too many boats at the same time ?

@ishaqhamin 27 күн бұрын

I think Java and microservices is a great idea! Both are used extensively across many companies and you’ll definitely have fun, feel challenged and grow a lot of skills. You can learn SQL too just don’t do to much too soon and get burnt out. It sounds like you’ve got a really good plan

@mickyman753 27 күн бұрын

@@ishaqhamina big thanks for answering my doubts

@aniket9595 2 ай бұрын

You captured it perfectly.. thanks a lot 😊 I have been a data engineer for 11 years and now trying to move to software engineering.

@ishaqhamin 2 ай бұрын

Thanks for watching! I’m certainly glad I did.

@aniket9595 2 ай бұрын

@@ishaqhamin Would love to get in touch sometime for a mentoring session, if possible. Thanks!

@mickyman753 28 күн бұрын

Hi aniket , what're doing for the switch and did you see any updates on the good sides while trying to get interviews?

@aniket9595 27 күн бұрын

@@mickyman753 I'm still exploring ways to make the transition. I understand that DSA is extremely important so I started brushing up on it using Neetcode YT channel. However the learning curve on web development side is pretty steep (JS, Typescript, Micro services, etc). Still trying to rack my brain around it.

@user-mu4uw2sr3g Ай бұрын

Hello everyone! I'm considering a transition from a Scala software engineer to a Scala data engineer. I've found that being a Scala dev is very challenging for me , but I'm not ready to give up on Scala just yet. Can anyone share insights on whether working as Scala Data engineer (Sql ,Spark) might be a smoother path for me? Appreciate any advice!

@ishaqhamin Ай бұрын

Scala is an amazing language and very specialised. If you stay with it you’ll be in a unique position with a unique language. Which makes you valuable. Working with scala as a data engineer is different as you’ll have different problems. It won’t all be scala you’ll have a mix airflow, and other config and setups plus likely some python. So a mix of variety and likely not as intense.

@neutech9108 7 ай бұрын

I have been working with Data for past 4 years. And I am losing interest in it because, most of the time I am doing fixes to the existing data. I am trying to switch my career to software engineering. But seems like I have to learn a lot to do this switch.

@ishaqhamin 7 ай бұрын

Yes, fire fighting is rampant in DE. The worst part tbh as it takes up so much time with investigations and unless you really enjoy it then it’s a chore. You will be surprised. A lot of what you likely do will be cross compatible. You just need to pick an area and focus on it.

@loujon191 8 ай бұрын

Was this video meant to be heard over music playing in the background? I’m so confused

@ishaqhamin 8 ай бұрын

It was one of my earlier videos where I was still getting to grips with editing. Thanks for pointing it out though, I can re record in a better format.