Is data engineering in demand?

By - Bruce Wathan • 1 year ago • 19.3k views

Wish to know if data engineering is in demand these days. I am a java programmer with over 5 years of experience. Recently seen a colleague switch to data engineering and got a big jump.

I'm curious to know if data engineering will be in demand 5 and 10 years from now.


  • Kaustubh
    Kaustubh Katdare

    I worked with an AI startup that offered data engineering services to its clients. As the head of data engineering, I got an in-depth view of the world of data engineering. Data engineering has a huge demand and potential in coming years.

    Understanding the scope of data engineering

    Although the data engineering field became popular after 2015, it's been in existence for a long time. Think about the SMEs who had no option but to store their data at local servers - with with no security and backups.

    Microsoft, AWS and Google noticed a big opportunity and developed cloud services to port this data to cloud. Given the advantages of cloud, moving the data to cloud from local premises was a no-brainer move for almost every SME and even enterprise clients.

    All the big cloud providers have built an amazing portfolio of services around data migration and processing; which ensures that data engineering is going to be in demand for several years.

    Demand for data engineers will grow

    I'm confident that data engineering will become very popular in coming years and the salaries will also boost. There are a ton of projects that boutique startups and large enterprise IT companies are working on which are focused on data engineering. It's a field easy to enter and make a career in.

    Let me know if that answers your question.

  • Kaustubh
    Kaustubh Katdare

    Update: While the demand for data engineers grows every year, the availability of skilled data engineers is a challenge. That's the reason there are several companies wanting to hire remotely.

    There are several jobs where data engineers can work from home. All you will need is a good computer and a strong Internet connection.

  • Kaustubh
    Kaustubh Katdare

    Update - please do check this article about big data engineering . Plus, a question on can data engineers can switch to machine learning career.

Note: Only logged-in members of CrazyEngineers can add replies.

Other questions

Elon Musk has completed his takeover of Twitter and one of the new changes he's proposed is $8/mo for the Twitter blue tick.

Do you think this move is justified? Let me know!

When it comes to building a successful business - does age matter? Well, the data shows that it does. The average age of tech entrepreneurs at the time of IPO is about 43.3 years!

Now that's totally contrasting to the news that we read daily. The Internet is full of success stories of entrepreneurs who became successful business owners and millionaires in their early 20s or 30s. But the data shows the truth - the older you are, the more are your chances of starting a successful business.

What do...

The IT and technology industry is going through massive layoffs. The latest news being Salesforce laying off 2500 employees and Meta planning to show pink slip to, if I'm not wrong, 11000 employees worldwide.

How long do you think these layoff cycles will last? Someone said this will continue till January 2023. What are your thoughts?

Register now for The Engineer UK organized free December 6th online panel session exploring what the current era of profound technological change means for engineering organisations and the people that work for them. Featuring speakers from BAE Systems, Royal Academy of Engineering, STEM Returners and The Labour Party .

The Telecom Regulatory Authority of India is proposing to make it compulsory for the network operators in India to show the identity of the caller with each call. This means, what TrueCaller offered will now be default - and I don't know how it will not end TrueCaller's business in India.

TRAI will pull the data from KYC documents submitted while obtaining the phone number / SIM card. This data will be queried every time there's an incoming call and displayed on the phone screen by default.

While it's immensely...