Sample Job Description for Data Engineers - Suggestions, Please?
By - Steve Gracia • 7 months ago • 5.6k views
We are recruiting data engineers in our company. I'm helping the HR team write a job description for data engineers. The aim is to hire fresh graduates interested in data engineering and also a few experienced data engineers with 3-4 years of experience.
If someone can provide a job description template for data engineers, I'll be grateful.
I think I missed the data engineering skills part in the job description. Here we go -
Data Engineering Skills
- Proficiency in SQL:
The candidate must be able to write efficient and effective SQL queries. Familiarity with design and development of databases would be an added plus.
- ETL Experience:
Experience with ETL (Extract, Transform, Load) is a must. Candidates should have exposure to the knowledge of data integration, data quality, data validation along with knowledge of Apache Kafka, Apache Spark and Apache NiFi.
- Strong Programming Foundation:
The candidate should be proficient in programming or scripting languages like Python, Java, Scala or R. Past experience in writing scalable data systems would be an advantage.
- API Writing:
Candidate should be able to write APIs and Web Services based on the project requirements. Prior work experience in API development is desired.
- Knowledge of Data Architecture and Design:
Strong understanding of data architecture and design principles including data modelling, DB design, Schema design would be a big plus.
- Exposure to Hadoop, Hive, Spark:
Along with knowledge of cloud engineering, candidates should have exposure to at least one of the following technologies: Hadoop, Hive, Spark, Parallel Processing, Distributed Computing etc.
Note: Only logged-in members of CrazyEngineers can add replies.
Can an engineer become a doctor? If you got forced into studying engineering and want to go back to your first love - medicine (MBBS), what are your options? Let's discuss.
Yes, an engineer can become a doctor. But it won't be easy. Engineering degrees worldwide are mostly 4-year degree courses and medicine too requires an average of 4-5 years followed by mandatory internship. Not everyone has the patience, money and time to dedicate a decade only to learning.
If you are an engineer or engineering student who wants to...
I was recently asked if a data engineer can become a data science. How difficult is it for data engineers to switch career to data scientist and what type of training is involved. Looking for responses from data engineers and data scientists.
A data engineer can become a machine learning engineer with proper training. Keep in mind that being a data engineer is not a prerequisite for becoming a machine learning engineer.
I find this question very similar to Can data engineer become a data scientist?. Do take a look at that discussion as well.
Data engineering is an emerging field in the big-data domain and there's a growing demand for data engineers.
A typical data engineer role involves collecting data, creating data pipelines, verifying the data, correcting it and...
Can data engineer work from home? Or do they have to be physically present at the work-site to get their data engineering job done? Let me answer this commonly asked question.
A data engineer can definitely work from home. The role of data engineer does not require the engineer to be physically present on-site. Why? because 99% of the data engineering work happens in the cloud. All you'll need is a strong Internet connection and credentials to login to your cloud accounts to build data pipelines.
Can data engineers...
Almost every engineer from the Indian middle class has considered working in a bank. Why? Traditionally, for most of Indian families - a bank job is safe, secure and gives you freedom to enjoy holidays. Also - you can settle much faster in life with a bank job. So, can engineer work in bank?
An engineer can definitely work in bank. I've had several friends who got first-class degree in engineering, then opted for MBA and then chose to work for a bank.
I'm sure you'd have engineer friends who're...