Sample Job Description for Data Engineers - Suggestions, Please?

Hey Steve, here's a job description you can use -

Job Title : Data Engineer

Job Type: Full time , Contractors

Location: [Insert Location]

Specify if Remote Allowed within [ US / India / Europe ]

Job Description

We at [company name] are looking to hire fresh Computer Science engineering graduates / experienced data engineers to join our engineering team.

The ideal candidate will be passionate about handing big data and solving some of the most complex problems our clients face. In this role, you will have an opportunity to work closely with our data analysts, data science teams, software development team and also the quality assurance teams.

Roles and Responsibilities

As a member of our technical staff, you will be involved in the following activities -

• Work closely with clients to understand the problems.
• Conceptualise and suggest reliable and cost-effective solutions using your expertise and team capabilities
• Design, develop and maintain scalable and robust data pipeline infrastructure in coherence with client's data-driven initiatives.
• Collaborate with various data teams within [company name]
• Prepare and maintain detailed documentation about the data pipelines, data models and data dictionaries for each client.
• Work upon data quality monitoring and validation processes to ensure data compliance, data accuracy and consistency throughout the lifespan of the project.
• Work with data testing teams and software development team to build robust manual tests.
• Work with automation testing team to develop automation test framework.
• Optimise and tune the data infrastructure for efficiency, performance and cost-effectiveness.
• Actively participate and contribute to peer code reviews, testing and develoyment.

Eligibility / Requirements

• Preferred, but not mandatory : Bachelor's degree in Computer Science, Computer Technology, IT or similar engineering fields.
• Minimum 3 years of relevant experience in data engineering role preferably with startups.
• Familiarity with one of more of the following programming languages: Python, R, Scala, Java
• In-depth knowledge of SQL is a must
• Knowledge of data modeling, scalable data architecture
• Experience with Azure is preferred. Experience with Amazon AWS and GCP will be considered.
• Excellent communication skills and ability to work in a fast-paced, dynamic environment
• Special Preference : Candidates with Azure DP-203 certification will be given preference throughout the selection process.

How to apply?

Interested candidates can either apply online thorugh our careers portal on: [link] OR send their resumes to [HR email address].

Hope this helps.

Fellow engineers interested in career in data engineering may go through these relevant links -

1. Data Engineer Salary and Career Opportunities
2. What is big data engineering?
3. Is Data Engineering Stressful?
4. Data Engineering - Remote Job?
5. Is Data Engineering in Demand?

I hope these discussions will be very useful to you.

I think I missed the data engineering skills part in the job description. Here we go -

Data Engineering Skills

1. Proficiency in SQL:

The candidate must be able to write efficient and effective SQL queries. Familiarity with design and development of databases would be an added plus.

2. ETL Experience:

Experience with ETL (Extract, Transform, Load) is a must. Candidates should have exposure to the knowledge of data integration, data quality, data validation along with knowledge of Apache Kafka, Apache Spark and Apache NiFi.

3. Strong Programming Foundation:

The candidate should be proficient in programming or scripting languages like Python, Java, Scala or R. Past experience in writing scalable data systems would be an advantage.

4. API Writing:

Candidate should be able to write APIs and Web Services based on the project requirements. Prior work experience in API development is desired.

5. Knowledge of Data Architecture and Design:

Strong understanding of data architecture and design principles including data modelling, DB design, Schema design would be a big plus.

6. Exposure to Hadoop, Hive, Spark:

Along with knowledge of cloud engineering, candidates should have exposure to at least one of the following technologies: Hadoop, Hive, Spark, Parallel Processing, Distributed Computing etc.