Lead Data Engineer Job Description
As a Lead Data Engineer, you will be responsible for leading a team of data engineers in designing, developing, and implementing data pipelines and solutions. You will work closely with data scientists to ensure the efficient processing and analysis of large datasets.
Responsibilities
- Lead a team of data engineers in designing and implementing scalable data solutions
- Collaborate with data scientists to understand data requirements and ensure data integrity
- Develop and maintain data pipelines for efficient data processing
- Optimize and tune data systems for performance and scalability
- Provide technical guidance and mentorship to junior data engineers
Qualifications
- Bachelor's degree in Computer Science, Data Engineering, or related field
- Proven experience in a data engineering role, with at least 5 years of experience
- Strong knowledge of data warehousing concepts and big data technologies
- Experience with cloud platforms such as AWS or Azure
- Excellent problem-solving and analytical skills
Skills
- Data modeling
- ETL tools (e.g. Apache NiFi, Talend)
- SQL and NoSQL databases
- Big data technologies (Hadoop, Spark)
- Cloud platforms (AWS, Azure)
- Python or Java programming