company logo

ETL - Data Engineering Manager

Bangalore Urban
Chennai
Hyderabad
Full-Time
Hybrid
Executive: 10 to 30 years
20L - 50L (Per Year)
Posted on May 16 2024

Not Accepting Applications

About the Job

Skills

SQL MSSQL
ADF
Integration
Cloud Services
Queries Extraction
Architecture Modelling
ETL Solutions
ETL Process Functions

Work location: Prathik Tech Park, Electronic City Ph-1, Bengaluru, Karnataka.

Shift timings: 12pm to 9 PM

Total experience required: 15-20 years.

Notice Period - Immediate - to 30 Days Time (Only Less then - or 30 Days Time )


JD: -

•   Lead and mentor a team of data engineers in designing, developing, and maintaining efficient and reliable ETL pipelines.

•   Develop advanced scripts using Python for data extraction, transformation, and loading (ETL) processes.

•   Architect robust ETL solutions to support diverse data integration needs and complex business logic.

•   Translate business requirements into technical designs, ensuring solutions meet functional and performance expectations.

•   Set up and oversee monitoring systems to provide production support for Data Warehouse issues, such as data load problems and transformation/translation problems.

•   Thoroughly understand data transformation and translation requirements and determine the most effective tools for the job.

•   Design and automate modern data pipelines using a mix of cloud-based and on-premises technologies.

•   Effectively communicate complex results and technical designs to both technical and non-technical audiences, including business functional owners and stakeholders.

•   Promote continuous improvement in all aspects of the team's operations.

•   Perform additional duties and responsibilities as assigned to support the team's objectives.


Skills needed:

•   Bachelor’s Degree in Computer Science or a related field with relevant experience.

•   Experience in developing SQL code in MS SQL/Oracle or other databases.

•   Experience in Python scripting for data processing and ETL tasks.

•   Over 10 years of experience with ETL tools such as SSIS, ODI, SAP Data Services, Informatica or similar.

•   Extensive exposure and working experience in Azure Synapse, Azure Data Factory (ADF), or similar technologies.

•   Exposure to modern integration tools like Bhoomi, Celigo, Talend or similar

•   Proven experience working with APIs, lambda functions, and designing complex ETLs extracting data from various sources like RDBMS, Flat files, XML, and JSON.

•   Ability to analyze and optimize poorly performing queries/ETL mappings, with a strong understanding of performance tuning.

•   Extensive experience with cloud services like AWS EMR, EC2, IAM, S3, and CloudFormation, as well as databases like DB2, Oracle, and Hive.

•   Deep knowledge of data warehouse architectures and data modelling principles.

•   Demonstrated ability to work independently and as a team leader, with a strong belief in automated testing and version control.

•   Exceptional analytical, problem-solving, and communication skills, with client-facing experience.

•   Proven ability to architect ETL solutions, translate business requirements into technical design, and effectively communicate with business functional owners and stakeholders.

About the company

Specialties: Distributed Operations, Back-Office Systems, Real-time Financial Visibility, Optimization Shared Services. - Founded 2003* Indian Operation

Industry

Business Process Outsourc...

Company Size

501-1000 Employees

Headquarter

San Francisco, CA