company logo

Data Engineer

Bangalore, Hyderabad, Chennai
Full-Time
Fresher: Less than 1 year
Posted on Feb 15 2022

About the Job

Skills

Design, develop, test, deploy, support, enhance data integration solutions seamlessly to connect and integrate enterprise systems in our Enterprise Data Platform.

Innovate for data integration in Apache Spark-based Platform to ensure the technology solutions leverage cutting edge integration capabilities.

Experience with ETL, data pipeline creation to load data from multiple data sources.


Primary Skills:


5+ years working experience in data integration and pipeline development.

BS degree in CS, CE or EE.

3+ years of Experience with AWS Cloud on data integration with Apache Spark, EMR, Glue, Kafka, Kinesis, and Lambda in S3, Redshift, RDS, MongoDB/DynamoDB ecosystems

Experience in Python and common python libraries is a must

Strong real-life experience in python development especially in pySpark in AWS Cloud environment.

Design, develop test, deploy, maintain and improve data integration pipeline.

Strong analytical experience with database in writing complex queries, query optimization, debugging, user defined functions, views, indexes etc.

Strong experience with source control systems such as Git, Bitbucket, and Jenkins build and continuous integration tools.

Databricks, Redshift Experience is a plus.

About the company

We are a staffing expert company with options to hire on C2H, Contract or Perm positions. We offer our clients to achieve their business goals with successfully outsourcing the business processes and functionalities. Our ability to offer high quality services in quick time makes us sustainable among the competitors. We believe in giving custom-fit, flexible and high quality solutions by deeply ...Show More

Industry

Staffing and Recruiting

Company Size

2-10 Employees

Headquarter

Bangalore