Senior (7 to 10 years)
1L - 7L (Per Year)

About the Job


JD and company profile Data Consultant - Spark Developer with AWS position Gurgaon location:

  •         Position Title : Data Consultant - Spark Developer with AWS
  •         Mandatory Skills: Experience working on Big Data Consultant with PySpark/Scala or Java, AWS Glue, EMR and Lambda, Cloudera Data Platform (CDP) Rest as per below JD.
  •        Exp – 7 to 12 years
  •         Qualification : B Tech/BE
  •         Job Location – Gurgaon (Remote during pandemic)
  •        Interview procedure:–Video (MS Teams) interviews in weekdays. (Google & MS team )
  •         Shift Timing : NA



A passionate Big Data Consultant with PySpark/Scala or Java 

Desired Candidate Profile

- Strong Programming skill in Spark, Scala or Java

- must have implemented solutions on AWS Glue, EMR and Lambda

- worked with s3 based data lakes, crawlers and Athena for data exploration

- integration with various source systems for data ingestion pipelines

- Experience with Impala, Kafka or other streaming solutions is good to have

- JIRA, GitLab, Jenkins is a must

- IntelliJ IDEA, Eclipse

- Strong knowledge in Cloudera Data Platform (CDP)


Roles and Responsibilities


- Hands on Spark/Scala programming experience

- Participating in agile development projects for batch and real time data ingestion.

- Integration with AWS, Real-Time Systems, Data Warehouses, and Analytics solutions.

- Working with business and peers to define, estimate, and deliver functionality.

- Produce unit tests for Spark transformations and helper methods

- Design data processing pipelines

- Good in writing Scaladoc-style documentation with all code



About the company

iQuest Management Consultants ('iQuest'​) is India's top recruitment partner and the leading executive search firm. Started in 2000, today iQuest is proud of working with more than 500 clients across India, the UAE, Malaysia and Singapore. Across 5 offices in India and one in the Middle East we empower organizations across lifecycles - from young start-ups to industry behemoths. ...Show More

Company Size

51-200 Employees



Other open jobs from IQuest Management Consultants