Big Data Developer

Job Title: Big Data Engineer/Developer/Sr. Developer/Leads

Job Locations: Bengaluru/Hyderabad/Pune/Indore/Noida/Gurgaon.

Job Description

Position Summary:

We are looking for candidates with hands on experience in Big Data Technologies.

Must have technical Skills

2-10 Years of experience

Expertize and hands-on experience on Python/Java – Must Have

Expertize knowledge on SparkQL/Spark Dataframe – Must Have

Good knowledge of SQL – Good to Have

Good knowledge of Shell script – Good to Have

Good Knowledge of one of the Workflow engine like Oozie, Autosys – Good to Have

Good knowledge of Agile Development– Good to Have

Good knowledge of Cloud- Good to Have

Passionate about exploring new technologies – Good to Have

Automation approach - – Good to Have

Good Communication Skills – Good to Have

Roles & Responsibilities

• Data Ingestion from source to target
• Develop Python code or PySpark code or Python+SnowSQL or Python+ReshsiftSQL (Depending of customer choice of target platform)
• Data Validation
• Performance Tuning.
• Design and implement solutions for problems arising out of large-scale data processing
• Attend/drive various architectural, design and status calls with multiple stakeholders
• Ensure end-to-end ownership of all tasks being aligned
• Design, build & maintain efficient, reusable & reliable code
• Test implementation, troubleshoot & correct problems
• Capable of working as an individual contributor and within team too
• Ensure high quality software development with complete documentation and traceability
• Fulfil organizational responsibilities (sharing knowledge & experience with other teams/ groups)
• Conduct technical training(s)/session(s), write whitepapers/case studies/blogs etc.

Mandatory Skills

BigData, Hadoop, Hive, Spark, Python/Java

Education/Qualification

BE / B.Tech / MCA / M.Tech / M.Com