Role: Big data-Spark Developer

Experience: 5-8 Years

Skills: spark, scala, pyspark, spark streaming, python, Hadoop, hive, snowflake

Salary: 12.5 LPA – 20 LPA

Notice: 0-15 Days

Location: Pune

Job Description

Essential Skills: Snowflake, Spark, Scala, Pyspark, oozie, Airflow, Python, Cloud Technologies, HDInsight, HBase, Hive, Spark Streaming

Roles and Responsibilities

• Develop data set processes for data modeling, mining, and production.
• Create Scala/Spark jobs for data transformation and aggregation.
• writing complex snowflake queries and deal with data warehouse.
• Responsible for the maintenance, improvement, cleaning, and manipulation of data in the business operational and analytics databases.
• Ensure that quality of the application is as per expectations
•  Write Junit test cases and unit testing
• Follow the development processes and be able to work in Agile- Scrum environment

Requirements

• Experience with the major big data solutions like Spark, Hadoop, Hive, Kafka, Scala for spark, Snowflake, HBase, Oozie etc with experience of 5-8 years.
• Experience with large data management, data integration and NoSQL database implementations
• Spark Developer with experience in large scale production deployment, data pipeline and large-scale computation.
• Experience in using programming languages such as Scala to query data for analysis and sometimes use big data SQL engines.
• Experience with Apache Spark streaming and batch framework.

Contact: hr@dreamwingstech.com/ 9003187281