Pyspark Developers

Experience: 4 -7 Years

Location: Chennai / Bangalore

 ·        Develop Big Data applications using -Pyspark on Hadoop, Hive and/or Kafka, HBase, MongoDB

·        Build Machine Learning models

·        Deployment on Cloud platforms

·        Total IT / development experience of minimum 4+ years of Big Data.

·        Experience in -Pyspark developing Big Data applications on Hadoop, Hive and/or Kafka, HBase, MongoDB

·        Deep knowledge of Pyspark and libraries to develop and debug complex data engineering challenges

·        Experience in developing sustainable data driven solutions with current new generation data technologies to drive our business and technology strategies

·        Exposure in deploying on Cloud platforms

·        Development experience on designing and developing Data Pipelines for Data Ingestion or Transformation using -Pyspark

·        Development experience in the following Big Data frameworks: File Format (Parquet, AVRO, ORC), Resource Management, Distributed Processing and RDBMS

·        Developing applications in Agile with Monitoring, Build Tools, Version Control, Unit Test, TDD, CI/CD, Change Management to support DevOps

·        Development experience with SQL and Shell Scripting experience

·        Banking domain knowledge

·        Hands-on experience in SAS toolset / statistical modelling migrating to Machine Learning models

·        Digital Marketing Machine Learning models and use cases

·        ETL / Data Warehousing and Data Modelling experience prior to Big Data experience

·        Deep knowledge on AWS stack for big data and machine learning

Company: Maveric Systems

Company Website : https://maveric-systems.com/

Type: Permanent

Position – Ab Initio Developer.

Location - Chennai, Bangalore.

Work Mode - Hybrid Model (3 days/week)

Job Description:

· ETL /Ab Initio Skills: Development experience in GDE, Express-It or any other ETL tool

· Exposure to Data Analysis

· Experience in Requirements Analysis, Data Analysis, Application Design, Application Development, Implementations and Testing of Data warehousing business systems.

· Solid experience in developing Ab Initio applications for Extraction, Transformation, Cleansing and Loading into Data Warehouse/Data mart.

· Strong experience on developing re-usable generic applications for high-volume DWH environment.

· Experience on development and maintenance of schemas, Fact Tables, Dimensional Tables (Type 1, Type 2, Type 3), and Surrogate Keys.

· Extensively used Ab Initio EME data store/sandbox for version control, code promotion, and impact analysis or any other ETL tool

· Experience in providing Business Intelligence solutions in Data Warehousing in Windows and UNIX platforms.

· Experience in writing UNIX Shell Scripts.

· Experience in integration of various data sources with Multiple Relational Databases like Oracle, SQL Server and Worked on integrating data from flat files and spreadsheets.

· Ability to solve problems and identify opportunities through analytical thinking.

· Good knowledge of Advanced MS Excel tools is a must for reporting and analysis.

· Strong attention to detail and has ability to learn quickly.

· Excellent communication skills with good command over English language (verbal & written).

· Ability to work independently and in a team environment.

Best Regards,

Anandhi | HR Recruiter 

8925516041 | www.krishpar.com

Krishpar Technologies

E.Mail - anandhiv@krishapr.com