Data Engineer Lead - Microsoft Azure

11

Applications

Bangalore
Full-Time
Senior: 7 to 10 years
6L - 15L (Per Year)
Posted on Apr 25 2023

About the Job

Skills

Data engineer
Microsoft Azure(DP-203)
Microsoft Azure
ADF/PySpark/Databricks/ADLS
Azure Full stack/Event hub
SQL/Python/Scala/Java
Databricks Certified Developer

Skill Required

4 to 8 years of total IT experience with 2+ years in big data engineering and Microsoft Azure

• Experience in implementing Data Lake with technologies like Azure Data Factory (ADF), PySpark, Databricks, ADLS, Azure SQL Database

• A comprehensive foundation with working knowledge of Azure Full stack, Event Hub & Streaming Analytics.

• A passion for writing high-quality code and the code should be modular, scalable, and free of bugs (debugging skills in SQL, Python, or Scala/Java).

• Enthuse to collaborate with various stakeholders across the organization and take complete ownership of deliverables.

• Experience in using big data technologies like Hadoop, Spark, Databricks, Airflow, Kafka.

• Adept understanding of different file formats like Delta Lake, Avro, Parquet, JSON, and CSV. • Good knowledge of building and designing REST APIs with real-time experience working on Data Lake/Lakehouse projects.

• Experience in supporting BI and Data Science teams in consuming the data in a secure and governed manner.

• Certifications like Data Engineering on Microsoft Azure (DP-203) or Databricks Certified Developer (DE) are a valuable addition. 


Responsibilities:

As a Big Data Engineer (Azure), you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.

• Design and build scalable & metadata-driven data ingestion pipelines (For Batch and Streaming Datasets)

• Conceptualize and execute high-performance data processing for structured and unstructured data, and data harmonization.

• Schedule, orchestrate, and validate pipelines.

• Design exception handling and log monitoring for debugging

• Ideate with your peers to make tech stack and tools-related decisions.

• Interact and collaborate with multiple teams (Vendors/Consultants/Data Science & Dev team) and various stakeholders to meet deadlines, to bring Analytical Solutions to life.

• Should be able to understand complex architectures and be comfortable working with multiple teams.

• Delivery teams to build, automate, and deploy cloud solutions on Microsoft Azure • Monitor production, staging, test, and development environments for a myriad of applications in an agile and dynamic organization.

• Should be well-versed in Security Skills.

• Should have a Customer-Focused approach and understanding the problems.

• Proactiveness is must and self-driven.


Contact Details: 7339294355/hr1@kukulkan.in

About the company

KUKULKAN is recruitment and staffing solutions consultant based at Madurai, Tamilnadu. We are experts in this field with 13 years of experience, focusing on Southern India. We are your one stop solution for all manpower requirements , from entry level to executive search, Permanent and temp staffing, blue collar to contract labour, sales to service in Tamilnadu. We also provide candidates from Tam ...Show More

Industry

Staffing and Recruiting

Company Size

2-10 Employees

Headquarter

Madurai

expertiaLogo

Made with heart image from India for the World

Expertia AI Technologies Pvt. Ltd, Sector 1, HSR Layout,
Bangalore 560101
/landingPage/Linkedin.svg/landingPage/Twitter.svg/landingPage/Instagram.svg

© 2024 Expertia AI. Copyright and rights reserved

© 2024 Expertia AI. Copyright and rights reserved