Bangalore
Hyderabad
Pune
Hybrid
Full-Time
Mid-Level: 3 to 8 years
Posted on Mar 11 2025

About the Job

Skills

Python
SQL
aws
azure
PySpark
Data Structures

We are seeking a skilled and motivated Data Engineer with experience in Python, SQL, Azure, and cloud-based technologies to join our dynamic team. The ideal candidate will have a solid background in building and optimizing data pipelines, working with cloud platforms, and leveraging modern data engineering tools like Airflow, PySpark, and Azure Data Engineering. If you are passionate about data and looking for an opportunity to work on cutting-edge technologies, this role is for you


Key Responsibilities:

  • Design, develop, and optimize data pipelines using Python, SQL, and PySpark.
  • Collaborate with cross-functional teams to gather and understand data requirements.
  • Implement and maintain data workflows using Apache Airflow and Azure Data Factory.
  • Design and implement cloud-based data solutions in Microsoft Azure, ensuring scalability, performance, and security.
  • Write efficient, scalable, and reusable Python code for data processing tasks.
  • Work with large datasets, ensuring data is transformed, stored, and processed effectively.
  • Utilize Azure services such as Azure Data Lake, Azure SQL Database, Azure Synapse, and Azure Databricks to build robust data solutions.
  • Troubleshoot and resolve any issues with data pipelines and data flow across systems.
  • Ensure high-quality standards for data management, integrity, and security.
  • Stay up-to-date with the latest data engineering trends and technologies in the Azure cloud environment.


Key Skills & Qualifications:

  • Experience: 3-7 years of experience as a Data Engineer or related role.
  • Programming: Proficiency in Python for data processing and automation tasks.
  • SQL: Strong experience writing complex SQL queries for data manipulation and analysis.
  • Cloud Technologies: Experience with Azure Cloud and services like Azure Data Lake, Azure SQL Database, Azure Synapse, Azure Databricks.
  • Data Engineering Tools: Hands-on experience with Apache Airflow for orchestrating workflows and scheduling tasks.
  • Big Data: Familiarity with PySpark for distributed data processing.
  • Problem Solving: Strong analytical skills and the ability to troubleshoot data engineering challenges.
  • Collaboration: Excellent communication skills and ability to work effectively in a team-oriented environment.


About the company

Being one of the top staffing consultancy firms in Bangalore, VidPro provides manpower solutions to both IT and non-IT sectors. We have a track record of sourcing top talent for several startups PAN India and ensuring exceptional customer experience of all our clients. Our mission is to support our clients business objectives through continuous talent enhancement and skill augmentation. Our vision ...Show More

Industry

Human Resources Services

Company Size

11-50 Employees

Headquarter

Bengaluru

Other open jobs from VidPro Consultancy Services