Job Title: Sr. Data Engineer

Location: Bangalore (Hybrid)

Experience: 5 + Years 

Notice Period: 0 to 30 Days

Job Description:

hashtag#Must-Have Skills 

1. Programming Languages Proficiency in Python for automating processes and supporting services. 

○ Shell scripting for task automation and system-level troubleshooting. 

2. ETL Tools ○Experience with ETL tools like Informatica Cloud. 

○Ability to manage and optimize data extraction, transformation, and loading (ETL) processes. 

3. SQL and Data Querying ○Strong SQL skills for querying data, creating custom checks, and monitoring services.

4. Data Pipeline Management 

○Experience managing and monitoring data pipelines in various environments (upstream, batch, streaming). ○Familiarity with pipeline orchestration tools like Luigi or Airflow. 

5. Operational Support and Troubleshooting 

○ Experience providing operational support, including troubleshooting and resolving incidents. 

6. Cloud Platforms and Data Environments 

○ Knowledge of cloud platforms like AWS, GCP, or Azure. 

○ Experience with OpenShift and Kubernetes environments. 

7. Monitoring and Automation Tools 

○ Proficiency in using Prometheus, Grafana, or similar tools for monitoring service health. 

○ Ability to set up monitoring dashboards and perform anomaly detection. 

8. Security and Access Management 

○ Knowledge of user access management, including account setup and permissions validation. 

9. Data Flow and System Dependencies 

○ Ability to understand and document data flows and dependencies between different data services. 

10. DevOps and Agile Practices 

○ Familiarity with DevOps principles and Agile environments. 

hashtag#Nice-to-Have Skills:

1. Collaboration and Communication 

○ Proficiency in using Google Docs and Jira for documentation and incident tracking. 

○ Strong communication skills for working with cross-functional teams. 

2. Incident Management and Optimization 

○ Experience in incident management and root cause analysis. 

○ Ability to identify and fix common failure points. 

3. Experience with Streaming Platforms 

○ Knowledge of Apache Kafka and experience with streaming services. 

4. Data Governance