Big Data Engineering
Big Data Engineering
2
Applications
Noida
Full-Time
Mid-Level: 5 to 6 years
Posted on Apr 14 2025
About the Job
Skills
AWS
Spark Streaming
Hadoop
DataLake Management
Python Programming
AWS Lambda
AWS S3
Snowflake
- Bachelor's degree in computer science, or similar technical field
- Minimum 5 years of experience in Big Data Engineering/Data Analysis
Preferred Skills and Qualifications:
- Proficiency in Python, SQL and Apache Spark
- Strong Experience on Snowflake
- AWS services such as EMR, Glue (serverless architecture), S3, Athena, IAM, Lambda and CloudWatch
- Core Spark, Spark Streaming, DataFrame API, Data Set API, RDD APIs & Spark SQL programming dealing with processing terabytes of data
- Advanced SQL using Hive/Impala framework including SQL performance tuning
- Expertise in Hadoop, and other distributed computing frameworks
- ElasticSearch (OpenSearch) and Kibana Dashboards
- Resource management frameworks such as Yarn or Mesos.
- Physical table design in Big Data environment
- External job schedulers such as autosys, AWS data pipeline, airflow etc.
- Experience working in Key/Value data store such as Hbase
Data Analyst:
Skills, Experience and Requirements
- Minimum of 5 years of experience delivering data solutions on a variety of data warehousing platforms.
- Experience with SQL, Python and Excel in a business environment required
- 2+ years of experience with Tableau developing calculated fields
- Experience with data cleaning and blending multiple data sources using ETL tools
- Experience in cloud technologies (like AWS) and data analytics platforms (ex: Redshift and Snowflake)
- Experience in delivering of self-service analytics, insights, KPIs and metrics
- Experience building and maintaining data catalog with dictionary
- Experience with scheduling tools like Control-M or Airflow
- Strong understanding and experience with data warehousing concepts required
- Experience manipulating large datasets in a business environment required
- Experience translating data to actionable insights required
- Excellent facilitation skills; Strong desire to communicate in all settings
- Apply objective, analytical, and orderly thinking to the analysis of complex problems
- Embrace the Adventure; Willing to take risks, try innovative approaches, be adaptable to change, and learn from failures
- Demonstrate Curiosity; Strong desire to learn and add value to all aspects of the Dish business
Education and Experience:
- Bachelor's Degree with 5 years of experience in a relevant field such as Business operations, Analytics and Computer science; Master & Degree a plus
About the company
....
....
Industry
IT Services and IT Consul...
Company Size
11-50 Employees
Headquarter
mumbai