Search by job, company or skills

Senior Data Engineer

Senior Data Engineer

Otis
Quick Apply
  • Posted 3 months ago
  • Over 200 applicants have applied

Job Description

Years Of Experience: 5 - 8 Years

Role Overview: As a Senior Data Engineer you will be working in end to end development of scalable Big Data pipelines and Data streams and manage various data related objectives such as system configuration and integration on multiple platforms

On a typical day you will:

  • As a Data Engineer you will be working with one of the largest and most complex warehouse environments
  • Coordinate with key stakeholders and ensure effective design, development, validation in line with the stakeholder needs and architectural requirements
  • End to end development of scalable Big Data pipelines and Data streams
  • Manage various data related objectives such as system configuration and integration on multiple platforms
  • Develop key metrics for tests on data and ensure integrity of same on data architecture
  • Adhere to proper documentation based on each of the development activities
  • Work with huge data sets and exhibit problem solving, analytical and communication abilities
  • Will be working in a self-directed environment, take up responsibilities and drive them to completion

What you will Need to be Successful:

  • Problem solving, analytical and good communication abilities
  • Years of development experience with Azure Cloud and Big Data Analytic solutions
  • Hands on experience in Azure - Data Factory, Data Lake store/Blob storage, SQL DB
  • Experience in creating Big data Pipelines with Azure components
  • Good programming skills in Java, Scala or Python
  • SQL experience writing stored procedures, tuning indexes and troubleshooting performance bottlenecks
  • Advanced experience with Data Warehousing concepts and standards
  • Experience with ETL processing or ETL toolset
  • Data Management concepts and standards (SQL Server, Oracle, Cloud, Hadoop, etc.)
  • Experience with Big Data Solutions. Hive, Spark or other frameworks
  • Experience across cloud implementations and Solutions specially Microsoft Azure
  • Exposure to large databases, BI applications, data quality and performance tuning.
  • Practical knowledge of Linux or Unix, a plus
  • Experience in Snowflake (cloud data warehouse), a plus
  • Experience with MS Dynamics data integration and development, a plus
  • Experience with Oracle - JDE ERP, a plus

Role: Data Engineer

Industry Type: Financial Services

Department: Data Science & Analytics

Employment Type: Full Time, Permanent

Role Category: Data Science & Machine Learning

Education

UG: Any Graduate

PG: Any Postgraduate

More Info

Job Type:
Function:
Employment Type:

About Company

At Otis, we are dedicated to connecting you to the people and places that matter. For over 160 years, we've continually reinvented the way our passengers move through the urban world with industry-leading elevators, escalators and moving walkways.

Similar Jobs

7-9 yrs
Bengaluru, India
Skills:
Pyspark, AWS Glue, Data Modeling, Emr, Avro, Autosys, Sql, Cloudwatch, Terraform, Etl Tools, Databricks, Python, AWS, Airflow, Parquet, AWS Lake Formation, Iceberg
5-10 yrs
Bengaluru, India
Skills:
Power Bi, Pyspark, Agile Scrum, Tableau, Databases, Git, Data Warehousing, Informatica Powercenter, Python, Airflow, Data Lake concepts, Advanced SQL and performance tuning, IICS, dbt, CI/CD
6-10 yrs
Bengaluru, India
Skills:
BigQuery, Apache Flink, Pyspark, Kafka, Sql, Hive, Spark, Python, Apache Iceberg, dbt, Delta Lake, Apache Hudi
5-7 yrs
Hyderabad, India
Skills:
Orchestration, Java, Power Bi, Performance Tuning, Scala, Kafka, Dimensional Modeling, Sql, Spark, Python, Flink, CI CD, Beam, incremental processing, access controls, Cube.dev, data-quality testing, data partitioning, Production Monitoring
8-12 yrs
Bengaluru, India
Skills:
snowflake , Github, Data Modeling, Buildkite, Cloudformation, Sql, Apache Airflow, Jenkins, Git, Terraform, Data Warehousing, Python, Azure DevOps, Infrastructure as Code, AWS Cloud Services, CI/CD Pipelines, GitHub Actions, dbt, AWS IAM Security and Monitoring