Search Jobs

Search by job, company or skills

Sr Data Engineer

Sr Data Engineer

Dynatrace
Early Applicant
  • Posted 10 hours ago
  • Be among the first 10 applicants

Job Description

Your role at Dynatrace

We are seeking an experienced Data Engineer to design, build, and optimize scalable data ingestion pipelines for product telemetry and enterprise business applications data. This role operates in a fast‑paced environment, rapidly prototyping data pipelines to enable data exploration, analytics, and downstream consumption.

Responsibilities

  • Design and implement modern data ingestion pipelines for business systems data using Fivetran, Python and Bulk APIs, S3-based lakehouse architectures, and streaming ingestion (Kafka, Spark)
  • Build end-to-end automated pipelines from source systems to Snowflake, ensuring reliability, scalability, and observability
  • Apply advanced SQL in Snowflake for transformation, standardization, and preparation of analytics-ready datasets
  • Optimize ingestion performance for large-scale, high-volume datasets using API rate-limit handling, micro-batching, and incremental loading / CDC
  • Implement DevOps and CI/CD practices for data pipelines, including version control and deployment automation
  • Partner with analysts, SMEs, and platform teams to rapidly prototype pipelines supporting exploration and evolving requirements
  • Monitor, troubleshoot, and optimize ingestion jobs to ensure data freshness, accuracy, and performance

What Will Help You Succeed

  • 6+ years of hands-on experience in data engineering and ingestion automation in cloud or hybrid environments
  • Proven experience ingesting business application data (CRM, ERP, financial, consumption, renewals systems)
  • Advanced proficiency with Python and Fivetran (or similar ETL/ELT tool) for pipelines, automation, orchestration, and validation
  • Expertise with Kafka, Spark, and S3 / lakehouse-style storage architectures
  • Strong proficiency with Snowflake, ingestion, transformation, and performance optimization
  • Deep understanding of ingestion optimization, rate limits, micro-batching, incremental loads, and CDC
  • Experience applying DevOps / CI/CD practices to data pipelines
  • Ability to work independently and deliver solutions rapidly in a fast-paced, iterative environment

Desirable

  • Experience with additional open-source ingestion frameworks and connectors
  • Exposure to event-driven or telemetry-heavy architectures at scale

Why you will love being a Dynatracer

  • Dynatrace is a leader in unified observability and security.
  • We provide a culture of excellence with competitive compensation packages designed to recognize and reward performance.
  • Our employees work with the largest cloud providers, including AWS, Microsoft, and Google Cloud, and other leading partners worldwide to create strategic alliances.
  • You'll get to work at the forefront of innovation with Dynatrace Intelligence, the industry's first agentic operations system. Bringing together deterministic and agentic AI, it helps teams understand what's happening, why it matters, and what to do next, automatically.
  • Over 50% of the Fortune 100 companies are current customers of Dynatrace

More Info

Job Type:
Industry:
Employment Type:

Key Skills

deployment automation

micro-batching

incremental loading

S3-based lakehouse architectures

CI/CD

API rate-limit handling

About Company

Similar Jobs

7-9 yrs
Bengaluru, India
Skills:
Nosql, Java, Lambda, Ec2, Scala, Dynamodb, Elastic Search, Nodejs, Python, Sql, AWS
10-12 yrs
Bengaluru, India
Skills:
snowflake , Spark SQL, Pyspark, Sql, ELT, Apache Airflow, Databricks, Rest Apis, Azure, Python, Etl, Delta Live Tables, Unity Catalog, Delta Lake, Databricks Workflows
5-7 yrs
Bengaluru, India
Skills:
Metadata Management, Data Lineage, Power Bi, Data Warehousing, Automated Testing, Sql, ELT, Gcp, Data Governance, Data Integration, Python, Etl, Source Control, Codex, Claude, Google BigQuery, data cataloging, medallion architecture
6-8 yrs
Bengaluru, India
Skills:
Unix, Prometheus, Grafana, Apache Airflow, JUnit, Neo4j, Docker, Hadoop Hdfs, Python, Spark SQL, Oracle Sql Server, Pytest, Apache Flink, Sql, Jenkins, Git, Hive, Linux, Apache Kafka, Spark, Kubernetes, JanusGraph, GitHub Actions, Iceberg, Real-Time and Batch Data Processing, Graph query languages
6-8 yrs
Bengaluru, India
Skills:
snowflake , AWS Glue, Informatica, Etl Tools, Sql, Azure Data Factory, Databricks, Data Warehousing, Star Schema, Redshift, Matillion, MS Fabric, DevOps practices, Dimensional modelling, Performance tuning and optimisation, Data governance compliance and security practices, CI/CD tools, GCP data services, Distributed data systems, Data modelling techniques, AI/ML data pipelines, Data integration APIs