Search Jobs

Search by job, company or skills

Senior Data Engineer

Senior Data Engineer

playvista
Fresher
  • Posted 9 hours ago
  • Be among the first 10 applicants

Job Description

About the role

Vurtech is hiring a Senior Data Engineer to own the production data platform. You will run pipelines on AWS, write the Airflow DAGs that schedule them, keep the data warehouse and databases in shape, and connect the platform to APIs and Kafka.

Responsibilities

Pipelines and orchestration
- Design, build, and operate data pipelines on AWS
- Write and maintain Airflow DAGs: schedules, dependencies, retries, and recovery
- Keep pipelines healthy: failures, backfills, data quality, and changes that have to land safely

Data warehouse and databases
- Model, load, and maintain the data warehouse
- Manage the databases those pipelines read and write, including schema changes, performance, and day-to-day upkeep
- Write the SQL that those models and operational queries depend on

Integrations
- Build and maintain API integrations that feed and serve the pipelines
- Work with Kafka for event and streaming flows

How you work
- Write production Python that other engineers can run and change
- Pick up unfamiliar parts of the stack quickly and take a problem through to a working result

What you bring

- Senior-level experience owning data pipelines in production
- Hands-on Airflow, including writing DAGs
- Experience modeling a data warehouse and managing databases day to day, including SQL
- Strong Python and SQL
- Hands-on AWS for running data workloads
- Real experience with APIs and with Kafka
- A fast learning pace and a can-do approach: you figure out the system in front of you and get the work done

How we hire

A short written application, then a practical conversation about pipelines, Airflow DAGs, the data warehouse, databases, AWS, Kafka, and APIs you have actually run. We care more about what you have shipped and how you debug it than about a long tool list.

Compensation and location

Full-time. Remote. Based in India. Competitive salary.

More Info

Job Type:
Industry:
Employment Type:

Key Skills

About Company

Similar Jobs

Hyderabad, India
Skills:
Apis, Data Modeling, Analytics Solutions, data pipelines, data engineering solutions, cloud platforms, design documentation, technical solution architecture
Noida, India
Skills:
snowflake , Apache Airflow, Pyspark, Amazon Kinesis, Apache Kafka, Delta Lake on Databricks, Databricks Workflows
Delhi, India
Skills:
Data Management, Pyspark, SQL Server, Data Lake, Databricks, Microsoft Azure, Python, DevOps pipelines, business intelligence architecture, Event Hub, dashboard creation
Noida, India
Skills:
Github, Aws Redshift, Pyspark, Amazon Kinesis, Apache Spark, Dynamodb, AWS Glue, Sql, Apache Kafka, Python, Aws S3, Amazon Aurora, Delta Lake on Databricks, Data Governance Frameworks, Databricks Workflows
India
Skills:
data wrangling , snowflake , Data Modelling, Kafka, Informatica, Data Visualisation, Pandas, Spark, Python, Airflow, AWS Step Functions, Statistics, ETL processes, Data ingestion pipelines