
Search by job, company or skills
Design, build, and maintain reliable data pipelines and data-processing workflows.
Integrate data from APIs, databases, enterprise applications, cloud services, files, and other source systems.
Develop scalable solutions for data ingestion, transformation, storage, processing, and serving.
Support data platforms operating across cloud, on-premise, or hybrid environments.
Implement appropriate monitoring, data-quality checks, error handling, and operational controls.
Automate deployment and operational processes using CI/CD and Infrastructure as Code where applicable.
Support production systems, troubleshoot issues, and contribute to root-cause analysis and continuous improvements.
Work closely with application, infrastructure, platform, security, and business teams to deliver reliable data solutions.
Maintain relevant technical documentation, operational procedures, and engineering standards.
Around 4-7 years or more of relevant experience in Data Engineering, Cloud Engineering, Platform Engineering, DevOps, SRE, or a related technical discipline.
Hands-on experience designing, building, or operating production-grade data solutions.
Experience with cloud platforms such as AWS and/or Azure.
Experience with some of the following areas:
Python and SQL
ETL / ELT and data pipelines
Batch, streaming, CDC, or event-driven processing
Data modelling and data quality
Cloud data platforms and services
Logging, monitoring, telemetry, or observability
CI/CD and Infrastructure as Code
Docker or containerised environments
Good understanding of software engineering practices, system reliability, scalability, security, and production support.
Strong problem-solving skills and the ability to work across technical teams.
Experience working across on-premise and cloud environments.
Experience with streaming or messaging technologies such as Kafka or MQ.
Experience with Terraform, Ansible, or equivalent automation tools.
Familiarity with observability or monitoring platforms such as Grafana, Prometheus, Dynatrace, Elastic, or equivalent.
Experience working in large-scale enterprise or Government environments.
AWS or Azure certifications.
Job ID: 153614571
Skills:
Apache Spark, Data Integration, Data Modelling, Data Transformation, Etl Development, elastic search/open search, python/scala
Skills:
snowflake , Hadoop, Microsoft Power Bi, Tableau, Data Integration, Google Cloud, Hive, Hue, Data Architecture, Data Lake, Databricks, Azure, Talend, Python, AWS, Etl, Alibaba Cloud
Skills:
data warehouses , snowflake , Java, Data Warehouse Concepts, Scala, Dimensional Modeling, Sql, Data Lake, Python, Airflow, dbt-core, Big Data processing frameworks, SCDs, lake house, data mesh, modern data warehouse
Skills:
snowflake , BigQuery, Postgres, FastAPI, Python, Sql, Airflow, Dagster, Anthropic APIs, Prefect
Skills:
BigQuery, Aws Redshift, Hadoop, Pyspark, Kafka, AWS Athena, Sql, Nosql, Gcp, MySQL, Spark, Sns, Data Lake, Python, AWS, Aws S3, Etl, Apache Iceberg, Parquet, Airflow, AWS MSK, Firehose