Senior Data Engineer
- Posted 3 days ago
- Be among the first 10 applicants
Job Description
- Strong hands-on experience with Python, SQL, and PySpark.
- Strong understanding of unit testing, test automation, debugging, and code quality best practices.
- Good understanding of data engineering fundamentals and advanced concepts.
- Experience building scalable and fault-tolerant data pipelines.
- Strong knowledge of CI/CD, automated testing, and production deployments.
- Understanding of Medallion Architecture, data modeling, data quality, and governance.
- Awareness of cloud infrastructure, security, Infrastructure as Code, and monitoring.
- Strong problem-solving, communication, and collaboration skills.
- Ability to understand and confidently explain code, design decisions, and project architecture.
- Collaborate through code reviews, peer reviews, pair programming, knowledge sharing, and Agile best practices.
More Info
Key Skills
Production Deployments
Infrastructure as Code
Data Engineering Fundamentals
Medallion Architecture
Code Quality Best Practices
CI/CD
Scalable and Fault-Tolerant Data Pipelines
Cloud Infrastructure Security
About Company
Skills:
composer , BigQuery, PostgreSQL, Dataproc, Shell, Docker, Terraform, MySQL, Iam, Spark, DataFlow, Helm, Kubernetes, Python, GCP Data Engineering, Airflow, OLAP architectures, Cloud SQL, GCP Networking, Spanner
Skills:
data warehouses , Big Data Technologies, Data Modeling, ELT, Data Quality, Etl, data pipelines, data platforms, lakehouses, data integration solutions, data engineering standards, Compliance, data lakes, Security, Infrastructure-as-Code, data processing solutions, observability, streaming platforms
Skills:
Pyspark, Spark, Azure Databricks, Data Warehousing, Python, Data Mart architecture, Data Pipeline Optimization, Databricks Workflows
Skills:
Java, Regression Testing, Scala, Slas, ELT, Gcp, Distributed Systems, System Design, metrics, Azure, Python, Alerts, AWS, Etl, data quality checks, logs, data pipelines, pipeline observability, SLOs, tiered data architectures
Skills:
snowflake , BigQuery, PowerShell, Sql, Google Cloud, Nosql, MongoDB, Cosmos DB, Azure, Python, dbt, Data Vault 2.0