Senior Data Engineer
- Posted 24 minutes ago
- Be among the first 10 applicants
Job Description
Job Description
6+ years in data engineering. Strong data architecture and system design skills to make sound tradeoffs on modeling, partitioning, and scalability, not just write queries. Demonstrated end-to-end production ownership of data pipelines from design through deployment, monitoring, and operational support. Expert-level Python + SQL as the primary toolset. Hive/Hadoop is a nice-to-have only. Robust data quality and auditability practices - validation, reconciliation, anomaly detection, audit trails. Experience working with finance, risk, or compliance data - comfort with the heightened accuracy, auditability, and data-lineage requirements typical of these domains. Proven experience designing and building transaction/fact tables.
Required Skills
Primary Skills
911PythonHiveHadoopETL
Secondary Skills
snowflakesAzure
6+ years in data engineering. Strong data architecture and system design skills to make sound tradeoffs on modeling, partitioning, and scalability, not just write queries. Demonstrated end-to-end production ownership of data pipelines from design through deployment, monitoring, and operational support. Expert-level Python + SQL as the primary toolset. Hive/Hadoop is a nice-to-have only. Robust data quality and auditability practices - validation, reconciliation, anomaly detection, audit trails. Experience working with finance, risk, or compliance data - comfort with the heightened accuracy, auditability, and data-lineage requirements typical of these domains. Proven experience designing and building transaction/fact tables.
Required Skills
Primary Skills
911PythonHiveHadoopETL
Secondary Skills
snowflakesAzure
More Info
About Company
Skills:
BigQuery, Apache Flink, Pyspark, Kafka, Sql, Hive, Spark, Python, Apache Iceberg, dbt, Delta Lake, Apache Hudi
Skills:
snowflake , Github, Data Modeling, Buildkite, Cloudformation, Sql, Apache Airflow, Jenkins, Git, Terraform, Data Warehousing, Python, Azure DevOps, Infrastructure as Code, AWS Cloud Services, CI/CD Pipelines, GitHub Actions, dbt, AWS IAM Security and Monitoring
Skills:
redgate , RDS, Cloudformation, Performance Tuning, PowerShell, Prometheus, SQL Server, Bash, Datadog, Redshift, Sql, Data Replication, Security Controls, Terraform, Python, AWS, auditing mechanisms, NoSQL databases, Aurora, partitioning, CosmosDB, high-availability configurations
Skills:
snowflake , Nosql, Pyspark, Gcp, Data Modeling, Data Lake, Sql, AWS, data schemas, data visualization techniques
Skills:
Orchestration, BigQuery, Apis, Python, Sql, infrastructure-as-code, dbt, data observability