Job Description

Required Skills

Strong hands-on experience in data engineering, ETL/ELT development, and large-scale data pipeline design.
Experience with AWS Glue, PySpark, Python, SQL, and cloud-based data processing.
Strong experience working with Snowflake as a data warehouse or enterprise data platform.
Good understanding of usage-based billing, rating engines, invoice feeds, or financial data processing.
Experience building data quality checks, reconciliation frameworks, audit controls, and exception handling processes.
Hands-on experience with CI/CD tools such as GitHub Actions, GitLab CI, Jenkins, AWS Code Pipeline, or similar.
Strong SQL skills for data analysis, validation, troubleshooting, and performance optimization.
Experience working with batch and event-driven data ingestion patterns.
Understanding of data modelling, partitioning, performance tuning, and cost optimization