Lead Data Engineer
Lead Data Engineer
anko gccThis job is no longer accepting applications
Job Description
Brighter futures start here
At Anko you'll be joining a diverse team who come together to collaborate globally around tech. We are an innovation hub which power and support our retail brands. You'll feel the impacts of the work you'll do for our millions of customers and team members every day. Our brands are focused on being customer-led, digitally enabled retailers, providing you with challenging and rewarding work that you will be proud of.
Join our team, choose your own path and work on projects that excite you.
Technical Skills
7- 10 years to total IT experience preferably in field of data engineering
At Anko you'll be joining a diverse team who come together to collaborate globally around tech. We are an innovation hub which power and support our retail brands. You'll feel the impacts of the work you'll do for our millions of customers and team members every day. Our brands are focused on being customer-led, digitally enabled retailers, providing you with challenging and rewarding work that you will be proud of.
Join our team, choose your own path and work on projects that excite you.
At Anko you'll be joining a diverse team who come together to collaborate globally around tech. We are an innovation hub which power and support our retail brands. You'll feel the impacts of the work you'll do for our millions of customers and team members every day. Our brands are focused on being customer-led, digitally enabled retailers, providing you with challenging and rewarding work that you will be proud of.
Join our team, choose your own path and work on projects that excite you.
Technical Skills
- AWS – S3, IAM, API Gateway, EKS, EC2, EMR, Lambda, Cloud formation etc.,
- SQL – snowflake or other cloud data warehouse solutions, Oracle, MS SQL server
- Python, Java, Scala
- Kafka, Kafka streams, KSQL DB, Kafka connect preferably confluent kafka
- Docker, Kubernetes, Jenkins, Airflow
- Power BI
7- 10 years to total IT experience preferably in field of data engineering
- 5+ years experience with AWS services including Lambda,IAM,API gateway
- 4+ years experience in creating and deploying dockor containers on Kubernetes
- 4+ years experience in supporting development teams on Kubernetes best practices, troubleshooting, and performance optimization.
- 4+ years experience with CI/CD pipelines toll such as Jenkins and Github Actions
- 4+ years experience with Snowflake data warehousing and data lake solutions
- Strong programming skill in Python, Java or Scala
- 4+ years of experience in scripting and automation using languages such as Bash, Python, or GO
- 4+ years of experience with infrastructure-as-code tools such as Terraform, Ansible, or CloudFormation and containerization technologies (e.g., Docker, Kubernetes).
- Knowledge of Agile methodologies and software development lifecycle processes
- Basic understanding of AI / Agentic AI/ Gen AI
At Anko you'll be joining a diverse team who come together to collaborate globally around tech. We are an innovation hub which power and support our retail brands. You'll feel the impacts of the work you'll do for our millions of customers and team members every day. Our brands are focused on being customer-led, digitally enabled retailers, providing you with challenging and rewarding work that you will be proud of.
Join our team, choose your own path and work on projects that excite you.
More Info
About Company
Skills:
Orchestration, S3, Metadata Management, Pyspark, PostgreSQL, Automated Testing, Data Modeling, Lambda, Advanced Sql, Python, RDS, release management, Dynamodb, SQL Server, Redshift, Data Quality, ECS, transformation standards, CI CD, AWS data services, ETL best practices, data cataloging, Step Functions, Monitoring, large-scale data processing, Glue
Skills:
Pyspark, Scala, Apache Spark, Kafka, Oracle Goldengate, Jenkins, Terraform, Python, Airflow, Google BigQuery, Cloud Composer, GitHub Actions
Skills:
Sql, ETL ELT fundamentals and best practices, CI CD pipelines for data deployments, Snowflake data warehousing including Time Travel and Fail Safe features, AWS services such as S3 Lambda Secret Manager IAM and CloudWatch, Configuration of monitoring alerting and data quality checks in cloud data platforms, Administration of Snowflake warehouses databases schemas and role-based security, dbt models macros and tests, Python for data engineering and automation
Skills:
Git, Gcp, Scala, Apache Spark, Apache Kafka, Databricks, Python, Spark Structured Streaming, Cloud SQL
Skills:
snowflake , Data Lineage, Pyspark, Apache Spark, Sql, ELT, Data Quality, Goldengate, Data Lake, Databricks, Data Governance, Python, AWS, Etl, AWS DMS, Data Pipelines, Lakehouse, Observability