We are looking for
Data Engineers!
Salary: INR 10,00,000 - 12,00,000 / year
Responsibilities
- Transform and process source data into data products and enable egression to other platforms
- Develop efficient Data Lake frameworks using Scala, PySpark, or Python, with robust data quality and security controls.
- Create reusable libraries and config driven pipelines for enterprise wide ingestion and integration
- Ensure compliance with data governance and security standards using tools like AWS DataZone, Lake Formation, AWS Glue and MWAA
Eligibility
- This is an entry-level job
- Experience with CI/CD tools such as GitHub, GitHub Actions, ArgoCD, and automated deployment pipelines.
- Demonstrable in Python, SQL, Spark, and Scala for distributed data processing.
- Performance tuning of ETL jobs and query optimisation for cost efficiency
- Demonstrable experience with AWS Glue, Lambda, Redshift, Athena, Kinesis, and EMR
(*Note: This is a requirement for one of Scoutit's clients)
Skills: aws,python,sql
