Senior ETL Developer

Skills Required Senior ETL Developer

Mandatory Skills

• ETL Development (8+ Years) Strong experience in designing and implementing ETL pipelines.
• AWS Expertise (4+ Years) Proven experience in deploying and running data solutions using:
• Amazon S3
• AWS Lambda
• Amazon SNS
• AWS Step Functions
• PySpark Scripting Expertise in building scalable data processing pipelines using PySpark.
• Python Programming Hands-on experience with libraries like NumPy and Pandas for data manipulation.
• Cloud-based ETL Pipelines Building and optimizing workflows in a cloud environment (AWS).
• Individual Contributor Ability to take ownership of tasks with minimal supervision.
• Data Governance(Good to Have) Knowledge of metadata management, data lineage, and governance best practices.

Good to Have Skills

• Large-scale Data Transformation Handling both structured and semi-structured data formats.
• Data Lake & Delta Lake Experience in building and configuring Delta tables in Data Lake architecture.
• AWS Cost Optimization Familiarity with performance tuning and cost-efficient computing strategies.
• Data Integration Frameworks Ability to understand the use case and build end-to-end integration solutions.
• Airflow Orchestration (MWAA) Working experience with Apache Airflow via Amazon MWAA.

Soft Skills

• Effective Communication Strong interpersonal skills to engage with IT stakeholders and business teams.
• Analytical Mindset Ability to identify delivery pain points and provide strategic solutions.
• Self-driven and Proactive Capable of working independently with a focus on delivery excellence.