Lead Software Engineer

Roles & Responsibilities

• Design and implement ETL processes to extract, transform, and load data from various sources.
• Conduct research and perform proof of concept (POC) activities
• Continuosly learn and master new technologies
• Use vibe coding tools to improved development velocity
• Collaborate with cross-functional teams to understand data requirements and deliver solutions.
• Optimize and maintain existing ETL workflows for improved efficiency and performance.
• Ensure data integrity and quality through rigorous testing and validation.
• Create and implement best practices to ensure successful delivery and support of large data transformation layer.
• Collaborate with other team members to ensure timely and successful delivery of production ready applications.
• Prepare detailed technical documentation.

Qualifications

Required Experience & Education:

• 5 - 8 years of relevant ETL development.
• Hands-on experience with building data integration solutions.
• Experience with both NOSql and Relational Database Development – e.g. Mongo, Postgres, Teradata, SQL Server required.
• Experience with Data Warehouse, Data Lake, and Lake House technologies
• Strong understanding of database concepts and experience with query optimization and performance tuning.
• Hands-on experience with scripting languages like Python.
• Hands on experience with Databricks and Airflow monitoring.
• Excellent problem-solving skills and the ability to analyze complex issues and implement effective solutions.

Required Skills:

• Python, Databricks, DevOps, Basic Cloud Experience (AWS/Azure)

Preferred Skills, Experience & Education:

• Cloud Certification (AWS Developer Associate or similar)