Python Developer Lead

Job Description:

We are seeking a highly skilled and experienced Senior Data Engineer with a strong background in API Integration, Python, and AWS. The ideal candidate will have a passion for data engineering and a proven track record of developing robust data pipelines and platforms.

Key Responsibilities:

• Develop and maintain ETL/ELT data pipelines and API integrations (Fast API preferred).
• Design and implement data platforms/products and data warehouses.
• Develop data-intensive solutions on AWS, Azure, or GCP for analytics workloads.
• Design both ETL/ELT processes for batch processing and data streaming architectures for real-time or near real-time data ingestion and processing.
• Work with various database technologies (e.g., MySQL, PostgreSQL, MongoDB) and data warehouses (e.g., Redshift, BigQuery, Snowflake).
• Utilize cloud-based data engineering technologies (e.g., Kafka, PubSub, Apache Airflow, Glue).
• Develop conceptual, logical, and physical data models using ERDs.
• Create dashboards and data visualizations using tools such as Tableau and Quicksight.

Qualifications:

• Bachelors degree in Computer Science, Data Science, or a related technical discipline.
• 7+ years of hands-on experience in data engineering.
• 4+ years of experience in developing data-intensive solutions on AWS, Azure, or GCP.
• 3+ years of experience in designing ETL/ELT processes and data streaming architectures.
• 3+ years of experience with database technologies and data warehouses.
• 5+ years of programming experience in Python.
• Proficiency in dashboard/BI and data visualization tools (e.g., Tableau, Quicksight).

Skills and Attributes:

• Thrives in dynamic, cross-functional team environments.
• Possesses a team-first mindset, valuing diverse perspectives and contributing to a collaborative work culture.
• Approaches challenges with a positive and can-do attitude.
• Willing to challenge the status quo and take appropriate risks to drive performance.
• A passionate problem solver with high learning agility.