Data Ops Lead Software Engineer

Responsibilities:

• Design, develop, and maintain backend services and APIs in Python to enable self-service pipeline creation, orchestration, and monitoring.
• Build frontend features (e.g., dashboards, forms, monitoring views) that help customers easily design and manage data pipelines.
• Develop frameworks, templates, and tooling using AWS services (Glue, Lambda, Step Functions) to support scalable, secure ETL/ELT workflows.
• Integrate AWS services (S3, Glue, IAM) to deliver secure and reliable data movement and cataloging.
• Implement robust monitoring, validation, and alerting features to ensure data quality, integrity, and lineage across customer pipelines.
• Enable connectivity and integrations with external systems such as Snowflake, Azure, and SAP.
• Collaborate closely with UX designers and other engineers to deliver intuitive, well-documented user experiences.
• Participate in architecture discussions, sprint planning, code reviews, and CI/CD workflows.

What should you bring along

Requirements:

• Strong experience with Python for backend development, ideally in a cloud-native, serverless context.
• Proficiency with frontend development in frameworks such as React, Vue, or Angular.
• Solid understanding of AWS services (Glue, S3, Lambda, IAM, Step Functions) and their use in data workflows.
• Experience designing and consuming REST APIs.
• Familiarity with data engineering concepts like data modeling, schema evolution, and partitioning strategies for large-scale storage.
• Proven ability to build shared tools, libraries, or frameworks that enable other engineers or customers to work more effectively.
• Commitment to writing well-tested, maintainable code, with experience in unit and integration testing.
• Familiarity with version control (Git) and CI/CD best practices.
• Strong communication skills and a collaborative, customer-focused mindset.

Must have technical skills

• Python, ideally in a cloud-native, serverless context
• React, Vue, or Angular
• AWS services Glue, S3, Lambda, IAM, Step Functions
• REST APIs
• Data engineering concepts like data modeling, schema evolution, and partitioning strategies
• GitHub

Good to have technical skills

• Experience integrating with Snowflake, Azure, or SAP systems.
• Familiarity with Glue Data Catalog, AWS Secrets Manager, or other security best practices.
• Experience building data quality monitoring dashboards or developer tooling for pipeline management.
• Experience with Infrastructure as Code tools such as Terraform for managing AWS resources