Senior Software Engineer (Data)

Job Description

Responsibilities

• Design and Development of cloud-based microservices to collect data
• Design and Development of REST API to serve Data as a Service
• Design and Development of Data Quality framework to enable automated data quality checks across data pipelines
• Write efficient, maintainable, and reusable code in at least one programming language (e.g., Java, Python, GoLang, GoSu, etc).
• Responsible for developing and maintaining CI/CD pipelines
• Maintain and stabilize existing data pipelines and infrastructure to provide timely, quality and accurate data
• Analysis, Performance Improvement, Development, Deployment and Contribute to overall product requirements
• Perform code review and develop best coding practices
• Indulge in brainstorming sessions to help team gain technical knowledge and grow equally
• Define release process improvements along with management of pipeline changes
• Collaborate with peer teams and support each other s on deliverables

Qualification

• Bachelor s or Master s degree in Computer Science or equivalent industry technical skills
• 8+ years of professional development experience
• Proven lead experience and a strong understanding of the Software Development Life Cycle (SDLC) process
• In-depth knowledge on strong experience in any one of the Python, Java, GoLang, C, etc programming language and should be an expert in Object Oriented Programming
• Strong experience in AWS service - Glue, Athena, Iceberg, MWAA(Airflow), EC2, ECS, Lambda, StepFunction, S3, SQS preferred. Experience in other AWS services are added advantage
• Expertise in both SQL and NoSQL databases. Experience in Postgres, Redshift, MongoDB and DynamoDB are preferred
• Experience in Linux and Shell scripting preferred
• Experience in Docker, Kubernetes, or MicroService preferred
• Experience in Airflow and Jenkins preferred
• Experience in FAST API, Flask Framework, SQL alchemy are preferred
• Expertise in version control tools Git, Bitbucket preferred
• Experience in creating and implementing a strong data quality system that checks data accuracy at every step, backed by thorough monitoring and observability features