Senior Data Engineer
Exp Level: 7+ Years
Location: Hyderabad
N.P: Immediate to 20 Days Max
Position Summary:
- Develop and maintain high-performance code based on SQL Server stack, including Stored Procedures, Views, Functions, and table design for transactional and analytic purposes.
- Develop and maintain Extract Transform Load jobs (ETL/ELT) and other data integrations with real-time streaming and API based sources.
- Develop new data solutions and migrate existing on-premise data solutions to cloud platforms including Azure Databricks and pyspark.
- Create Continuous Integration and Continuous Delivery (CI/CD) pipelines to automate delivery of solutions
- Provide support for data solutions, including remediation of failed ETL jobs, integrations and investigation of data quality issues.
- Data modeling for transactional and analytical platforms.
- Work directly with stakeholders to gather requirements and provide status updates and solution support
- Ensure data solutions meet or exceed enterprise regulatory and compliance requirements
Required Qualification:
- Bachelor's degree in business, computer science, computer engineering, electrical engineering, system analysis or a related field of study, or equivalent experience.
- 5+ years experience using Microsoft SQL Server
- 5+ years experience building data integrations leveraging ETL tools such as SSIS or Talend
- Familiarity with data integration patterns including ETL/ELT, event messaging and APIs
- Familiarity with database change capture tools including Change Tracking and Change Data Capture
- Familiarity with data modeling patterns
- Familiarity with Master Data Management concepts and platforms
- Familiarity with data product Software Development Lifecycle (SDLC)
- Excellent communications skills.
- Excellent analytical and technical skills.
- Excellent planning and organizational skills.
- The ability to work in a collaborative team environment