Azure/SQL/Application - Data Engineer
Job description:
- Responsible to maintain the data required for managed application like Advanced Planning System, Dealer Management System, etc.,
- Responsible for user access management on data upload and download
- Working with functional team to manage the required data in a structured manner
- Make use of Azure services like Data Factory, Data Lake, Machine Learning, SQL Warehouse, Data Bricks for data extraction.
- Building real-time data pipelines from on-prem SAP DB to cloud along with required API.
- Python model development and continuous improvement through containerization. Conduct basic exploratory analytics for insights.
- Working with Azure SQL databases and NoSQL Databases (Azure Cosmos DB) for data management
Desired candidate education and experience:
- A minimum of 2-3 years of experience in Data engineering and migration
- Graduation/ Post graduation or equivalent. BE CS / B. Tech IT/ MCA preferred
- SQL knowledge to create complex queries.
- Experience in working with relational databases, Time-series Database as well as working familiarity with a variety of databases (structured & Unstructured).
- Good experience in object-oriented programming in python and using python tools such as PySpark, NumPY, TensorFlow and Jupyter etc.
- Experience in API creation.
- Performance Monitoring & Troubleshooting Azure data pipeline performance, identify bottlenecks, and troubleshoot complex issues in production environments.
- Hands on Experience in working on Kafka.
- Knowledge on continuous integration/continuous deployment.
- Experience of data migration and deployment from On-Prem to Cloud environment and vice-versa.
- Ability to identify problems, mediate issues, develop solutions, and implement appropriate courses of action.
- Good oral and written English communication skills
Role: Data Engineer
Department: Digital Technology
Employment Type: Full Time
