Sr Azure Data Engineer
Job Description
- 4-8 Years of experience as data engineer preferably from data science groups
- Analyse, organize, segment and disseminate raw or unprocessed data based on business needs.
- Be the key anchor for data extraction, preparation and hosting processes.
- Create master data files from disparate data sources by building data pipelines.
- Develop and test architecture for data extraction.
- Provide continuous connectivity to a master data source and access to refreshed data
- Ensure data quality and reliability
- Data expert for datasets used by data scientists
- Able to understand the basic requirements of data science methodologies to collaborate with data scientists
- Hands on experience on all Azure Services primarily Data lake, ADF pipelines, Data Bricks, Azure Functions, Azure SQL, Synapse, Azure Data Explorer.
- Should have implemented Master Data Management and CI/CD Pipelines.
Technical Role and Responsibilities
- Advanced SQL RDBMS design and query building skills (Oracle, SQL Server, Redshift, etc.)
- Having knowledge of NOSQL databases is preferable
- Sound knowledge of standard ETL practices and building data processing pipelines
- Experience profiling, manipulating, and merging massive data set using Big Data technologies, preferably spark in Data Bricks on Azure.
- Visualization tool experience, especially with Power BI and Tableau as added advantage
- Attention to detail and logical based thinking in building, testing, and reviewing data pipelines containing multi-disciplinary information
- Commitment to build using established coding and naming standards
- Coding experience with data connecters for different systems like Talend, SAP data services and etc
Education
- Required to have B.Tech. or B.E. preferably in Computer Science or Engineering from reputed institutes
Certifications [preferable to have one from below]
- Data Engineering from Top Institutes or Azure
- Cloud Certifications from Top Institutes or AWS or Azure
