- Senior Data Engineer- 9-12 years, Team Mentoring required
- Data Engineer- 6-9 years, IC role
Must have skills:
Databricks
Python/Pysaprk
Development Side Experience
Required Qualification:
- Bachelor's degree in Computer Science, CIS, or related field and Minimum 8 years ofexperience in software development or a related field. Additional equivalent work experience may be substituted for the degree requirement
- 3 years in using Azure Data Factory for data ingestion, transformation, and orchestration.
- 3 years with the Azure ecosystem, including services like Azure Data Lake Storage, Azure Blob Storage, and Azure SQL Database
- 3 years of software development lifecycle, agile methodologies, CI/CD, and version control systems (e.g., Git).
- Understanding of data governance principles, data quality, and security best practices
- 3 years in designing and developing ETL processes using Informatica IICS. Experience with Informatica Intelligent Cloud Services, including its CAI (Cloud Application Integration) and CDI (Cloud Data Integration) modules.
- 3 years in Python in developing and debugging code, with a focus on data manipulation and processing.
- 3 years Hands-on experience with Databricks platform, including Delta Lake and Lakehouse architecture.
- 3 years of experience with data structures, data modeling, ETL/ELT concepts, and data warehousing principles.
- 3 years of experience with SQL skills for data querying and manipulation.
