Infrastructure Engineering Advisor

• Design and implement data integration solutions using tools such as Apache Airflow, Informatica, Python, and Snowflake.
• Develop and maintain ETL processes to ensure data is accurately and efficiently loaded into the data warehouse.
• Develop error handling, alerting, monitoring, and testing processes into data pipelines.
• Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs.
• Manage and optimize data pipelines for performance and scalability.
• Implement and manage DevOps practices in the Data Engineering environment, including version control with BitBucket and continuous integration/continuous deployment (CI/CD) with Jenkins.
• Develop and manage branching strategies to support multiple development streams.
• Ensure data quality and integrity through rigorous testing and validation.
• Work with databases and SQL to extract, transform, and load data.
• Integrate data from various APIs into the data warehouse and other data platforms.
• Participate in Agile development processes, including sprint planning, daily stand-ups, and retrospectives.
• Use Jira for task management and tracking progress.
• Be available for occasional on-call night/weekend support.

Qualifications

Required Skills:

• Strong python and SQL skills
• Experience building data pipelines in python
• Familiarity with one of the following technologies- JAVA, C#.NET
• Experience with extracting data from Rest APIs and ingesting it to a cloud data warehouse
• Experience working with S3 buckets and writing DAGs on Airflow
• Experience programmatically working with any cloud data warehouse
• Strong written and verbal communication skills with the ability to interact with all levels of the organization
• Strong interpersonal/relationship management skills.
• Strong time and project management skills
• Familiarity with agile methodology like Scrum/Kanban

Required Experience & Education:

• 8 to 11 Years of relevant experience required
• 11 to 13 Years of overall experience required
• bachelors degree or equivalent preferred
• Experience with vendor management in an onshore/offshore model
• Proven experience with architecture, design, and development of large-scale enterprise application solutions

Desired Experience:

• Experience with Python/R or other statistical programming language Understanding of statistics concepts (eg confidence intervals, hypothesis testing, regression analysis)
• Angular
• Ability to think strategically, analyze and interpret market and consumer information
• Intense curiosity, high intellectual and analytical horsepower, passionate pursuit of analytics driven insights