Senior Data Engineer

In this role, you will:

• Lead moderately complex initiatives within Technology and contribute to large scale data processing framework initiatives related to enterprise strategy deliverables
• Build and maintain optimized and highly available data pipelines that facilitate deeper analysis and reporting
• Review and analyze moderately complex business, operational or technical challenges that require an in-depth evaluation of variable factors
• Oversee the data integration work, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data integration and analysis
• Resolve moderately complex issues and lead teams to meet data engineering deliverables while leveraging solid understanding of data information policies, procedures and compliance requirements
• Collaborate and consult with colleagues and managers to resolve data engineering issues and achieve strategic goals

Required Qualifications:

• 4+ years of Data Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education

Desired Qualifications:

• 3+ years of Data Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
• 2+ years of working experience in Data Ingestion, Data Curation, Data Extraction
• 2+ years in development of data pipelines/ETL for data ingestion, data preparation, data integration, data aggregation, feature engineering, etc.
• 2+ years of strong experience in relational DBMS platforms, (DB2 or Oracle)
• 2+ years of strong experience in SQL and Data Analysis
• Strong understanding of unit testing, integration, functional and load testing.
• Ability to conduct code reviews with a focus on testability and code coverage.
• Should have experience working in an Agile environment using Scrum or Kanban.
• 1+ years of strong experience with Hadoop
• 1+ years of strong experience with Hive
• 1+ years of strong experience with Python
• 1+ years of experience with Kubernetes
• 1+ years of experience with Docker
• 1+ years of experience with Google Big Query
• 1+ years of experience with Autosys
• 2 years presenting to technical and executive audiences
• Good knowledge of non-relational DBMS platforms, (MongoDB or Neo4j)
• Good knowledge of real-time data streaming via Kafka
• Good knowledge of Cloud ecosystems such as Google Cloud Platform
• GCP Associate Cloud Engineer Certified is a plus

Role: Data Engineer

Industry Type: IT Services & Consulting

Department: Data Science & Analytics

Employment Type: Full Time, Permanent

Role Category: Data Science & Machine Learning

Education

UG: Any Graduate

PG: Any Postgraduate