In this role, you will:
- Lead moderately complex initiatives within Technology and contribute to large scale data processing framework initiatives related to enterprise strategy deliverables
- Build and maintain optimized and highly available data pipelines that facilitate deeper analysis and reporting
- Review and analyze moderately complex business, operational or technical challenges that require an in-depth evaluation of variable factors
- Oversee the data integration work, including developing a data model, maintaining a data warehouse and analytics environment, and writing scripts for data integration and analysis
- Resolve moderately complex issues and lead teams to meet data engineering deliverables while leveraging solid understanding of data information policies, procedures and compliance requirements
- Collaborate and consult with colleagues and managers to resolve data engineering issues and achieve strategic goals
Required Qualifications:
- 4+ years of Data Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
Desired Qualifications:
- 3+ years of Data Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education
- 2+ years of working experience in Data Ingestion, Data Curation, Data Extraction
- 2+ years in development of data pipelines/ETL for data ingestion, data preparation, data integration, data aggregation, feature engineering, etc.
- 2+ years of strong experience in relational DBMS platforms, (DB2 or Oracle)
- 2+ years of strong experience in SQL and Data Analysis
- Strong understanding of unit testing, integration, functional and load testing.
- Ability to conduct code reviews with a focus on testability and code coverage.
- Should have experience working in an Agile environment using Scrum or Kanban.
- 1+ years of strong experience with Hadoop
- 1+ years of strong experience with Hive
- 1+ years of strong experience with Python
- 1+ years of experience with Kubernetes
- 1+ years of experience with Docker
- 1+ years of experience with Google Big Query
- 1+ years of experience with Autosys
- 2 years presenting to technical and executive audiences
- Good knowledge of non-relational DBMS platforms, (MongoDB or Neo4j)
- Good knowledge of real-time data streaming via Kafka
- Good knowledge of Cloud ecosystems such as Google Cloud Platform
- GCP Associate Cloud Engineer Certified is a plus
Role: Data Engineer
Industry Type: IT Services & Consulting
Department: Data Science & Analytics
Employment Type: Full Time, Permanent
Role Category: Data Science & Machine Learning
Education
UG: Any Graduate
PG: Any Postgraduate
