Role Purpose
The Data Engineer will be responsible for designing, building, and supporting scalable data solutions that enable business intelligence, analytics, and data-driven decision-making. The role requires working within a cross-functional Agile team, developing robust data pipelines, data warehouse solutions, and cloud-based data architectures while ensuring compliance with engineering and governance standards.
Key Responsibilities
- Design, develop, test, and maintain data pipelines and data warehouse solutions.
- Work with structured and unstructured data from multiple sources.
- Build scalable cloud-based data architectures.
- Develop innovative data solutions that align with business requirements.
- Follow engineering best practices, governance, security, and architectural standards.
- Participate in Agile ceremonies (Scrum, Squad, Chapter, Guild activities).
- Collaborate with stakeholders across IT and business teams.
- Support production environments and participate in on-call activities when required.
- Drive automation, reusability, and continuous improvement initiatives.
- Contribute to data strategy and business intelligence capabilities.
Essential Technical Skills Data Engineering
- Data Pipeline Design & Development
- ETL/ELT Development
- Kimball Data Warehouse Modeling
- Data Integration & Transformation
Programming & Querying
- ANSI SQL
- Python
- PowerShell (or equivalent scripting languages)
Cloud & Data Platforms
- Google Cloud Platform (GCP)
- Cloud Data Architecture
Tools & Technologies
- WhereScape
- SQL Server
- Azure DevOps
- Looker
- MicroStrategy
Development Methodologies
- Scrum / Agile
- CI/CD
- Automated Testing
- Version Control
Preferred Candidate Profile
- Strong experience in cloud-based data engineering environments.
- Hands-on expertise with BigQuery, Dataflow, and Pub/Sub.
- Experience implementing Kimball dimensional models.
- Good understanding of DevOps and automation practices.
- Ability to work independently and within collaborative Agile teams.
- Strong problem-solving and analytical mindset.
Skills: python,ansi sql,kimball,devops
