Job Description:

What You Will Be Doing:

Data Pipeline Development: You'll design, build, and maintain data pipelines that efficiently move and transform data from various sources to storage systems. These pipelines ensure data availability, reliability, and quality.

Data Integration and ETL: You'll work onExtract, Transform, Load (ETL)processes. This includes extracting data from different systems, transforming it into a consistent format, and loading it into target destinations. ETL ensures data consistency and usability.

Performance Optimization: Optimize data processing performance. This involves choosing appropriate storage solutions.

Collaboration with Cross-Functional Teams: Engage with data scientists, analysts, developers, and business stakeholders. Understand their requirements and translate them into effective data solutions and reports.

Agile Development: Work in an agile environment, collaborating with other team members to deliver code to production frequently.

As a Data Engineer, you play a crucial role in ensuring data availability, reliability, and accuracy, enabling data-driven decision-making across the organization.

What We Are Looking For:

Strong SQL proficiency (MySql / Snowflake ...) Proficiency in database solutions (SQL, NoSQL, ) Proficiency in structured languages (JavaScript, Python, Bash, ) Expertise in data storage Expertise in ETL Tools (such as Matillion) Proficiency in Power BI and report development including DAX/M language

You can adapt to our technical environment: AWS (API Gateway, Lambda, DynamoDB, Aurora, Athena, S3, OpenSearch), Snowflake / Matillion.

Job Complexity:

Analyze and evaluate business requirements: Understand and assess business needs, translating them into technical requirements.
Design solutions for complex report.
Contribute to process improvements.
Write and maintain technical documentation describing processes.

Experience

Requires a minimum of 8 years of experience.