Summary:
We're looking for a dynamic Data Engineer with hands-on experience in Apache Spark and AWS to join our Data Analytics Team at Gain well Technologies. This is an exciting opportunity to collaborate with a cross-functional team, designing and deploying data frameworks that support critical analytics missions for Gain well and our clients.
Your Role in Our Mission:
As a Data Engineer, you will:
- Design & Develop Data Pipelines: Build and deploy robust ETL processes using the Apache Spark Framework for data collection, transformation, and delivery.
- Data Management: Monitor, manage, validate, and test data extraction, transformation, loading (ETL), normalization, cleansing, and updating processes.
- Database Development: Build complex, secure, and accessible databases tailored to analytics needs.
- Stakeholder Collaboration: Work closely with users to understand data requirements, ensuring data quality, consistency, security, and compliance with regulations.
- Data Modeling: Collaborate on data models, schemas, and source-to-target mapping for efficient data warehouse operations.
- Framework Visualization: Conceptualize and visualize data frameworks to support business decisions.
- Cross-Functional Communication: Effectively communicate with internal teams and external stakeholders to align data strategies with business goals.
What We're Looking For:
- Educational Background: Bachelor's degree in Computer Science, Information Technology, or a related field.
- Technical Expertise:
- 3+ years of experience with big data technologies on AWS, Azure, or GCP.
- 2+ years of hands-on experience with Apache Spark and Data bricks, using Python or Scala.
- Strong understanding of database structures, including transactional databases and data warehouses.
- Certifications (Preferred):
- AWS Developer/Architect Certifications
- Data bricks Certifications
What You Should Expect in This Role:
- A fast-paced, collaborative environment focused on data-driven solutions.
- Opportunities to work on cutting-edge technologies in the cloud and big data ecosystem.
- A supportive team culture where your insights and innovations are valued.
- Flexibility in work arrangements (Remote/Hybrid options available).
