The Data Engineer contractor will play a pivotal role in designing, developing, and maintaining data pipelines and systems to support the Increase Client Exchange of Data (ICED) project. This role requires expertise in data engineering, proficiency in relevant technologies such as DBT,SSIS, SQL, Microsoft SQL Server, PostgreSQL, Snowflake, Knime, Python, and familiarity with project management platforms like JIRA. The ideal candidate will be self-motivated, adaptable, and passionate about leveraging data to drive business success.
JOB SPECIFIC DUTIES & RESPONSIBILITIES
- Design, develop, and maintain scalable and efficient data pipelines and workflows to support RKD Group's marketing solutions, ensuring the reliable extraction, transformation, and loading (ETL) of data.
- Collaborate closely with data architects, analysts, and other stakeholders to understand data requirements and design data models and architectures that meet business needs.
- Implement data quality checks, validation processes, and monitoring tools to ensure the accuracy, completeness, and integrity of data.
- Optimize data pipelines and workflows for performance, reliability, and scalability, leveraging best practices and emerging technologies.
- Develop and maintain documentation for data engineering processes, standards, and best practices.
- Provide technical guidance and support to other team members, as needed, fostering a culture of collaboration and knowledge sharing.
- Stay current with industry trends, advancements, and best practices in data engineering, and apply this knowledge to enhance RKD Group's data capabilities and offerings.
- Uphold confidentiality and security standards for client data, ensuring compliance with relevant regulations and policies.
- Communicate effectively with remote/offshore teams, leveraging appropriate tools and technologies to facilitate collaboration and productivity.
REQUIRED COMPETENCIES AND SKILLS
- Bachelor's degree in computer science or related experience.
- 5+ years of experience in data engineering, ETL development, or a similar role, preferably in a marketing or technology environment.
- Proficiency in DBT, SQL, Microsoft SQL Server, PostgreSQL, Snowflake, Knime, and Python for designing and implementing data pipelines and workflows.
- Should have knowledge in SSIS
- Familiarity with project management platforms like JIRA or similar tools for tracking and managing technical projects.
- Strong understanding of data modeling, data warehousing, and database technologies, with experience in both relational and non-relational databases.
- Familiarity with cloud platforms such as AWS, GCP, or Azure, and familiarity with related services (e.g., Snowflake, S3, BigQuery).
- Excellent problem-solving skills, with the ability to analyze complex data requirements and develop innovative solutions to meet business needs.
- Proven ability to work independently and manage multiple tasks and priorities in a remote/offshore environment.
