Data Engineer

Job Description

Responsibilities:

Data Pipeline Development:

• Design, build, and maintain scalable and robust data pipelines to ingest, process, and transform data from various sources.

• Collaborate with cross-functional teams to understand data requirements and implement efficient solutions.

• Ensure data quality and integrity throughout the pipeline by implementing data validation and monitoring processes.

Frontend Development:

• Develop interactive and user-friendly frontend applications using modern web technologies such as HTML, CSS, and JavaScript frameworks (e.g., React, Angular, Vue.js).

• Implement responsive design principles to ensure seamless user experiences across different devices and screen sizes.

• Work closely with UX/UI designers to translate design mockups into functional frontend components.

Data Visualization:

• Create visually compelling and insightful data visualizations using tools like Tableau, Power BI, or D3.js. • Collaborate with stakeholders to understand analytical requirements and design intuitive dashboards and reports.

• Continuously optimize and refine visualizations to improve data interpretation and storytelling.

Infrastructure and Tooling:

• Deploy and maintain infrastructure components necessary for data processing and visualization, including cloud services (e.g., AWS, Azure, GCP) and containerization technologies (e.g., Docker, Kubernetes).

• Evaluate and integrate third-party tools and libraries to enhance the capabilities of data pipelines and frontend applications.

Documentation and Collaboration:

• Document technical designs, implementation details, and best practices to facilitate knowledge sharing and onboarding of team members.

• Collaborate effectively with data scientists, analysts, and other stakeholders to understand business requirements and deliver solutions that meet their needs.

Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

• Proven experience in data engineering, including designing and implementing data pipelines using technologies like Apache Spark, Kafka, or Apache Airflow.

• Strong proficiency in frontend development with expertise in HTML, CSS, JavaScript, and popular frameworks/libraries (e.g., React, Angular, Vue.js).

• Experience with data visualization tools such as Tableau, Power BI, or D3.js, including designing and implementing interactive dashboards and reports.

• Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and containerization technologies (e.g., Docker, Kubernetes).

• Excellent problem-solving skills and ability to work in a fast-paced, collaborative environment.

• Effective communication skills with the ability to convey complex technical concepts to non-technical stakeholders.

Preferred Qualifications:

• Previous experience in the manufacturing or engineering industry.

• Knowledge of SQL and database systems (e.g., PostgreSQL, MySQL, MongoDB).

• Understanding of Agile development methodologies and practices.

• Experience with version control systems (e.g., Git) and CI/CD pipelines.