Data Engineering And Infrastructure
- 6+ years of experience in a Data Engineering role, designing, building, and managing
scalable and reliable data systems.
- Proficient with big data and stream-processing technologies such as Spark and Kafka.
- Hands-on experience with cloud platforms, particularly AWS services like EC2 and RDS.
- Skilled in building and orchestrating data pipelines using tools like Airflow.
- Experience with Databricks for scalable data processing and advanced analytics.
- Strong knowledge of SQLMesh for modern data workflow management.
- Extensive experience integrating and working with external data sources via REST APIs,
- GraphQL endpoints and SFTP servers.
- Strong communication skills and leadership capabilities are required.
