- Posted a day ago
- Be among the first 10 applicants
Job Description
Job Description
Key responsibilities:
Ensure the stability, scalability, and performance of the data pipelines solution.
Monitor and maintain batch data pipelines in a cloud-based environment.
Improve operational processes including incident handling, performance monitoring, and issue resolution.
Optimize Databricks workloads to improve efficiency and reduce costs.
. Analyze and fine-tune the cloud infrastructure for better cost optimization.
Technical Skills:
Solid understanding of common issues incloud-based data pipelinesand analytics solutions
Working knowledge ofDatabricksandLakehouse architecturein a cloud environment.
Working with Batch accounts, IAC, GitHub, IAM, and CI/CD pipelines
Experience withcommand-line scripting(e.g.,PowerShell).
Experience withdata pipeline orchestration tools(e.g. Azure Data Factory)
Understanding of monitoring and logging tools is a plus.
Soft Skills:
Excellentproblem-solving and critical thinking skills,with a proactive approach to incident management and root cause analysis.
Strongcommunication and coordination abilities,capable of working effectively across cross-functional and international teams.
High level ofownership,with a strong drive foroperational excellence,efficiency, and continuous improvement.
Qualifications
Education:
Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.
Professional Experience:
Experience in operating and maintaining large-scale cloud data solutions in production environments.
Proven experience as a Data Engineer, with a strong focus on Azure Data factory and Databricks.
Experience working in an automotive domain is a plus.
Languages:
Fluent in English(written and spoken) additional languages are a plus.
Additional Information
3-5 years Experience in cloud infra and Devops
More Info
Key Skills
monitoring and logging tools
CI CD pipelines
Batch accounts
Lakehouse architecture
IAC
data pipeline orchestration tools
