Resident Solution Architect
Resident Solution Architect
Unison Group New ZealandThis job is no longer accepting applications
Job Description
- Design and implement scalable data pipelines using Delta Live Tables (DLT), Spark SQL, Python, or Scala
- Optimize ETL, streaming, and ML workloads for performance, cost efficiency, and reliability
- Administer and configure Databricks Workspaces, Unity Catalog, and cluster policies for secure, governed environments
- Automate infrastructure and deployments using Terraform, Git, and CI/CD pipelines
- Implement observability, cost optimization, and monitoring frameworks using tools like Splunk, Prometheus, or CloudWatch
- Collaborate with customers to build AI and LLM solutions leveraging MLflow, DBRX, and Mosaic AI
- Strong hands-on experience with Databricks, including workspace setup, notebooks, clusters, and job orchestration
- Expertise in Delta Lake, DLT, Unity Catalog, and SQL Warehouses
- Proficiency in Python or Scala for data engineering and ML workflows
- Strong understanding of AWS, Azure, or GCP cloud ecosystems
- Experience with Terraform automation, DevOps, and MLOps practices
- Familiarity with monitoring and governance frameworks for large-scale data platforms
More Info
Key Skills
Mosaic AI
MLflow
Unity Catalog
SQL Warehouses
DBRX
About Company