Required Skills & Experience
- 5-8 years of experience in data systems and analytics development.
- Expert in advanced SQL, Spark and Python.
- 3+ years of experience with Databricks Unity Catalog, Workflows and Autoloader.
- Experience developing Big Data pipelines in AWS cloud.
- Bachelors Degree in Computer Science , Information Systems, Data Analytics or related.
- Experience with Git repository and CI/CD pipeline.
Desired Experience
- Understanding of web and mobile analytics.
- Experience with Data Security and managing PII/PHI in production environments.
- Understanding of common Big Data file formatsDatabricks Delta, CSV, JSON, Parquet, etc
- Understanding of Adobe Analytics or Customer Journey Analytics (CJA).
- Understanding of the medical insurance industry.
- Experience with Terraform code for Databricks job deployment.
