DATA ENGINEER - Databricks
DATA ENGINEER - Databricks
Happiest Minds Technologies- Posted an hour ago
- Be among the first 10 applicants
Job Description
Senior Data Engineer (Senior C2)
Required Skills & Qualifications
- Strong expertise in data engineering architecture
- Expertise in data warehouse concepts
- Good exposure to building end-to-end data pipelines
- Strong knowledge of and hands-on experience with Databricks
- Strong programming skills in Python and Pyspark
- Strong SQL scripting skills
- Expertise in Snowflake cloud data warehouse
- Experience with AWS services, including S3, CloudWatch, and KMS ,also DevOps such as EC2 and ECR
- Good debugging and troubleshooting skills
- Exposure to Apache Airflow orchestration
- Experience with CI/CD pipelines and automated deployments
- Proven expertise in data modelling and performance tuning
- Good communication skills
- Strong problem-solving skills
More Info
About Company
Skills:
snowflake , Pyspark, Apache Airflow, Data Modelling, Performance Tuning, Databricks, Python, Sql, CI/CD pipelines
Skills:
Pyspark, Azure Databricks, Sql, Clusters, Python, Kubernetes, RBAC configuration, Ability to debug and optimize PySpark SQL code, Programming Data Processing using Scala, Databricks Platform Expertise, Unity Catalog, Azure Services, Experience in AWS using Docker, CI CD with Azure DevOps, Jobs, Secure Coding principles in Databricks, Notebooks, Delta Lake, Blob Storage, Data Governance and Compliance standards, Apache Spark optimization techniques, Helm framework
Skills:
Adf, Pyspark, Azure Databricks, Sql, Devops, Git, Openshift, Python, Kubernetes, KQL, CI CD, Delta Lake
Skills:
Data Engineering Skills, Databricks Platform Expertise, Technical Collaboration, Cloud Technology Knowledge, Implementation Expertise
Skills:
Python, Databricks, Sql, AWS Glue, Spark SQL, Informatica Powercenter, Apache Spark, Pyspark, Databricks SQL, Databricks Jobs Workflows, Delta Lake