Senior Data Engineer
Senior Data Engineer
Kanerika Inc- Posted an hour ago
- Be among the first 10 applicants
Job Description
About This Job
Kanerika Inc
Location: Hyderabad, Telangana, India
Work Mode: On-site
Industry: IT Services and IT Consulting
Role
Job Description
As a Senior Databricks Engineer you will be responsible for automating platform operations, managing CI/CD pipelines, and supporting deployments across multiple environments. The role ensures platform stability, security, and scalability while enabling faster and more reliable software delivery.
Key Responsibilities
Hands on experience working on Databricks, creating data pipelines, transformation rules using Unity Catalog, PySpark, SparkSQLHands on Databricks Devs – Deployments, CICD, Performance ManagementHands on Databricks Infrastructure like creating resources (Catalogs, Volumes, Storage Account, Private end points)User permissions, access controls, Keyvalults etc.Handling release deployments, job controls, workflow management & organizing via automationsHandling production incidents, triaging production issues, work with Databricks to open incident tickets/case and follow up to close the issue and ensure long term fixesAdditional knowledge of other Databricks key features, like Genie, Apps, Models creations etc
Required Qualifications
Bachelor's degree in computer science, Information Technology, Engineering, or a related field.Bachelor's/Master's degree in Computer Science, Information Technology, Engineering, or related field.8+ years of experience in Devops and 3+ years in DBX.Strong hands-on experience in Databricks (Spark, Delta Lake, PySpark, MLflow).Proficiency in SQL and programming languages like Python or Scala.Experience with Azure cloud data services.Solid understanding of data modeling, data governance, security.
Why join us
Work with a passionate and innovative team in a fast-paced, growth-oriented environment.Gain hands-on experience in content marketing with exposure to real-world projects.Opportunity to learn from experienced professionals and enhance your marketing skills.Contribute to exciting initiatives and make an impact from day one.Competitive stipend and potential for growth within the company.Recognized for excellence in data and AI solutions with industry awards and accolades.
Kanerika Inc
Location: Hyderabad, Telangana, India
Work Mode: On-site
Industry: IT Services and IT Consulting
Role
Job Description
As a Senior Databricks Engineer you will be responsible for automating platform operations, managing CI/CD pipelines, and supporting deployments across multiple environments. The role ensures platform stability, security, and scalability while enabling faster and more reliable software delivery.
Key Responsibilities
Hands on experience working on Databricks, creating data pipelines, transformation rules using Unity Catalog, PySpark, SparkSQLHands on Databricks Devs – Deployments, CICD, Performance ManagementHands on Databricks Infrastructure like creating resources (Catalogs, Volumes, Storage Account, Private end points)User permissions, access controls, Keyvalults etc.Handling release deployments, job controls, workflow management & organizing via automationsHandling production incidents, triaging production issues, work with Databricks to open incident tickets/case and follow up to close the issue and ensure long term fixesAdditional knowledge of other Databricks key features, like Genie, Apps, Models creations etc
Required Qualifications
Bachelor's degree in computer science, Information Technology, Engineering, or a related field.Bachelor's/Master's degree in Computer Science, Information Technology, Engineering, or related field.8+ years of experience in Devops and 3+ years in DBX.Strong hands-on experience in Databricks (Spark, Delta Lake, PySpark, MLflow).Proficiency in SQL and programming languages like Python or Scala.Experience with Azure cloud data services.Solid understanding of data modeling, data governance, security.
Why join us
Work with a passionate and innovative team in a fast-paced, growth-oriented environment.Gain hands-on experience in content marketing with exposure to real-world projects.Opportunity to learn from experienced professionals and enhance your marketing skills.Contribute to exciting initiatives and make an impact from day one.Competitive stipend and potential for growth within the company.Recognized for excellence in data and AI solutions with industry awards and accolades.
More Info
About Company
Skills:
snowflake , Data Management, Hadoop, Performance Tuning, Data Modeling, Dimensional Modeling, Redshift, Sql, Data Quality, Hive, Spark, Data Integration, Python, Airflow, big data systems, data warehouse scaling, ETL pipelines
Skills:
monte carlo , snowflake , Azure, Python, Sql, Azure DevOps, GitHub Actions, dbt, Fivetran, Atlan, Immuta
Skills:
Java, Hadoop, Power Bi, Tableau, Data Modeling, Informatica, Redshift, Sql, Nosql, Bash Scripting, Hive, Data Transformation, Spark, Vertica, Talend, Python, Etl, Airflow, AWS Step Functions
Skills:
Azure Data Factory, Scala, Data Warehousing, Azure Databricks, Data Modeling, Sql, Python, Palantir, ETL processes
Skills:
snowflake , BigQuery, Gcp, Apache Flink, Apache Kafka, Apache Spark, Sql, Python, AWS, Etl, dbt