Search by job, company or skills

Q

Senior Technical Architect - Databricks

Save
new job description bg glownew job description bg glownew job description bg svg
  • Posted 9 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

While technology is the heart of our business, a global and diverse culture is the heart of our success. We love our people and we take pride in catering them to a culture built on transparency, diversity, integrity, learning and growth.

If working in an environment that encourages you to innovate and excel, not just in professional but personal life, interests you- you would enjoy your career with Quantiphi!

Required Skills:

  • Experience: 15+ years of relevant experience in building cloud-native, hybrid, or multi-cloud solutions.

  • Experience with Databricks implementations - developing data pipelines using PySpark

  • Experience in Databricks Workspaces,Notebooks, Delta Lake, APIs

  • Expertise in production grade solutions using: AWS (Redshift, S3, Glue, Lambda, Airflow), Pyspark, Python, Data pipelines using Glue/Airflow/Sagemaker.

  • Hands-on experience in working on large cloud-based migration workloads involving SQL and NoSQL Databases

  • Experience with migration of databases to AWS. Strong ability in creating roadmaps and architecture to execute migration workloads on AWS.

  • Exposure to ETL tools and Data warehouse.

  • Experience in SQL and Query optimisation. Proficient in SQL-based technologies (MySQL, Oracle DB,SQL Server etc.)

  • Experience in creation and maintenance of data dictionaries, metadata repositories, and data lineage documentation.

  • Experience building and supporting large-scale systems in a production environment.

  • Strong skills to mentor and manage teams of junior and senior data engineers and leading end to end delivery of technical workloads.

  • Experience using Github/codecommit for developmental activities

Good to have skills:

  • Experience with AWS services - S3,Redshift,Secrets Manager
  • Experience in implementing data integration projects using ETL

  • Experience in using Airflow or Step Functions for orchestration

  • Exposure to IaC tools like Terraform and to CI/CD tools

  • Prior experience in migrating (on-prem to cloud) and processing large amounts of data

  • Experience in implementing data lake and data warehouse on cloud

  • Experience in implementing the industry's best practices

More Info

Job Type:
Employment Type:

About Company

Quantiphi Founded in 2013, Quantiphi is an award-winning AI-first digital engineering company driven by the desire to reimagine and realize transformational opportunities at the heart of business. We are passionate about our customers and obsessed with problem-solving to make products smarter, customer experiences frictionless, processes autonomous and businesses safer.

Job ID: 147166575