B
Senior Data Engineer
B
Senior Data Engineer
Bridgestone AmericasFresher
- Posted 2 hours ago
- Be among the first 10 applicants
Job Description
Job Duties
- Designs, builds, and operates industrialized data ingestion and transformation pipelines from source systems through the silver layer of a medallion architecture, using Databricks (Spark, Unity Catalog, workflows) as the core platform.
- Serves as the team's Databricks subject matter expert — data modeling in Delta, job and cluster design, performance and cost tuning, and Unity Catalog governance patterns.
- Guides, coaches, and technically mentors other Data Engineers; conducts design and code reviews to ensure architecture, platform, and solution standards are followed.
- Builds and maintains pipelines across multiple clouds — primarily AWS (Glue, Step Functions, Redshift, Aurora, Transfer Family, S3) and Azure (Data Factory, ADLS) — and plans the migration of native cloud pipelines to Databricks as a destination technology.
- Defines and enforces the guardrails, standards, and reusable patterns that business units follow when building their own projects on the platform, balancing self-service velocity against governance requirements.
- Partners with the BI and analytics teams to deliver curated, well-modeled, well-documented data products fit for reporting and for conversational query experiences such as Databricks Genie Space.
More Info
Key Skills
Aurora
ADLS
Transfer Family
Unity Catalog
About Company
Skills:
Apache Airflow, Data Modeling, Pyspark, Version Control, Databricks, Sql, AWS, ETL ELT
Skills:
Rest Api, S3, Git, Terraform, Pyspark, AWS Glue, Python, AWS, AWS Step Functions, Athena
Skills:
Gcp, Apache Spark, Databricks, Tableau, Python, Sql, AWS, Airflow, Bitbucket Pipelines, dbt
Skills:
snowflake , Pyspark, Dynamodb, Kafka, Emr, Cloud Watch, Redshift, Sql, Jenkins, Docker, Terraform, Iam, Sqs, Spark, Sns, Kubernetes, Python, AWS, Step Functions, dbt, Glue, SecretManager
Skills:
Pyspark, Api Integration, Sql, ELT, Azure Data Factory, Databricks, Azure, Python, Etl, Azure OpenAI, Genie Spaces Agents, AI-enabled data solutions, Unity Catalog, Azure Data Lake Storage, microservices architecture