Search by job, company or skills

C

Senior Cloud Data Engineer - Emerging Lead

new job description bg glownew job description bg glownew job description bg svg
  • Posted 6 hours ago
  • Be among the first 10 applicants
Early Applicant

Job Description

Who we are looking for:

We are seeking an experienced Senior Data Engineer to design, build, and optimize scalable data solutions on cloud platforms.The candidate should have industry experience (preferably in Financial Services) in building cloud based database engineering platforms. The role requires strong technical expertise in Databricks and Spark.

What you will be responsible for:

  • Design, develop, and optimize endtoend data pipelines using Databricks
  • Design data pipelines using Bronze / Silver / Gold (medallion) architecture
  • Ensure data quality, integrity, and performance across pipelines
  • Develop highperformance PySpark and SQL transformations
  • Collaborate with Architects, Business Analysts, and downstream consumers
  • Support CI/CD implementation for Databricks jobs and notebooks
  • Ensure adherence to security, governance, and compliance standards

What we value:

  • Strong ownership and delivery focus
  • Collaboration and teamwork across global teams
  • Willingness to learn new technologies and data platforms
  • Proactive identification of risks and improvement opportunities
  • Ability to work independently in complex data environments

Mandatory skills / experience:

  • 5-8 years of hands on experience with AWS Cloud Data Engineering with Databricks platform
  • Hands on experience in setting up data pipelines for ETL jobs across multiple data sources
  • Knowledge of cluster configuration, autoscaling, and cost optimization in Databricks
  • Expertise in Data Modeling and DB design
  • Handson experience with performance tuning, Git, Jenkins, and enterprise job scheduling tools (Autosys / Airflow)
  • Basic understanding of data warehousing and ETL concepts
  • Knowledge of CI/CD tools (GitHub, Azure DevOps)
  • Advanced SQL and Python skills
  • Experience working in Agile delivery environments

Additional requirements / Good to have skills:

  • Experience in regulatory or financial services domain
  • Databricks or Cloud certifications
  • Experience with visualization tools (PowerBI, Tableau)
  • Exposure to Starburst, Spotfire, TDV, ServiceNow

Mode of work:Hybrid (Hyderabad or Bangalore)

Are you the right candidate Yes!

We truly believe in the power that comes from the diverse backgrounds and experiences our employees bring with them. Although each vacancy details what we are looking for, we don't necessarily need you to fulfil all of them when applying. If you like change and innovation, seek to see the bigger picture, make data driven decisions and are a good team player, you could be a great fit.

Why this role is important to us:

Our technology function, Global Technology Services (GTS), is vital to State Street and is the key enabler for our business to deliver data and insights to our clients. We're driving the company's digital transformation and expanding business capabilities using industry best practices and advanced technologies such as cloud, artificial intelligence and robotics process automation.

We offer a collaborative environment where technology skills and innovation are valued in a global organization. We're looking for top technical talent to join our team and deliver creative technology solutions that help us become an end-to-end, next-generation financial services company.

Join us if you want to grow your technical skills, solve real problems and make your mark on our industry.

About State Street

Across the globe, institutional investors rely on us to help them manage risk, respond to challenges, and drive performance and profitability. We keep our clients at the heart of everything we do, and smart, engaged employees are essential to our continued success.

We are committed to fostering an environment where every employee feels valued and empowered to reach their full potential. As an essential partner in our shared success, you'll benefit from inclusive development opportunities, flexible work-life support, paid volunteer days, and vibrant employee networks that keep you connected to what matters most. Join us in shaping the future.

As an Equal Opportunity Employer, we consider all qualified applicants for all positions without regard to race, creed, color, religion, national origin, ancestry, ethnicity, age, disability, genetic information, sex, sexual orientation, gender identity or expression, citizenship, marital status, domestic partnership or civil union status, familial status, military and veteran status, and other characteristics protected by applicable law.

Discover more information on jobs at

Read our

More Info

About Company

At State Street, we partner with institutional investors all over the world to provide comprehensive financial services, including investment management, investment research and trading, and investment servicing.
Whether you are an asset manager, asset owner, alternative asset manager, insurance company, pension fund or official institution, you can rely on us to be focused on your challenges. We are committed to doing what it takes to help you perform better &#8212&#x3B; now and in the future.

Job ID: 144203997