Search by job, company or skills

Lead Data Engineer

Lead Data Engineer

Visa
10-15 Years
Not Disclosed

This job is no longer accepting applications

Job Description

We are seeking a highly skilled and experienced Big Data Platform Architect to join our team. The ideal candidate will have a proven track record in building large shared platforms and hybrid cloud platforms. This role requires a visionary leader who can develop the vision and roadmap for our Data Platform, collaborate with business and product teams to establish and drive consensus, and deliver as per the roadmap.

Key Responsibilities:

  • Develop and implement the vision and roadmap for the Data Platform, ensuring alignment with the company's strategic goals.
  • Design and build large shared platforms and hybrid cloud platforms that are scalable, reliable, and secure.
  • Collaborate with business and product teams to establish and drive consensus on platform strategies and initiatives.
  • Lead the architecture and design of data solutions, ensuring they meet the needs of the business and support the company's strategic goals.
  • Provide technical leadership and guidance to development teams, ensuring best practices are followed.
  • Stay up-to-date with the latest industry trends and technologies to ensure the Data Platform remains cutting-edge.
  • Oversee the implementation of data governance and security best practices.
  • Foster a culture of innovation and continuous improvement within the team.
  • Ensure the Data Platform supports the company's data-driven decision-making processes.

This is a hybrid position. Expectation of days in office will be confirmed by your hiring manager.

Qualifications

Basic Qualifications:

  • 10+ years of relevant work experience with a Bachelor's Degree or at least 7 years of work experience with an Advanced degree (e.g. Masters, MBA, JD, MD) or 4 years of work experience with a PhD, OR 13+ years of relevant work experience.

Preferred Qualifications:

  • Proven experience in building large shared platforms and hybrid cloud platforms.
  • Strong expertise in Big Data technologies and architectures.
  • Technologist with excellent leadership and communication skills.
  • Ability to collaborate effectively with cross-functional teams.
  • Strong problem-solving and analytical skills.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud.
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Experience in a similar role within a large organization.
  • Knowledge of data governance and security best practices.
  • Familiarity with machine learning and AI technologies.
  • Experience with data-driven decision-making processes.
  • Strong understanding of data privacy regulations and compliance requirements.

Key Skills

About Company

Visa is a world leader in payments and technology, with over 259 billion payments transactions flowing safely between consumers, merchants, financial institutions, and government entities in more than 200 countries and territories each year. Our mission is to connect the world through the most innovative, convenient, reliable, and secure payments network, enabling individuals, businesses, and economies to thrive while driven by a common purpose – to uplift everyone, everywhere by being the best way to pay and be paid.

Similar Jobs

9-11 yrs
Bengaluru, India
Skills:
Pyspark, Scala, Apache Spark, Kafka, Oracle Goldengate, Jenkins, Terraform, Python, Airflow, Google BigQuery, Cloud Composer, GitHub Actions
10-12 yrs
Bengaluru, India
Skills:
snowflake , Data Lineage, Pyspark, Apache Spark, Sql, ELT, Data Quality, Goldengate, Data Lake, Databricks, Data Governance, Python, AWS, Etl, AWS DMS, Data Pipelines, Lakehouse, Observability
8-10 yrs
Bengaluru, India
Skills:
Sql, ETL ELT fundamentals and best practices, CI CD pipelines for data deployments, Snowflake data warehousing including Time Travel and Fail Safe features, AWS services such as S3 Lambda Secret Manager IAM and CloudWatch, Configuration of monitoring alerting and data quality checks in cloud data platforms, Administration of Snowflake warehouses databases schemas and role-based security, dbt models macros and tests, Python for data engineering and automation
8-10 yrs
Bengaluru, India
Skills:
Git, Gcp, Scala, Apache Spark, Apache Kafka, Databricks, Python, Spark Structured Streaming, Cloud SQL
12-14 yrs
Bengaluru, India
Skills:
change data capture , Java, SQL Server, Spring Boot, Data Migration, Reconciliation, Messaging, relational database architecture, consistency models, SQL performance, distributed services, Transactions