Search by job, company or skills

Data Engineer II - Databricks, Python, PySpark, AWS

2-4 Years
Early Applicant
  • Posted 2 hours ago
  • Be among the first 10 applicants

Job Description

You thrive on diversity and creativity, and we welcome individuals who share our vision of making a lasting impact. Your unique combination of design thinking and experience will help us achieve new heights.


As a Data Engineer II at JPMorganChase within the Commercial & Investment Bank, youare part of an agile team that works to enhance, design, and deliver the data collection, storage, access, and analytics solutions in a secure, stable, and scalable way. As an emerging member of a data engineering team, you execute data solutions through the design, development, and technical troubleshooting of multiple components within a technical product, application, or system, while gaining the skills and experience needed to grow within your role.

Job responsibilities

  • Organizes, updates, and maintains gathered data that will aid in making the data actionable
  • Demonstrates basic knowledge of the data system components to determine controls needed to ensure secure data access
  • Uses enterprise-authorized AI capabilities within the work environment to accelerate data analysis support and technical documentation (e.g., clarifying requirements and drafting data definitions), validating outputs and handling data according to sensitivity and security requirements.
  • Applies reuse-first, AI-assisted approaches to improve data quality checks and model/change validation routines, ensuring results are validated and aligned to resiliency and security expectations.
  • Be responsible for making custom configuration changes in one to two tools to generate a product at the business or customer request
  • Updates logical or physical data models based on new use cases with minimal supervision
  • Adds to team culture of diversity, opportunity, inclusion, and respect

Required qualifications, capabilities, and skills

  • Formal training or certification on data engineering concepts and 2+ years applied experience
  • Basic knowledge of the data lifecycle and data management functions. Experience across the data lifecycle, building Data frameworks, working with Data lakes. Experience with Batch and Real time Data processing with Spark or Flink.
  • Working experience with both relational and NoSQL databases. Experience in ETL data pipelines both batch and real-time data processing, Data warehousing, NoSQL DB. Experience working with Databricks, Python/Java, PySpark etc.
  • Working knowledge of AWS Glue and EMR usage for Data processingand in building services using Spring Boot or Flask and deploying them on AWS EKS or Kubernetes.
  • Working knowledge of using enterprise-authorized AI capabilities within the work environment to support data engineering workflows with strong validation habits and awareness of data sensitivity.
  • Ability to review and validate AI-assisted outputs (e.g., query suggestions or model change summaries) before use, escalating when uncertain and following data handling requirements.
  • Significant experience with statistical data analysis and ability to determine appropriate tools to perform analysis
  • Basic knowledge of data system components to determine controls needed
Preferred qualifications, capabilities, and skills
  • Cloud computing: Expertise in Amazon Web Services (AWS), Docker, and Kubernetes for cloud-native and containerized data solutions.
  • Experience in big data technologies: Hadoop, Spark, Kafka.
  • Experience in distributed system design and development

More Info

Job ID: 153739477

Similar Jobs

Hyderabad, India

Skills:

snowflake Aws CloudPythonSqlAgentic AI conceptsPrompt Engineering

Hyderabad, India

Skills:

Aws ServicesPythonCI CD Pipeline DevelopmentCloud Platform DevelopmentCloud based databasesCloud Based Application Development

Hyderabad, India

Skills:

ConfigAWS IAMAWS Security HubPythonAgentCoreprivate endpointsAI Agents FrameworksControl TowerAmazon AWS SecurityOrganizationsGuardDutyVPC designmulti-account AWS governanceAmazon BedrockCloudTrail

Hyderabad

Skills:

DjangoSoftware Development Life CycleT-sqlReactjsNodejsAutomationPythonAI-assisted development

Hyderabad, India

Skills:

GitBigQueryGoogle Cloud PlatformTerraformDataprocDataFlowPythonCloud ComposerGoogle Cloud StorageCloud Data Fusion

Beware of Scammers

We don’t charge money for job offers