Data Engineer II - Python, AWS, Spark

Join us for an exciting opportunity to advance your data engineering career and drive innovation in cloud automation.

Job summary

As a Software Engineer II at JP Morgan Chase within the Data Governance team, you design and deliver robust, compliant, and scalable data solutions that support our organization's data quality, security, and regulatory requirements. You collaborate with cross-functional teams to ensure best practices in data management and automation.

Job responsibilities

• Designs, develops, and maintains scalable data pipelines using Python and Big Data frameworks to support governance initiatives
• Architects and implements AWS cloud-based solutions for secure data storage, processing, and analytics
• Automates infrastructure deployment and management using Terraform
• Develops and maintains CI/CD pipelines using Jenkins for automated testing and deployment
• Collaborates with data stewards and compliance officers to deliver high-performance, compliant data solutions
• Ensures best practices in code quality, data security, privacy, and regulatory compliance
• Troubleshoots and optimizes data workflows and cloud infrastructure

Required qualifications, capabilities, and skills

• Formal training or certification on software engineering concepts and 2+ years applied experience
• Experience in data engineering, cloud automation, or DevOps
• Advanced programming skills in Python for data engineering and automation
• Hands-on experience with Hadoop, Spark, or similar Big Data technologies
• Proficiency in AWS Cloud platforms
• Strong knowledge of Infrastructure as Code using Terraform
• Experience in building and maintaining CI/CD pipelines with Jenkins

Preferred qualifications, capabilities, and skills

• Experience or interest in agent-based AI systems or autonomous agents
• Experience working in or with data governance, data quality, or data compliance teams
• Strong problem-solving and communication skills
• Ability to work independently and as part of a team