Business Area:
Engineering
Seniority Level:
Mid-Senior level
Job Description:
At Cloudera, our Data Services Pillar is the heart of data innovation. Cloudera Data Engineering (CDE) is our next-generation cloud-native service built on Apache Spark and Apache Airflow. It is the only service purpose-built for enterprise data engineering teams, providing an all-inclusive toolset for orchestration, pipeline monitoring, and visual troubleshooting across hybrid cloud environments.
As a Senior Software Engineer on you will:
- Architect & Build: Design scalable, high-performance, cloud-native platforms that enable data scientists and engineers to run distributed workloads using Spark and Airflow.
- Master Kubernetes: Develop and operate microservices on Kubernetes, ensuring reliability, scalability, and efficient resource utilization.
- Scale Distributed Systems: Build and enhance systems for orchestration, scheduling, monitoring, and lifecycle management of large-scale data pipelines.
- Lead Technical Decisions: Drive design discussions with a focus on performance, scalability, and resiliency.
- Own the Lifecycle: Take full ownership of features end-to-end: from initial design and development to testing, deployment, and production support.
- Mentor & Advocate: Guide junior engineers and champion engineering best practices across the organization.
We're excited about you if you have:
- 5+ years of experience designing and building distributed, scalable systems in production environments.
- Kubernetes Mastery (Mandatory): Strong, hands-on experience designing and operating containerized workloads, with a deep understanding of scheduling, autoscaling, and networking.
- Backend Proficiency: Strong fundamentals in data structures and algorithms with proficiency in Java or Golang.
- Cloud Expertise: Proven experience with at least one major cloud platform (AWS or Azure).
- Data Intensity: Experience building or operating data-intensive applications or large-scale platforms.
- Systems Thinking: The ability to troubleshoot complex production issues and improve the observability of large-scale systems.
You may also have:
- Big Data Ecosystem: Experience with Apache Spark, Airflow, or Hive.
- Modern Dev Tools: Experience leveraging AI-assisted tools (e.g., Claude Code, Cursor, Copilot) to improve productivity and code quality.
- Observability: Familiarity with tools like Prometheus and Grafana.
- Open Source: Contributions to big data or cloud-native open-source ecosystems.
- AI/ML: Exposure to AI/ML pipelines or infrastructure.
What you can expect from us:
- Generous PTO Policy
- Support work life balance with Unplugged Days
- Flexible WFH Policy
- Mental & Physical Wellness programs
- Phone and Internet Reimbursement program
- Access to Continued Career Development
- Comprehensive Benefits and Competitive Packages
- Paid Volunteer Time
- Employee Resource Groups
EEO/VEVRAA
