Job Description
Job Summary We are seeking an experienced Python Developer with deep expertise in workflow orchestration, cloud-native data pipelines, and AWS services. The ideal candidate will design, develop, and maintain scalable data processing solutions using Python, Apache Airflow, and AWS technologies. This role requires strong software engineering skills, cloud architecture knowledge, and e, production-grade data platforms. Key Responsibilities Design, develop, and maintain scalable data pipelines and workflow orchestration solutions using Apache Airflow. Develop high-quality, reusable, and maintainable Python applications and libraries. Build and optimize ETL/ELT pipelines for large-scale data processing. Design cloud-native architectures leveraging AWS services. Implement workflow scheduling, monitoring, alerting, and recovery mechanisms. Integrate data from multiple sources, APIs, databases, and enterprise systems. Optimize application and pipeline performance, scalability, and reliability. Implement automated testing, code reviews, and CI/CD best practices. Required Qualifications Bachelor's or Master's degree in Computer Science, Engineering, Information Technology, or a related field. 6+ years of professional software development experience with Python. 3+ years of hands-on experience with Apache Airflow. Strong experience with AWS cloud services. Technical Skills Python Advanced Python programming Object-Oriented Design Multithreading and Multiprocessing Exception Handling Apache Airflow DAG Development Custom Operators and Hooks Sensors and Scheduling AWS Services Amazon S3 AWS Lambda Amazon EC2 Databases & Data Technologies SQL and Query Optimization PostgreSQL MySQL DevOps & Cloud Docker Kubernetes CI/CD Pipelines Preferred Qualifications Experience with
Apache Spark Databricks dbt AWS certification such as
AWS Certified Solutions Architect AWS Certified Developer Experience with data governance, security, and compliance frameworks. Knowledge of event-driven and microservices architectures.Key Competencies Solution Design and Architecture Cloud-Native Development Data Engineering Workflow Automation Performance Optimization Problem Solving Technical Leadership Stakeholder Management Collaboration and Mentoring This role is ideal for a highly skilled Python professional who can combine software engineering excellence with expertise in Apache Airflow and AWS to build robust, scalable, and secure cloud-based data platforms.
