AWS,Scala,Pyspark,Python Expert

Key Responsibilities

• Design, build, and maintain scalable data pipelines and data platforms on AWS cloud

• Develop and optimize data processing workflows using Databricks, PySpark, and Scala

• Implement and manage data ingestion, transformation, and storage solutions for large-scale systems

• Work with SQL for data extraction, transformation, and analysis across complex datasets

• Build and support cloud-based data architectures aligned with modern best practices

• Implement event-driven data processing architectures for real-time and batch use cases

• Collaborate with data analysts, data scientists, and engineering teams to support data requirements

• Ensure data quality, performance optimization, and system reliability across platforms

• Develop reusable and efficient code for scalable data processing solutions

• Support data visualization and analytics requirements for business insights

• Work with distributed systems handling large volumes of structured and unstructured data

• Troubleshoot and resolve data pipeline and platform issues in production environments