Skills Required6+ years(6 year) of professional software engineering mostly focused on the following:
- Developing ETL pipelines involving big data.
- Developing data processinganalytics applications primarily using PySpark.
- Experience of developing applications on cloud(AWS) mostly using services related to storage, compute, ETL, DWH, Analytics and streaming.
- Clear understanding and ability to implement distributed storage, processing and scalable applications.
- Experience of working with SQL and NoSQL database.
- Ability to write and analyze SQL, HQL and other query languages for NoSQL databases.
- Proficiency is writing disitributed & scalable data processing code using PySpark, Python and related libraries.ValidationStart Date ValidatedJob DescriptionWhat you'll do
- Develop low level design as per approved Tech Specification or equivalent inputs provided.
- Build and deliver technology deliverables as per Tech Specifications/low level design or equivalent inputs.
- Build and delivery technology deliverables compliant with functional requirements.
- Build and deliver technology deliverables in accordance with the best practices to ensure compliance with non-functional aspects like scalability, maintainability, performance etc.
- Process technology deliverables through full development lifecycle.
- Maintain and support existing solutions and technology frameworks.
- Attend regular scrum events of equivalent and provide update on the deliverables.
- Work independently with none or minimum supervision. Skills: aws,data engineer,pyspark
