
Search by job, company or skills
Skill Strong Python + Spark Developer with strong experience in SQL.
Experience 4 8 yrs
Notice Period Immediate to 30 days
Location is Chennai, Pune, Bangalore, Hyderabad
Job Description:
At least 3 to 5 years of development work experience in Hadoop programming (HDFS) using pyspark/Hive based Data warehouse projects and, with good Shell Scripting experience.
- Experience in Big Data technologies including Pyspark, Hive and Hadoop.
- Experience in Pyspark programming languages
- You have a good understanding of organizational strategy, architecture patterns (Microservices, Event Driven) and technology choices and coaching the team in execution in alignment to these guidelines.
- You can apply organizational technology patterns effectively in projects and make recommendations on alternate options.
- You have hands-on experience working with large volumes of data including different patterns of data ingestion, processing (batch & real-time), movement, storage and access (for both internal and external to BU) and ability to make independent decisions within scope of project.
- You have a good understanding of data structures and algorithms.
- You can test, debug, and fix issues within established SLAs.
- You can design software that is easily testable and observable.
- You understand data access patterns, streaming technology, data validation, data performance, cost optimization.
- Strong SQL skills
Job ID: 145310621