Wea are hiring for Sr. Data Engineer for Bangalore location. We are looking that candidate should have strong experience in Bigdata, Hadoop, Hive, Hdfs, Spark, Pyspark & Python, Dataframes & SQL. If you are good in all the skill set please share your resume at [Confidential Information]
Required Skills-
- Strong experience working with the Apache Spark framework, including a solid grasp of core concepts, performance optimizations, and industry best practices
- Proficient in PySpark with hands-on coding experience; familiarity with unit testing, object-oriented programming (OOP) principles, and software design patterns
- Experience with code deployment and associated processes
- Proven ability to write complex SQL queries to extract business-critical insights
- Hands-on experience in streaming data processing
- Familiarity with machine learning concepts is an added advantage
- Experience with NoSQL databases
- Good understanding of Test-Driven Development (TDD) methodologies
- demonstrated flexibility and eagerness to learn new technologies
- Design and implement solutions for problems arising out of large-scale data processing
- Attend/drive various architectural, design and status calls with multiple stakeholders
- Ensure end-to-end ownership of all tasks being aligned including development, testing, deployment and support
- Design, build & maintain efficient, reusable & reliable code
