Essential Responsibilities:
Desired Characteristics
- Minimum 7 years of software engineering experience.
- Proven long term experience and enthusiasm for distributed data processing at scale, eagerness to learn new things.
- Expertise in designing and architecting distributed low latency and scalable solutions in either cloud and on premises environment.
- Exposure to the whole software development lifecycle from inception to production and monitoring
- Fluency in Python or solid experience in Scala, Java
- Proficient with relational databases and Advanced SQL
- Expert in usage of services like Spark, HDFS, Hive, HBase
- Experience in adequate usage of any scheduler such as Apache Airflow, Apache Luigi, Chronos etc.
- Experience in adequate usage of cloud services (AWS) at scale
- Experience in agile software development processes
- Excellent interpersonal and communication skills
Nice To Have
- Experience with large scale / multi-tenant distributed systems
- Experience with columnar / NoSQL databases Vertica, Snowflake, HBase, Scylla, Couchbase
- Experience in real team streaming frameworks Flink, Storm
- Experience with web frameworks such as Flask, Django
