Qualifications for Data Engineer:
- 3+ Years of experience in building and optimizing big data solutions required to fulfill business and technology requirements.
- 3+ years of technical expertise in areas of design and implementation using big data technology Hadoop, Hive, Spark, Python/Java.
- Strong analytic skills to understand and create solutions for business use cases.
- Ensure best practices to implement data governance principles, data quality checks on each data layer.
- A successful history of manipulating, processing and extracting value from large disconnected datasets.
- Working knowledge of message queuing, stream processing, and highly scalable big data data stores.
- Strong project management and organizational skills.
- Experience supporting and working with cross-functional teams in a dynamic environment.
- We are looking for a candidate with 3+ years of experience in a Data Engineer role, who has attained a Graduate degree in B.Tech/B.E.
They should also have experience using the following software/tools
- :Experience with big data: Hadoop, Map Reduce, Hive, Spark, Kafka, Airflow etc
- .Experience with relational SQL and NoSQL databases: MySQL, Postgres, MongoDB, HBase, Cassandra etc
- .Experience with cloud Data platform: AWS, Azure-HDInsight's, GCP, CDP
- .Experience with real-time data processing: Storm, Spark-Streaming etc
- .Experience with object-oriented/object function scripting languages: Java, Python, Scala, etc
.
