Job description:
Job Title: Data Engineer (Pyspark) with AI
Location: Bangalore
Experience Range: 6 - 10 yrs
Required skill:
- Minimum 5 years of PySpark Development experience, especially in Spark SQL and Complex Transformations
- Minimum 3 years of Python development experience
- Minimum 2 years of experience in ADF
- Strong design and data solutioning skills
- Good command and hands-on experience in Python
- Database skills- Oracle, Postgres, SQL Server any one database experience, Oracle PL/SQL or T-SQL experience, Data modelling
- Experience working with following concepts, packages, and tools, Object oriented and functional programming, NumPy, Pandas, Matplotlib, requests, pytest, Jupyter, PyCharm and IDLE, Conda and Virtual Environment
Good-to-Have
- Understanding and experience in Azure Synapse Analytics is a double plus
- Understanding of Hadoop ecosystem working experience is a plus
- NLTK, Scikit-learn, TensorFlow, Keras is a plus
