Data Engineer
Job Description
Role: Data Engineer
Experience: 4+ years
Work Location: Chennai
Notice Period: 0-15 days
Job Description:
- PySpark: Advanced proficiency in PySpark, including working with RDDs, DataFrames, and optimization techniques.
- Cloudera Data Platform: Strong experience with Cloudera Data Platform (CDP) components, including Cloudera Manager, Hive, Impala, HDFS, and HBase.
- Data Warehousing: Knowledge of data warehousing concepts, ETL best practices, and experience with SQL-based tools (e.g., Hive, Impala).
- Big Data Technologies: Familiarity with Hadoop, Kafka, and other distributed computing tools.
- Orchestration and Scheduling: Experience with Apache Oozie, Airflow, or similar orchestration frameworks.
- Scripting and Automation: Strong scripting skills in Linux.
More Info
Key Skills
Orchestration and Scheduling
Scripting and Automation
Cloudera Data Platform
About Company
Skills:
Pyspark, Azure Data Factory, Azure Functions, Azure Databricks, Sql, Synapse, ADLS, Databricks notebooks using Python
Skills:
snowflake , Informatica, Data Warehousing, Redshift, Databricks, Talend, Python, Etl, Aws S3, Airflow, AWS EMR, Luigi, Business intelligence, Azkaban, Athena
Skills:
Azure Data Lake Storage (ADLS), Pyspark, Apache Spark, Python, Sql, Git, Azure Data Factory, Power Bi, Azure Synapse Analytics, Databricks, Azure DevOps, Fabric Lakehouse, OneLake, Delta Lake, Fabric Data Factory Data Pipelines, Microsoft Fabric, Microsoft Purview, ETL ELT concepts, Real-time streaming data, CI CD
Skills:
Python, Sql, Hadoop, Spark, Data Warehousing, Etl, Machine Learning, Data Modeling, Cloud Computing, Api Development