T
Data Engineer
T
- Posted 3 hours ago
- Be among the first 10 applicants
Job Description
EXP: 4 to 10 year
Job description
Responsibilities:
- Data Solution Development: Design, develop, and optimize data solutions using Databricks, Spark, and related technologies.
- Data Engineering: Develop and maintain data pipelines, data lakes, and data warehouses using Databricks, Delta Lake, and other tools.
- Data Science: Collaborate with data scientists to deploy machine learning models and optimize data science workflows.
- Performance Optimization: Optimize Spark jobs, Databricks notebooks, and data pipelines for performance and scalability.
- Collaboration: Work with cross-functional teams to identify and prioritize project requirements, provide technical guidance, and ensure data quality
Required Skills:
- Databricks: In-depth knowledge of Databricks, Spark, Delta Lake, and related technologies.
- Programming: Strong programming skills in Python, Scala, or Java.
- Data Engineering: Experience with data engineering, data warehousing, and ETL tools.
- Expertise in SQL, Unity Catalogue, Workflows/Jobs
- Data Science: Experience with data science, machine learning, and statistical modeling.
- Communication: Excellent communication and collaboration skills
More Info
About Company
Skills:
data engineering , Data Modeling, Bi Tools, Scala, Data Warehousing, Data Analytics, Python, Sql, Data security practices, ETL tools and frameworks
Skills:
data engineering , Pyspark, Scala, Emr, Redshift, Sql, Lambda, Git, Kinesis, Spark, Python, AWS, Step Functions, Glue
Skills:
snowflake , Github, Power Bi, Python, Sql, Kubeflow
Skills:
Azure Data Factory, Informatica, Talend, Sql, ETL tools and frameworks
Skills:
snowflake , S3, Erp, PostgreSQL, ELT, Lambda, Ec2, Data Modelling, Oracle, Python, AWS, Sql, Jenkins, Git, Iam, Etl, Infrastructure-as-code, Data quality and monitoring frameworks, Data warehouse design, rbac, dbt, Dagster, CI/CD, Tms, Wms