Data Engineer
- Posted 4 hours ago
- Be among the first 10 applicants
Job Description
Data Engg Job description:
Experience and expertise in
- Pipeline/ETL (Extract, Transform, Load) processes, API integration, scripting languages (Python), and big data technologies (Trio, Iceberg, DuckDB/Parquet).
- Database design, data modeling, and data warehousing. SQL and at least one cloud platform.
- Analytical tools (Superset, Power BI), statistical analysis, and SQL. To derive insights from data.
- Data governance principles and data quality.
- Data management, data integration projects using IPAAS tools like IBM Sterling, Mulesoft, Dell Boomi
Location-Bangalore/Pune
Experience-5-10 yrs
More Info
Key Skills
data governance principles
Parquet
Trio
IPAAS tools
Iceberg
DuckDB
Superset
About Company
Skills:
Google Cloud Platform (GCP), BigQuery, Hadoop Ecosystem, Scala, Apache Spark, Kafka, Data Modeling, Dataproc, Big Data Technologies, Cloud Storage, DataFlow, Etl, Airflow, ELT frameworks, Pub/Sub, Pipeline orchestration
Skills:
Data Quality (DQ) rules, Metadata Management, Unix, Databricks, Python, Data lineage techniques, Master data management, Data modeling methodologies, Big Data storage architecture
Skills:
Workflows, Apis, Cloudformation, Pyspark, Sql, Devops, MLops, Terraform, Spark, Databricks, Azure, Python, AWS, Databricks Lakehouse, dbt
Skills:
data engineering , snowflake , Data Modeling, Sql, ELT, Apache Airflow, Git, Data Warehousing, Python, Etl, AWS, CI CD, dbt, Cloud Data Platforms
Skills:
Data Modeling, Redshift, Sql, ELT, Jenkins, Python, AWS, Etl, Airflow, SageMaker, GitHub Actions, dbt, Dagster, CI/CD