Lead Data Engineer
Job Description
In-depth working experience of distributed systems Hadoop, Spark, Hive, DBT and Airflow/Dagster
At least 5 years of solid production quality coding experience in data pipeline implementation in Python
Experience working with public cloud platforms, preferably AWS
Experience working with Databricks and/or Snowflake
Experience in Git, JIRA, Jenkins, shell scripting
Familiarity with Agile methodology, test-driven development, source control management and test automation
Experience supporting and working with cross-functional teams in a dynamic environment
You have excellent collaborative problem solving and communication skills and are empathetic to others
You have a track record of building fast, reliable, and high-quality data pipelines
At least 5 years of solid production quality coding experience in data pipeline implementation in Python
Experience working with public cloud platforms, preferably AWS
Experience working with Databricks and/or Snowflake
Experience in Git, JIRA, Jenkins, shell scripting
Familiarity with Agile methodology, test-driven development, source control management and test automation
Experience supporting and working with cross-functional teams in a dynamic environment
You have excellent collaborative problem solving and communication skills and are empathetic to others
You have a track record of building fast, reliable, and high-quality data pipelines
More Info
About Company
Skills:
Csv, Pyspark, Json, ELT, Git, Docker, MongoDB, Advanced Sql, Rest Apis, Kubernetes, Python, Etl, OLAP engines
Interesting Job Opportunity: Calfus Inc - Senior/Lead Data Engineer - ETL/Data Warehousingcalfus inc.
Skills:
snowflake , Power Bi, Tableau, Redshift, Sql, ELT, Azure Data Factory, Postgres, Databricks, Python, Aws S3, Etl
Skills:
Java, Metadata Management, Scala, Sql, Apache Airflow, Kinesis, MLops, Gcp, Apache Kafka, Spark, Data Governance, Azure, Python, AWS, data quality frameworks, Flink, Prefect, dbt
Skills:
Data Lineage, Typescript, Javascript, Python, Pipeline Builder, Palantir Foundry, Ontology Modeling, React OSDK, Code Repositories
Skills:
snowflake , Etl, Sql, ELT, Data Modeling, Data Governance, Postgres, AWS, Bi Tools, Hl7, Git, Redshift, FHIR