Search by job, company or skills

Senior Data Engineer

Early Applicant
  • Posted a month ago
  • Be among the first 30 applicants

Job Description

Responsibilities

  • Watch Reels and YouTube videos every day and level up on your fashion sense.
  • Develop and optimize ETL workflows using Spark within our Databricks/Delta Lake Lakehouse following Medallion architecture.
  • Work with cloud analytics and ML platforms, including BigQuery, Athena, EMR, and SageMaker.
  • Manage ingestion and integration using Airbyte.
  • Enable downstream analytics and reporting through well-modeled datasets for tools like Power BI.
  • Write maintainable and scalable code, and know when to trade code quality for faster delivery
  • Communicate with both technical and non-technical teams to identify and solve roadblocks in advance.
  • Suggest and implement 10x improvements in the current systems that technology can enable.
  • Solve new business problems using technology every day.

Requirements

  • If you are a content creator yourself or have worked closely in the social media space, we like you already: )
  • Business-oriented problem-solving mindset.
  • Willing to work in a fast-paced startup environment and follow Agile practices.
  • 4+ years of software engineering experience. At least 2 years of experience in building data pipelines.
  • Willingness to learn new stacks and technologies to solve new business problems.
  • Proficient in using Linux-based systems (any of Ubuntu/CentOS/MacOS/etc. ) and Bash.
  • Proficient and experienced in using Git for collaborative development.
  • Aware of common design patterns, good coding, and documentation practices.
  • Above everything, willing to learn continuously and keep improving.

This job was posted by Rajshree Bisht from Wishlink.

More Info

Job Type:
Industry:
Function:
Employment Type:

About Company

Job ID: 141019327

Similar Jobs

Gurugram, India

Skills:

Data ModelingSqlSparkData IntegrationPythondata pipeline developmentOneLakeschema managementdata quality frameworksReconciliationincremental processingPipelinesNotebookspartitioningperformance optimizationLakehouse architectureMicrosoft FabricAzure data servicesValidation

Gurugram, India

Skills:

GithubTableauDatabricksDataprocInformaticaPythonSqlAirflowDataformGoogle BigQuery

Noida, India

Skills:

KubernetesApache SparkHadoopNumpyPysparkKafkaPandasAWSNode.jsFastAPIAzureDockerFlaskData ModelingMilvusLlamaIndexGenAI LLMsPython EcosystemDatabricks Delta LakeLangChainPinecone

Remote

Skills:

Data EngineerPythonSqlPandasBigQueryEtlDockerPolar

Gurugram, Gurugram, India

Skills:

snowflake Apache AirflowPysparkAmazon KinesisApache KafkaPythonSqlDelta Lake on DatabricksData Quality ValidationDatabricks Workflows

Beware of Scammers

We don’t charge money for job offers