Search by job, company or skills

Senior Data Engineer

Senior Data Engineer

WishLink
4-6 Years
Not Disclosed
Early Applicant
  • Posted a month ago
  • Be among the first 30 applicants

Job Description

Responsibilities

  • Watch Reels and YouTube videos every day and level up on your fashion sense.
  • Develop and optimize ETL workflows using Spark within our Databricks/Delta Lake Lakehouse following Medallion architecture.
  • Work with cloud analytics and ML platforms, including BigQuery, Athena, EMR, and SageMaker.
  • Manage ingestion and integration using Airbyte.
  • Enable downstream analytics and reporting through well-modeled datasets for tools like Power BI.
  • Write maintainable and scalable code, and know when to trade code quality for faster delivery
  • Communicate with both technical and non-technical teams to identify and solve roadblocks in advance.
  • Suggest and implement 10x improvements in the current systems that technology can enable.
  • Solve new business problems using technology every day.

Requirements

  • If you are a content creator yourself or have worked closely in the social media space, we like you already: )
  • Business-oriented problem-solving mindset.
  • Willing to work in a fast-paced startup environment and follow Agile practices.
  • 4+ years of software engineering experience. At least 2 years of experience in building data pipelines.
  • Willingness to learn new stacks and technologies to solve new business problems.
  • Proficient in using Linux-based systems (any of Ubuntu/CentOS/MacOS/etc. ) and Bash.
  • Proficient and experienced in using Git for collaborative development.
  • Aware of common design patterns, good coding, and documentation practices.
  • Above everything, willing to learn continuously and keep improving.

This job was posted by Rajshree Bisht from Wishlink.

More Info

Job Type:
Industry:
Function:
Employment Type:

Key Skills

Databricks Delta Lake

Airbyte

SageMaker

Linux-based systems

Athena

ETL workflows

Medallion architecture

About Company

Similar Jobs

5-10 yrs
Noida, India
Skills:
S3, Github, Pyspark, Lambda, Ec2, Kinesis, Docker, Shell scripting, Python, AWS, Scala, Redshift, Sql, Git, Kubernetes, GenAI, Airflow, AI coding assistants, LLM tools, RAG pipelines, LangChain, prompt engineering, dbt, Glue, LlamaIndex
5-7 yrs
Gurugram, India, Gurugram
Skills:
Databricks, Python, Sql, Orchestration, cloud-based data platforms, CI CD, data pipeline development, ETL ELT workflows
5-10 yrs
Gurugram, India
Skills:
S3, Hadoop, Pyspark, PostgreSQL, Scala, Apache Spark, Svn, Autosys, Sql, HTML, Git, Hive, Elasticsearch, Databricks, Python, Unix Shell Scripting, Airflow, AWS EMR, ETL pipelines
4-10 yrs
Gurugram, Gurugram, India
Skills:
bigtable , BigQuery, Performance Tuning, Hadoop Ecosystem, Pyspark, Apache Spark, Data Modeling, Dataproc, Sql, ELT, Data Integration, DataFlow, Python, Etl, Cloud Functions, Optimization of large-scale data processing workloads, Cloud Composer, Google Cloud Storage, Pub/Sub
5-8 yrs
Gurugram, Gurugram, India
Skills:
Pyspark, Sql, Azure ML, Azure Synapse, Azure Data Factory, Databricks, Azure DevOps, FiveTran, GCP Cloud Composer, Vertex AI, GCP BigQuery, GCP Cloud Run, GCP DLP