Search by job, company or skills

Senior Data Engineer

  • Posted 10 hours ago
  • Be among the first 10 applicants

Job Description

Job Description:

  • 5+ years building production data pipelines in Python, owning them end to end (ingestion → transformation → serving), not just authoring queries or notebooks.
  • Expert Python for data engineering 
  • Cloud data-warehouse experience and comfortable with spinning infrastructure as code
  • Distributed batch processing - hands-on experience designing large-scale data-parallel pipelines and reasoning about memory, shuffles and windowing
  • Containerization & CI/CD -Docker, automated test gates and a branch-based deploy model.
  • Data correctness discipline - idempotent pipelines, deterministic deduplication, stable key generation and the judgment to not break downstream data.

Good- to -have:

  • ML/NLP engineering - fine-tuning and serving text-classification models, plus orchestrating LLM calls in production (rate limiting, backoff, concurrency, cost/latency tradeoffs).
  • RAG / vector search - embeddings, vector databases and serving them behind an API.
  • MLOps - model training pipelines, labeling workflows and evaluation harnesses.

More Info

Job Type:
Industry:
Employment Type:

About Company

Job ID: 151567475

Similar Jobs

Remote

Skills:

data engineering PythonEtl ProcessPysparkSparkSqlAzure CloudGitTerraformMicrosoft FabricETL Developerbicep

Remote

Skills:

GithubPythonAws