Search by job, company or skills

Senior Data Engineer

Senior Data Engineer

Celebal
4-6 Years
Not Disclosed

This job is no longer accepting applications

Job Description

About the Role:

We are seeking a highly skilled and motivated Senior Data Engineer to join our growing data team. You will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support analytics, machine learning, and business intelligence initiatives.

Key Responsibilities:-

Design, develop, and maintain robust, scalable, and efficient data pipelines using tools like Apache Spark, Airflow, or similar.-

Collaborate with data scientists, analysts, and software engineers to understand data needs and deliver high-quality data solutions.-

Optimize data systems for performance, scalability, and reliability.-

Implement data quality checks, monitoring, and alerting systems.-

Work with structured and unstructured data from various sources (APIs, databases, cloud storage).-

Ensure data security, compliance, and governance best practices.-

Mentor junior engineers and contribute to team knowledge sharing.

Required Qualifications:-

Bachelor·s or Master·s degree in Computer Science,

Engineering, or a related field.-

4+ years of experience in data engineering or a similar role.-

Proficiency in SQL and at least one programming language (Python, Scala, or Java).-

Experience with big data technologies (e.g., Hadoop, Spark, Kafka).-

Hands-on experience with cloud platforms (AWS, GCP, or Azure).-

Familiarity with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery).-

Strong understanding of ETL/ELT processes and data modeling.

Preferred Qualifications:-

Experience with orchestration tools like Apache Airflow or Prefect.-

Knowledge of CI/CD practices and infrastructure as code (e.g., Terraform).-

Exposure to machine learning pipelines and MLOps.-

Excellent problem-solving and communication skills.

Why Join Us

- Opportunity to work on cutting-edge data technologies.-

Collaborative and inclusive team culture.-

Competitive compensation and benefits.-

Flexible work environment

More Info

Job Type:
Industry:
Employment Type:

About Company

Similar Jobs

7-9 yrs
Bengaluru, India
Skills:
Pyspark, AWS Glue, Data Modeling, Emr, Avro, Autosys, Sql, Cloudwatch, Terraform, Etl Tools, Databricks, Python, AWS, Airflow, Parquet, AWS Lake Formation, Iceberg
5-10 yrs
Bengaluru, India
Skills:
Power Bi, Pyspark, Agile Scrum, Tableau, Databases, Git, Data Warehousing, Informatica Powercenter, Python, Airflow, Data Lake concepts, Advanced SQL and performance tuning, IICS, dbt, CI/CD
6-10 yrs
Bengaluru, India
Skills:
BigQuery, Apache Flink, Pyspark, Kafka, Sql, Hive, Spark, Python, Apache Iceberg, dbt, Delta Lake, Apache Hudi
8-12 yrs
Bengaluru, India
Skills:
snowflake , Github, Data Modeling, Buildkite, Cloudformation, Sql, Apache Airflow, Jenkins, Git, Terraform, Data Warehousing, Python, Azure DevOps, Infrastructure as Code, AWS Cloud Services, CI/CD Pipelines, GitHub Actions, dbt, AWS IAM Security and Monitoring
5-7 yrs
Bengaluru, India
Skills:
data engineering , snowflake , Data Modeling, Sql, Python, AWS, Etl