Senior Data Engineer

Job Title: Senior Data Engineer

Job type: Full time

Work Mode: Somajiguda,Hyderabad (Onsite)

Shift Timings: 3:00 PM – 12:00 AM IST

We are seeking an experienced Senior AWS Data Engineer to design, build, and maintain scalable data infrastructure and pipelines. This role requires close collaboration with data scientists, developers, and business stakeholders to ensure high data availability, quality, and reliability across the organization.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines to ingest, process, and store large volumes of data from multiple sources.
• Implement and manage ETL (Extract, Transform, Load) processes to convert raw data into structured, analytics-ready formats.
• Integrate data from diverse sources including databases, APIs, third-party systems, and data warehouses.
• Ensure data consistency, integrity, and reliability across various data platforms.
• Design, manage, and optimize databases, data warehouses, and data lakes.
• Write and optimize complex SQL queries, including joins across multiple databases and tables.
• Implement data quality checks, validation rules, and monitoring mechanisms.
• Troubleshoot and debug data pipeline issues to ensure uninterrupted data flow.
• Collaborate with data scientists, developers, and business stakeholders to gather requirements and deliver data solutions.
• Document data pipelines, workflows, and technical processes.
• Establish and enforce data engineering best practices, including coding standards, version control, and testing.

Required Qualifications

• Bachelor's degree in computer science, Engineering, Information Technology, or a related field (Master's degree is a plus).
• 7+ years of experience in Data Engineering, Software Development, or related roles.
• Strong experience with data warehousing solutions such as:
• Amazon Redshift
• Google BigQuery
• Hands-on experience with ETL tools and frameworks such as:
• Apache Airflow
• Apache NiFi
• Talend
• Informatica
• Proficiency in SQL and relational databases (PostgreSQL, MySQL, SQL Server).
• Programming experience in Python/Pyspark.
• Familiarity with big data technologies like Hadoop, Spark, and Kafka.
• Strong understanding of data modeling and database design principles.
• Excellent problem-solving, analytical, and communication skills.
• Ability to manage multiple priorities in a fast-paced environment.