We are looking for an experienced
Senior Data Engineer with strong expertise in
AWS, Amazon Redshift, Python, and SQL to design, build, and optimize scalable data engineering solutions. The ideal candidate will have hands-on experience in developing enterprise-grade data warehouses, building robust ETL/ELT pipelines, integrating data from APIs, and ensuring high-quality, reliable data for business reporting and analytics.
You will work closely with cross-functional teams to deliver scalable data solutions, automate data workflows, and support business decision-making through efficient and reliable data platforms.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using AWS services and Python.
- Build, optimize, and manage enterprise data warehouses using Amazon Redshift.
- Develop and maintain automated data ingestion processes from REST APIs and third-party platforms.
- Create and optimize SQL queries, stored procedures, and data transformation logic.
- Design and implement batch and real-time data processing pipelines.
- Monitor data pipelines, troubleshoot failures, and resolve production issues.
- Implement data quality checks, validation frameworks, and reconciliation processes.
- Optimize Redshift performance through query tuning, distribution styles, sort keys, and maintenance activities.
- Collaborate with business stakeholders to understand reporting and analytics requirements.
- Develop reusable, scalable, and well-documented data engineering solutions.
- Mentor junior engineers and promote engineering best practices.
- Participate in Agile ceremonies, code reviews, and deployment activities.
Required Skills
- 7+ years of experience in Data Engineering.
- Strong hands-on experience with AWS Cloud and Amazon Redshift.
- Expertise in designing and maintaining enterprise data warehouses.
- Advanced SQL skills, including query optimization, window functions, indexing, and performance tuning.
- Strong Python programming experience with libraries such as Pandas and NumPy.
- Experience building ETL/ELT pipelines for large-scale data processing.
- Hands-on experience integrating data using REST APIs.
- Experience working with both batch and real-time data pipelines.
- Strong understanding of data quality, validation, and monitoring frameworks.
- Experience troubleshooting production data pipeline issues.
- Familiarity with Agile development methodologies.
- Excellent analytical, problem-solving, and communication skills.
Preferred Skills
- Experience with AWS Glue, Lambda, S3, CloudWatch, and IAM.
- Knowledge of BigQuery or other cloud data warehouse platforms.
- Experience with Apache Airflow or similar workflow orchestration tools.
- Familiarity with Flask or other Python web frameworks.
- Experience with advertising platform APIs such as Google Ads, Facebook Ads, or DV360.
- Exposure to dashboarding tools such as Power BI or Tableau.
Qualifications
- Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
- Relevant AWS certifications are an added advantage.
What We Offer
- Opportunity to work on large-scale cloud data engineering projects.
- Exposure to modern cloud technologies and enterprise data platforms.
- Collaborative and innovative work environment.
- Career growth and learning opportunities.
- Competitive compensation and benefits.
Skills: aws,sql,python
