Senior Data Engineer

Summary:

The Senior Data Engineer will be responsible for the design, implementation, and operation of Aurora PostgreSQL databases supporting data engineering workloads. This role ensures performance, reliability, scalability, security, and compliance of the database systems while supporting data engineering enablement and operational excellence.

Responsibilities:

• Aurora PostgreSQL Administration:
  • Own the design, implementation, and operation of Company Aurora PostgreSQL databases supporting data engineering workloads.
  • Define, review, and evolve database schemas, data models, and access patterns optimized for downstream consumption.
  • Be accountable for database lifecycle activities including provisioning, upgrades, patching, backups, and high availability.
  • Ensure consistent standards and configurations across Dev, Non Prod, and Prod environments.
• Performance, Reliability & Scalability:
  • Take responsibility for database performance tuning, including query optimization, indexing strategies, and connection management.
  • Monitor database health, capacity, and growth trends, and proactively drive scaling and optimization activities.
  • Design, validate, and maintain high availability and disaster recovery strategies using native Aurora capabilities.
• Security, Governance & Compliance:
  • Own implementation of secure, least privilege access models and role based controls for database access.
  • Enable and maintain audit logging and integrations with centralized SOC platforms.
  • Ensure databases comply with organizational security standards and regulatory requirements (e.g., GDPR).
  • Act as a key technical contributor during SOC reviews, audits, and security investigations.
• Data Engineering Enablement:
  • Work to support and optimize ETL/ELT pipelines, batch and near real time ingestion workloads.
  • Provide guidance on data access patterns, schema evolution, and performance best practices.
  • Support integrations with platforms such as Databricks, S3 based data pipelines, and analytics tools.
• Automation & Operational Excellence:
  • Drive automation of routine operational and database tasks using scripts, AWS native services, Infrastructure as Code, and AI assisted tools to streamline repetitive activities such as performance analysis, log review, and incident investigation.
  • Own troubleshooting and resolution of complex data platform issues, including participation in on call rotations and production support.
  • Create, maintain, and continuously improve runbooks, SOPs, and operational documentation for data platforms.

Requirements:

• 6 years of strong experience as a Senior Data Engineer with deep hands on expertise in Company Aurora PostgreSQL.
• Advanced PostgreSQL knowledge (query optimization, indexing, vacuuming, replication concepts).
• Experience owning and supporting data intensive platforms in production environments.
• Solid understanding of AWS services related to data platforms (Aurora/RDS, IAM, CloudWatch, S3).
• Proven ability to independently troubleshoot and resolve complex production issues.

Required Skills:

• Experience with Client Aurora MySQL and MongoDB Atlas.
• Familiarity with Databricks or similar analytics/lakehouse platforms.
• Understanding of modern data engineering patterns (ETL/ELT, batch vs streaming).
• Working knowledge of AI/ML concepts.
• Experience in regulated industries such as fintech, payments, or financial services.

Preferred Skills:

• Experience with Infrastructure as Code tools (Terraform, CloudFormation).
• Exposure to CI/CD practices for data platforms.

#AditiConsulting
# 26-02989