Freelance Senior AWS Data Engineer

Company Description

ThreatXIntel is a growing Cybersecurity, IT Staffing, and Consulting company delivering end-to-end technology and security solutions. Our services include cloud security, web and mobile application security testing, DevSecOps, vulnerability assessments, IT consulting, and professional staffing services.

We support global corporate clients by hiring and deploying skilled professionals across IT and cybersecurity domains while helping organizations strengthen security, optimize operations, and scale efficiently. ThreatXIntel is committed to enabling business growth through secure, reliable, and high-quality technology solutions.

Role Overview

We are seeking a highly skilled AWS Data Engineer with strong expertise in AWS data services, data pipeline development, and big data processing.

The consultant will design, develop, and optimize scalable data pipelines using AWS-native technologies while supporting enterprise analytics and data platform initiatives.

Key Responsibilities

• Design and build scalable data pipelines using AWS services.
• Develop ETL/ELT workflows using:
• AWS Glue
• Amazon Redshift
• Apache Airflow
• Implement infrastructure automation using AWS CDK.
• Develop data processing solutions using:
• Python
• PySpark
• SQL
• Optimize data ingestion, transformation, and loading processes.
• Work with large datasets and distributed data processing frameworks.
• Monitor and troubleshoot pipeline performance and failures.
• Implement best practices for data quality, governance, and security.
• Collaborate with analytics, BI, and platform engineering teams.
• Support deployment, testing, and production operations.

Mandatory Skills

• 7+ years of Data Engineering experience
• Strong hands-on experience with:
• AWS Glue
• Amazon Redshift
• Apache Airflow
• AWS CDK
• Advanced SQL development skills
• Strong programming experience in Python and PySpark
• Experience building production-grade ETL pipelines
• Knowledge of cloud data architecture and distributed systems

Preferred Skills

• Data Lake architecture experience
• AWS IAM and security concepts
• CI/CD for data pipelines
• Performance tuning in Redshift
• Infrastructure as Code experience