Job Description
Job Description
Python, ETL, EDA, and DataLake development AWS eco systems from EC2, to Athena SQL Cribl and cyber security data analytics Design, Build, and Maintain ETL Pipelines: Develop robust, efficient ETL processes using Python for diverse data sources and third-party integrations. - Exploratory Data Analysis (EDA): Conduct EDA to drive insights, optimize data models, and support machine learning initiatives. - DataLake Architecture: Architect and optimize DataLake solutions leveraging AWS technologies such as S3, Glue, and Athena. - AWS Ecosystem Integration: Deploy, monitor, and maintain solutions on EC2; write and optimize Athena SQL queries; manage scalable cloud infrastructure for data engineering needs. - Data Wrangling: Clean, transform, and standardize large heterogeneous data sets, enabling seamless analytics and reporting. - Cybersecurity Analytics (Preferred): Engineer pipelines for security-related data, supporting threat detection, SIEM, and anomaly mod.