Associate Data Engineer

.Degree in Computer Science or Computer Engineering
. Minimum 5 years workingexperience in system operations compliance and management areas
. Project hands-on experiencespecifically with AWS platform (primary requirement)
. project experience in cloudoperations or cloud architecture
. Must be cloud certified (AWS)

CoreTechnical Skills:
. proficiency in Databricksplatform, including workspace management, cluster configuration, and joborchestration
. Strong expertise in ApacheSpark within Databricks environment, including Spark SQL, DataFrames, and RDDs
. Good in-depth understanding ofdata warehouse concepts, data profiling, data verification and advancedanalytics techniques
. Strong knowledge ofmonitoring, incident management, and cloud cost control

TechnologyStack Experience:
. Databricks
. AWS cloud services andarchitecture
. IDMC (Informatica DataManagement Cloud)
. Tableau for data visualization
. Oracle Database management
. ML Ops practices withinDatabricks environment
. STATA for statistical analysisis advantage
. Amazon SageMaker integrationwith Databricks
. DataRobot platformintegration

Responsibilities:

Operational Responsibilities:

. Monitor and maintainproduction data pipelines to ensure 99.9% uptime and optimal performance

. Implement comprehensivelogging, alerting, and monitoring systems using Application monitoring tools

. Perform regular health checksperformance, job execution times, and resource utilization to identify andresolve bottlenecks proactively

. Manage incident responseprocedures for pipeline failures, including root cause analysis, resolution,and post-incident reviews

. Establish and maintaindisaster recovery procedures and backup strategies for critical data assetswithin the Databricks environment

Thanks,and Best Regards

KaranamVijaya Kiran

(EARegistration no: R1443178)

HP:+65 92333815

RecruitmentManager

HeliusTechnologies Pte Ltd (EA Licence No: 11C3373)

https://www.linkedin.com/in/vijay-karanam-68462131/