Experience: More than 3 years in data integration, pipeline development, and data warehousing, with a strong focus on AWS Databricks.
Technical Skills:
Proficiency in Databricks platform, management, and optimization.
Strong experience in AWS Cloud, particularly in data engineering and administration, with expertise in Apache Spark, S3, Athena, Glue, Kafka, Lambda, Redshift, and RDS.
Proven experience in data engineering performance tuning and analytical understanding in business and program contexts.
Administer, manage, and optimize the Databricks environment to ensure efficient data processing and pipeline development.
Perform advanced troubleshooting, query optimization, and performance tuning in a Databricks environment.
Collaborate with development teams to guide, optimize, and refine data solutions within the Databricks ecosystem.
