Data Migration Engineer

Software Development:

• Design, develop, test, and deploy high-performance and scalable data solutions using Python, PySpark, SQL
• Collaborate with cross-functional teams to understand business requirements and translate them into technical specifications.
• Implement efficient and maintainable code using best practices and coding standards.

AWS & Databricks Implementation:

• Work with Databricks platform for big data processing and analytics.
• Develop and maintain ETL processes using Databricks notebooks.
• Implement and optimize data pipelines for data transformation and integration.
• Utilize AWS services (e.g., S3, Glue, Redshift, Lambda) and Databricks to build and optimize data migration pipelines.
• Leverage PySpark for large-scale data processing and transformation tasks.

Continuous Learning:

• Stay updated on the latest industry trends, tools, and technologies related to Python, SQL, and Databricks.
• Share knowledge with the team and contribute to a culture of continuous improvement.

SQL Database Management:

• Utilize expertise in SQL to design, optimize, and maintain relational databases.
• Write complex SQL queries for data retrieval, manipulation, and analysis