Senior Data Engineer

Skill Set:Azure Data Factory, Azure Databricks, Python/PysparkMandatory Skills(ONLY 2 or 3) Same as above

Key Responsibilities:

Data Architecture & Design:

• Design and implement data systems and pipelines that allow seamless data flow across multiple platforms.
• Ensure the scalability, performance, and reliability of data infrastructure and systems.
• Work with architects and other stakeholders to design data models and structures that support analytical and operational workloads.

Data Integration & ETL:

• Build and maintain ETL (Extract, Transform, Load) processes to integrate data from various sources, ensuring high-quality, clean, and accessible data for analysis.
• Design and implement data pipelines that automate the extraction, transformation, and loading of data to ensure up-to-date and reliable data for users.

Big Data Technologies:

• Leverage big data technologies (such as Hadoop, Spark, or Kafka) to handle large volumes of structured and unstructured data efficiently.
• Optimize and manage large-scale data storage solutions such as data lakes, data warehouses, or cloud-based storage systems.