Data Engineer for a freelancer work in india
Location: India - Remote
Duration: 6+ Months
- Azure Databricks
- Python
- Spark
- Azure Power Apps
- Azure Power BI
Job Title: Data Engineer
Job Description: We are seeking an experienced Data Engineer with expertise in Azure Databricks, Python, Spark, Azure Power Apps, and Azure Power BI to join our team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure and processing pipelines. You will work closely with cross-functional teams to ensure efficient data workflows, optimize data processing, and enable data-driven decision-making throughout the organization.
Responsibilities
- Design, develop, and implement data pipelines and ETL processes using Azure Databricks and Spark.
- Collaborate with data scientists and analysts to understand data requirements and translate them into scalable data solutions.
- Optimize data workflows for performance, scalability, and reliability, ensuring data quality and integrity.
- Integrate data from various sources and formats, ensuring seamless data ingestion and transformation.
- Develop and maintain data models and data warehouses to support business reporting and analytics needs.
- Collaborate with software developers to build data-driven applications using Azure Power Apps.
- Work with Azure Power BI to create interactive dashboards, reports, and visualizations to communicate data insights effectively.
- Monitor and troubleshoot data pipelines, addressing any data processing or integration issues promptly.
- Stay updated with emerging technologies, tools, and best practices in the data engineering and analytics space, and propose innovative solutions to enhance data processing capabilities.
Qualifications
- Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.
- Proven experience as a Data Engineer, working on large-scale data projects using Azure Databricks, Python, Spark, Azure Power Apps, and Azure Power BI.
- Strong programming skills in Python and proficiency in working with Spark for distributed data processing.
- In-depth knowledge of data engineering concepts, data modeling, and ETL principles.
- Experience with cloud-based data platforms and services, particularly Microsoft Azure.
- Familiarity with Azure Power Apps for building custom applications and Azure Power BI for data visualization.
- Strong SQL skills for data manipulation and querying.
- Ability to work in a collaborative and cross-functional environment, effectively communicating complex technical concepts to both technical and non-technical stakeholders.
- Strong problem-solving and analytical skills, with a focus on delivering high-quality data solutions.
If you are a passionate Data Engineer with expertise in Azure Databricks, Python, Spark, Azure Power Apps, and Azure Power BI, and you thrive in a fast-paced, data-centric environment, we would love to hear from you. Apply now and join our team as we drive data-driven insights and enable data-driven decision-making across the organization.
