V
Lead Software Engineer
Job Description
Job Summary: We are seeking a highly skilled Databricks Consultant with extensive experience in AWS to join our consultancy team. The ideal candidate will possess a deep understanding of data engineering and analytics, leveraging Databricks to deliver innovative solutions for our clients. This role requires a strategic thinker who can analyze complex data requirements and translate them into actionable insights.
Responsibilities
Design, develop, and implement data solutions using Databricks on AWS.
Collaborate with clients to understand their data needs and provide tailored solutions.
Optimize data pipelines and workflows for performance and scalability.
Conduct data analysis and visualization to support business decision-making.
Provide technical guidance and mentorship to junior team members.
Stay updated with the latest trends and technologies in data engineering and analytics.
Mandatory Skills
Proven experience with Databricks and its ecosystem.
Strong knowledge of AWS services related to data processing and storage.
Expertise in data modeling, ETL processes, and data warehousing.
Proficiency in programming languages such as Python or Scala.
Experience with SQL and data querying techniques.
Preferred Skills
Familiarity with machine learning frameworks and libraries.
Experience in working with big data technologies such as Apache Spark.
Knowledge of data governance and security best practices.
Strong communication and interpersonal skills.
Responsibilities
Design, develop, and implement data solutions using Databricks on AWS.
Collaborate with clients to understand their data needs and provide tailored solutions.
Optimize data pipelines and workflows for performance and scalability.
Conduct data analysis and visualization to support business decision-making.
Provide technical guidance and mentorship to junior team members.
Stay updated with the latest trends and technologies in data engineering and analytics.
Mandatory Skills
Proven experience with Databricks and its ecosystem.
Strong knowledge of AWS services related to data processing and storage.
Expertise in data modeling, ETL processes, and data warehousing.
Proficiency in programming languages such as Python or Scala.
Experience with SQL and data querying techniques.
Preferred Skills
Familiarity with machine learning frameworks and libraries.
Experience in working with big data technologies such as Apache Spark.
Knowledge of data governance and security best practices.
Strong communication and interpersonal skills.
More Info
Key Skills
About Company
Skills:
.Net Core, Angular, React, Microsoft Azure, Full Stack Development, Oracle Cloud Infrastructure OCI, Database Technologies SQL, DevOps practices, System integration and distributed systems, Web API Microservices, AKS, Enterprise architecture frameworks, Product design and platform engineering, hybrid architectures, CI CD pipelines, performance optimization, Container based applications
Skills:
S3, Kafka, Spring Boot, Vpc, Postgres, AWS, Java, RDS, Dynamodb, ECS, Load Balancers, Waf, Lambda, Cloudwatch, Terraform, Dynatrace, Datadog, Redis, Api Gateway, Secrets Manager, DocumentDB, event streaming, Aurora, Messaging, EKS, Fargate, Step Functions, Sumo Logic