Search by job, company or skills

Lead Data Engineer

Lead Data Engineer

Vxi Global Solutions
8-10 Years
Not Disclosed
Early Applicant
  • Posted a month ago
  • Be among the first 10 applicants

Job Description

Job Description:

We are seeking talented and motivated Data Engineers to join our dynamic team and contribute to our mission of harnessing the power of data to drive growth and success.

As a Data Engineer at VXI Global Solutions, you will play a critical role in designing, implementing, and maintaining our data infrastructure to support our customer experience and management initiatives. You will collaborate with cross-functional teams to understand business requirements, architect scalable data solutions, and ensure data quality and integrity. This is an exciting opportunity to work with cutting-edge technologies and shape the future of data-driven decision-making at VXI Global Solutions.

Responsibilities:

  • Design, develop, and maintain scalable data pipelines and ETL processes to ingest, transform, and store data from various sources.
  • Collaborate with business stakeholders to understand data requirements and translate them into technical solutions.
  • Implement data models and schemas to support analytics, reporting, and machine learning initiatives.
  • Optimize data processing and storage solutions for performance, scalability, and cost-effectiveness.
  • Ensure data quality and integrity by implementing data validation, monitoring, and error handling mechanisms.
  • Collaborate with data analysts and data scientists to provide them with clean, reliable, and accessible data for analysis and modeling.
  • Stay current with emerging technologies and best practices in data engineering and recommend innovative solutions to enhance our data capabilities.

Requirements:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Proven 8+ years experience as a data engineer or similar role
  • Proficiency in SQL, Python, and/or other programming languages for data processing and manipulation.
  • Experience with relational and NoSQL databases (e.g., SQL Server, MySQL, Postgres, Cassandra, DynamoDB, MongoDB, Oracle), data warehousing (e.g., Vertica, Teradata, Oracle Exadata, SAP Hana), and data modeling concepts.
  • Strong understanding of distributed computing frameworks (e.g., Apache Spark, Apache Flink, Apache Storm) and cloud-based data platforms (e.g., AWS Redshift, Azure, Google BigQuery, Snowflake)
  • Familiarity with data visualization tools (e.g., Tableau, Power BI, Looker, Apache Superset) and data pipeline tools (e.g. Airflow, Kafka, Data Flow, Cloud Data Fusion, Airbyte, Informatica, Talend) is a plus.
  • Understanding of data and query optimization, query profiling, and query performance monitoring tools and techniques.
  • Solid understanding of ETL/ELT processes, data validation, and data security best practices
  • Experience in version control systems (Git) and CI/CD pipelines.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication and collaboration skills to work effectively with cross-functional teams.

Join VXI Global Solutions and be part of a dynamic team dedicated to driving innovation and delivering exceptional customer experiences. Apply now to embark on a rewarding career in data engineering with us!

More Info

Job Type:
Industry:
Employment Type:

Key Skills

data pipeline tools

ETL processes

NoSQL databases

cloud-based data platforms

distributed computing frameworks

data visualization tools

Similar Jobs

9-11 yrs
Bengaluru, India
Skills:
Pyspark, Scala, Apache Spark, Kafka, Oracle Goldengate, Jenkins, Terraform, Python, Airflow, Google BigQuery, Cloud Composer, GitHub Actions
7-9 yrs
Hyderabad, India
Skills:
snowflake , Adf, Agile Methodologies, Informatica, Sql Development, Git, Gcp, Azure, AWS, Airflow, dbt Core, Kimball Dimensional Modeling, Matillion, dbt Cloud, CI CD pipelines, Fivetran, Snowflake Certification SnowPro Core Advanced
8-10 yrs
Pune, India
Skills:
snowflake , Pyspark, Scala, Redshift, Sql, Gcp, Spark, Databricks, Azure, Python, AWS, Etl
7-9 yrs
Bengaluru, India
Skills:
Orchestration, S3, Metadata Management, Pyspark, PostgreSQL, Automated Testing, Data Modeling, Lambda, Advanced Sql, Python, RDS, release management, Dynamodb, SQL Server, Redshift, Data Quality, ECS, transformation standards, CI CD, AWS data services, ETL best practices, data cataloging, Step Functions, Monitoring, large-scale data processing, Glue
10-12 yrs
Bengaluru, India
Skills:
snowflake , Data Lineage, Pyspark, Apache Spark, Sql, ELT, Data Quality, Goldengate, Data Lake, Databricks, Data Governance, Python, AWS, Etl, AWS DMS, Data Pipelines, Lakehouse, Observability