Data Engineer
Data Engineer
Lowes Services India Private limitedThis job is no longer accepting applications
Job Description
- Bachelors Degree in Engineering, Computer Science, CIS, or related field (or equivalent work experience in a related field)
- 2 years of experience in Data, Platform Engineering, Data Warehousing/ETL, Cloud Platform or Software Engineering
- 1 year of experience working on project(s) involving the implementation of solutions applying development life cycles (SDLC)
Preferred Qualifications
- Masters Degree in Computer Science, CIS, or a related field
- 2 years of IT experience in developing and implementing business systems within an organization
- 4 years of experience with technical documentation in a software development environment
- 2 years of experience with Big Data technologies - both On-Premises and Cloud
- 2 years of experience with Hadoop and Spark Experience with application and integration middleware
- Experience with database technologies
Data Engineering
- 2 years of experience with Hadoop or any Cloud Big Data components (specific to the Data Engineering role), preferably Google Cloud Platform
- Expertise in Java/Scala/Python, SQL, Scripting, Hadoop (Sqoop, Hive, HDFS), Spark (Spark Core Streaming), Kafka or equivalent Cloud Big Data components
- Proficiency in programming languages: Scala, Python, Java, and Big Data technologies, both On-Premises and Cloud
- Knowledge of data modeling and database design
- Hands-on experience with GCP services: BigQuery, Dataflow, Dataproc, Composer/Airflow, Google Storage, Pub-Sub
- Experience with CI/CD processes: Jenkins, Cloud build tools, Docker, Kubernetes, Artifact Registry
- Ability to design scalable data architectures on GCP using services like Dataproc, BigQuery, and Composer
- Experience with ETL (Extract, Transform, Load) processes
- Responsible for optimizing data pipelines and queries for performance, troubleshooting issues, and proactive monitoring
- Knowledge of quality checks, data governance, and security policies
Role: Data Engineer
Industry Type: Retail
Department: Data Science & Analytics
Employment Type: Full Time, Permanent
Role Category: Data Science & Machine Learning
Education
UG: B.Tech/B.E. in Any Specialization
PG: Any Postgraduate
More Info
Key Skills
About Company
Lowes Companies, Inc. (NYSE: LOW) is a FORTUNE50 home improvement company serving approximately 16 million customer transactions a week in the United States. With total fiscal year 2023 sales of more than $86 billion, Lowes operates over 1,700 home improvement stores and employs approximately 300,000 associates
Skills:
Scala, Python, Spark
Skills:
Pyspark, AWS Glue, Data Modeling, Emr, Avro, Autosys, Sql, Cloudwatch, Terraform, Etl Tools, Databricks, Python, AWS, Airflow, Parquet, AWS Lake Formation, Iceberg
Skills:
Power Bi, Pyspark, Agile Scrum, Tableau, Databases, Git, Data Warehousing, Informatica Powercenter, Python, Airflow, Data Lake concepts, Advanced SQL and performance tuning, IICS, dbt, CI/CD
Skills:
Kms, Pyspark, Iam, Sql, Python, AWS Lake Formation
Skills:
Java, Python, AWS Analytics, data modeling and database design, data warehousing concepts and architecture, data governance and data quality frameworks