Data Engineer
- Posted 3 hours ago
- Be among the first 10 applicants
Job Description
Responsibilities
- Lead the architecture, design, and development of data warehousing solutions.
- Provide technical guidance and mentorship to the data engineering team.
- Ensure best practices in data warehousing, ETL / ELT processes, and data integration.
- Design, develop, and optimize ETL / ELT pipelines using industry-standard tools.
- Ensure data accuracy, integrity, and consistency across data sources.
- Monitor and troubleshoot ETL / ELT processes to ensure timely and accurate data loading.
- Implement and manage data warehousing solutions using Snowflake.
- Utilize AWS Glue for data integration and ETL / ELT tasks.
- Optimize data storage and retrieval processes to enhance performance.
- Apply AI/ML concepts to extract insights from large datasets.
- Integrate AI solutions like Cortex AI/AWS Bedrock into the data warehousing environment.
- Leverage knowledge in Finance, Accounts, and Manufacturing to understand business requirements.
- Develop data solutions that address specific needs within these domains.
- Collaborate with stakeholders to gather and analyse business requirements
- Overall, 3 to 5 years experience in which 2+ years of experience in Data Analytics and Digital solutions with exposure to Lake house architecture
- BTech in Computer Science or IT
- Technical expertise with data models, data mining, and segmentation techniques
- Knowledge of programming languages (e.g. Java and Python) and with hands-on experience with SQL database design
- Exposure to Cortex AI, AWS Bedrock, Copilot studio (good to have)
- Strong analytical and problem-solving skills. Strong influencing and communication skills (written, verbal, presentation) with the ability to be a thought partner/ coach to internal team
- Should have exposure to Cloud ETL/ ELT, Cloud DWH, AI and ML tools
- Domain expertise in Finance, Accounts, and Manufacturing.
- Exposure to agile software development, and/or development management
- Positive attitude and motivation to deliver and ensure highest quality deliverables. Able to respond positively and calmly to shifting priorities, demands and timelines
More Info
About Company
Skills:
Bash Shell Scripting, Databases, Oracle Data Integrator, Mulesoft, Pl Sql, Golden Gate, Data Modeling, Sql, Python, ETL Mapping, Integration architectures
Skills:
Java, BigQuery, Hive, Spark, Python, Linux systems
Skills:
snowflake , Pyspark, Snowpipe, Terraform, AWS, Scala, Sql, Gcp, Spark, Databricks, Azure, Airflow, Purview, Alation, Great Expectations, Delta Live Tables, Prefect, IDMC, Deequ, Atlan, Unity Catalog, Lakeflow, Glue, Delta Lake
Skills:
vertex , BigQuery, Data Modeling, Advanced Sql, Python, ETL/ELT concepts, BI delivery, PLX, Looker, GCP tools, Google internal analytics platforms
Skills:
Apache Airflow, Sql, Python, dbt, Google BigQuery, Looker