

Search by job, company or skills
Key Skills:
▪ Lead a team of data engineers in managing day-to-day BAU operations, production support, incident management, and platform stability.
▪ Strong AWS knowledge in terms of designing new architecture and providing optimized solutions for existing ones. (S3, Glue, DMS, MWAA, AMS, IAM).
▪ In-depth knowledge with respect to Snowflake and its architecture.
▪ Prefer prior Experience in BAU environment.
▪ Good knowledge on Airflow and MWAA.
▪ Hands-on experience in SQL/Python/Pyspark.
▪ Expertise in optimizing techniques in cloud environments.
▪ Should have the vision on data strategy and able to deliver the same.
▪ Should be able to lead the design and implementation of data management processes, including data sourcing, integration, and transformation.
▪ Able to manage and lead a team of data professionals, providing guidance, mentoring and foster a collaborative and innovative team culture focused on continuous improvement.
▪ To evaluate and recommend data-related technologies, tools, and platforms.
▪ Collaborate with IT teams to ensure seamless integration of data solutions.
▪ Should have experience in Implementing and enforcing data security protocols and ensure compliance with relevant regulations.
Required Qualifications:
▪ At least 8+ years of Data Engineer Experience
▪ Bachelor qualification in a computer science or STEM (science, technology, engineering, or mathematics) related field.
▪ At least 5+ years of recent hands-on professional experience (actively coding) working as a Lead handling support & production issue.
▪ 2+ experience with large scale datasets, data lake and data warehouse technologies such as AWS Redshift, Google BigQuery, Snowflake. Snowflake is highly preferred.
Job ID: 151766449
Skills:
Gcp, Data Engineer, Big Data Analysis, Powerbi, Sql, Data Analyst
Skills:
Application Management, Data Warehouse, Aws, Tableau, snowflake developer, datbricks, informtica idmc
Skills:
Python, machine learning pipelines, vector databases, Azure data infrastructure, cloud-based data processing, analytics frameworks, embeddings for LLM-based applications
Skills:
MySQL, Sql, AWS, Python, Azure, Apache Spark, Hadoop, PostgreSQL, Industrial IoT integrations
Skills:
Python, data cleaning validation, sequence number continuity, market data architectures, A-B arbitrage data alignment, low-latency processing techniques, contract symbol mapping, implied order matching, multicast snapshot recovery, order book reconstruction, market data delivery, historical MBO data lifecycle, real-time feed handler connectivity, Pcap parser development