About Us:

Paytm is India's leading mobile payments and financial services distribution company. Pioneer of themobile QR payments revolution in India, Paytm builds technologies that help small businesses withpayments and commerce. Paytm's mission is to serve half a billion Indians and bring them to themainstream economy with the help of technology.

About the role:

Build systems for collection & transformation of complex data sets for use in productionsystems Collaborate with engineers on building & maintaining back-end services Implement dataschema and data management improvements for scale and performance Provide insights into keyperformance indicators for the product and customer usage Serve as team's authority on datainfrastructure, privacy controls and data security.

Collaborate with appropriate stakeholders to understand user requirements Support efforts forcontinuous improvement, metrics and test automation Maintain operations of live service as issues ariseon a rotational, on-call basis Verify whether data architecture meets security and compliancerequirements and expectations .Should be able to fast learn and quickly adapt at rapid pace.java/scala, SQL,

Minimum Qualifications:

. Minimum 6+ years of experience in Big Data technologies.

. The position grows our analytics capabilities with faster, more reliable tools, handlingpetabytes of data every day.

. Brainstorm and create new platforms that can help in our quest to make available to clusterusers in all shapes and forms, with low latency and horizontal scalability. Make changes to ourdiagnosing any problems across the entire technical stack. Design and develop a real-timeevents pipeline for Data ingestion for real-time dash- boarding.

. Develop complex and efficient functions to transform raw data sources into powerful, reliablecomponents of our data lake.

. Design & implement new components and various emerging technologies in Hadoop Eco-System, and successful execution of various projects.

Required Technical skills:

. Fluent with Strong hands-on experience with Hadoop, MapReduce, Hive, Spark, PySpark etc.

. Excellent programming/debugging skills in Python/Java/Scala.

. Experience with any scripting language such as Python, Bash etc.

. Good to have experience of working with noSQL databases like Hbase, Cassandra.

. Hands-on programming experience with multithreaded applications.

. Good to have experience in Database, SQL, messaging queues like Kafka.

. Good to have experience in developing streaming applications e.g. Spark Streaming, Flink,Storm, etc.

. Good to have experience with AWS and cloud technologies such as S3Experience with cachingarchitectures like Redis etc.

Compensation:

If you are the right fit, we believe in creating wealth for you with enviable 500 mn+ registered users,25 mn+ merchants and depth of data in our ecosystem, we are in a unique position to democratizecredit for deserving consumers & merchants - and we are committed to it.India's largest digital lending story is brewing here.It's your opportunity to be a part of the story!

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Technical Lead - Data Engineering