Job Description:
Key Responsibilities
- Design, develop, and maintain robust data pipelines and AI integration solutions using Python on Azure Databricks.
- Integrate Generative AI and Agentic AI models into existing and new workflows to drive business innovation and automation.
- Collaborate with data scientists, AI researchers, software engineers, and product teams to deliver scalable and efficient AI-powered solutions.
- Orchestrate data movement and transformation across Azure-native services including Azure Databricks, Azure Storage (Blob, Data Lake), and Snowflake, ensuring data quality, security, and compliance.
- Integrate enterprise data using Palantir Foundry and leverage Azure services for end-to-end solutions.
- Develop and implement APIs and services to facilitate seamless AI model deployment and integration.
- Optimize data workflows for performance and scalability within Azure.
- Monitor, troubleshoot, and resolve issues related to data and AI pipeline performance.
- Document architecture, designs, and processes for knowledge sharing and operational excellence.
- Stay current with advances in GenAI, Agentic AI, Azure data engineering best practices, and cloud technologies.
Required Skills And Qualifications
- Bachelor's or Master's degree in Computer Science, Engineering, or related field.
- 6 to 9 years of professional experience as a Data Engineer or Software Engineer.
- Strong proficiency in building and managing ETL/ELT pipelines and data workflows.
- Solid understanding of relational and NoSQL databases (e.g., SQL Server, PostgreSQL, MongoDB, Cassandra).
- Hands-on experience with big data technologies (e.g., Hadoop, Spark, Kafka, Airflow).
- Proficiency in at least one programming language commonly used in data engineering (e.g., Python, Java, Scala).
- Experience integrating and deploying AI/ML models into production systems.
- Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and cloud-based data services.
- Strong problem-solving, analytical, and debugging skills.
- Excellent communication and teamwork abilities.
Preferred/Optional Skills
- Experience developing web applications using Angular/REACT, node.js and others.
- Knowledge of data and application security best practices.
- Relevant certifications (Azure Data Engineer Associate).
Education & Experience:
- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
Location: Bangalore
Employment Type: Full-Time
Weekly Hours:
40
Time Type:
Regular
Location:
IND:KA:Banglaore / Intl Tech Park, Whitefield Rd - Storage: Innovator Building, Itpb, Whitefield Rd
It is the policy of AT&T to provide equal employment opportunity (EEO) to all persons regardless of age, color, national origin, citizenship status, physical or mental disability, race, religion, creed, gender, sex, sexual orientation, gender identity and/or expression, genetic information, marital status, status with regard to public assistance, veteran status, or any other characteristic protected by federal, state or local law. In addition, AT&T will provide reasonable accommodations for qualified individuals with disabilities. AT&T is a fair chance employer and does not initiate a background check until an offer is made.
JobCategory:BigData