Data Engineer - Python Job

YASH Technologies is a leading technology integrator specializing in helping clients reimagine operating models, enhance competitiveness, optimize costs, foster exceptional stakeholder experiences, and drive business transformation.

At YASH, we're a cluster of the brightest stars working with cutting-edge technologies. Our purpose is anchored in a single truth – bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future.

We are looking forward to hire Python Professionals in the following areas :

Job Description

Experience required: 5-7 years

Core Technical Skills

• Python
• Backend service development and business logic implementation
• Retry and error-handling mechanisms
• Data schema modeling and validation using Pydantic
• REST API development and request handling

• SQL / Snowflake
• MERGE and STREAM-based CDC pipeline development
• Task scheduling and stored procedure implementation
• Secure Views and Secure Data Sharing
• Streaming data ingestion using Snowpipe and Snowpipe Streaming
• RBAC, role management, and grant administration
• Warehouse performance tuning and optimization

• Terraform
• Infrastructure as Code (IaC) for Snowflake resource provisioning
• Database, role, warehouse, and grant management
• Modular and reusable infrastructure deployments
• Automated environment provisioning and standardization

• AWS
• Lambda-based event-driven ingestion workflows
• S3 data lake storage architecture
• Glue Data Catalog integration
• IAM-based security and access control implementation

• Palantir Foundry
• Workshop-based GUI and application development
• Backend workflow and process orchestration
• Data request, approval, and provisioning workflows
• Multi-stage approval lifecycle management with role-based ownership transitions

• Version Control & CI Engineering
• Git-based source control and branching strategies
• Pre-commit hook framework implementation
• Python linting and formatting using Ruff
• Pull request templates and review governance
• AI-assisted development workflows (Plan → Build → Review)
  

Data Modeling & Interchange Formats

• JSON-based configuration and request schema design
• Hierarchical and relational data modeling
• Cross-platform data model synchronization
  

Platform & Domain Expertise

• Enterprise Data Provisioning & Request Portals
• End-to-end ownership of data request platforms
• Palantir Foundry Workshop GUI development
• Workflow orchestration and Python-based execution engines
• Integration with Snowflake and AWS target platforms
  

Data Virtualization & Analytics Platform Integration

• Output-port and ownership-privilege management
• Source-to-target data model synchronization
• Integration of hierarchical data structures across platforms
  

Industrial / OT Data Integration

• Integration of Aveva PI process historian data
• Event-driven ingestion pipelines using Lambda → Snowpipe → Snowflake
• Secure data sharing architectures
• OT entity modeling and governance framework design
  

Multi-Stage Approval Workflow Design

• Workflow development in Palantir Foundry
• Role-based approval and ownership handoffs
• End-to-end request lifecycle management:
• Requester
• Data Steward
• Data Owner
• Engineering Team
• Business Verification Team
  

Data Access Governance

• Access request and approval workflow implementation
• Role-Based Access Control (RBAC) design
• Self-service data provisioning solutions
• Business-owner-driven governance models

• Regulated Environment Delivery
• Dev → QA → Production deployment management
• Controlled release and promotion workflows
• Support for validated and GxP-equivalent environments
  

Compliance-focused system delivery and governance practices

At YASH, you are empowered to create a career that will take you to where you want to go while working in an inclusive team environment. We leverage career-oriented skilling models and optimize our collective intelligence aided with technology for continuous learning, unlearning, and relearning at a rapid pace and scale.

Our Hyperlearning workplace is grounded upon four principles

• Flexible work arrangements, Free spirit, and emotional positivity
• Agile self-determination, trust, transparency, and open collaboration
• All Support needed for the realization of business goals,
• Stable employment with a great atmosphere and ethical corporate culture