Developer
Developer
GSB Solutions- Posted 10 hours ago
- Be among the first 10 applicants
Job Description
Must-Have**
- Strong proficiency in Python programming.
- Hands-on experience with PySpark and Apache Spark.
- Knowledge of Big Data technologies (Hadoop, Hive, Kafka, etc.).
- Experience with SQL and relational/non-relational databases.
- Familiarity with distributed computing and parallel processing.
- Understanding data engineering best practices.
- Experience with REST APIs, JSON/XML, and data serialization.
- Exposure to cloud computing environments.
- 5+ years of experience in Python and PySpark development.
- Experience with data warehousing and data lakes.
- Knowledge of machine learning libraries (e.g., MLlib) is a plus.
- Strong problem-solving and debugging skills.
- Excellent communication and collaboration abilities.
- Develop and maintain scalable data pipelines using Python and PySpark.
- Design and implement ETL (Extract, Transform, Load) processes.
- Optimize and troubleshoot existing PySpark applications for performance.
- Collaborate with cross-functional teams to understand data requirements.
- Write clean, efficient, and well-documented code.
- Conduct code reviews and participate in design discussions.
- Ensure data integrity and quality across the data lifecycle.
- Integrate with cloud platforms like AWS, Azure, or GCP.
More Info
Key Skills
data engineering best practices
data pipelines
machine learning libraries
data lakes
non-relational databases
cloud platforms
data serialization
About Company
Skills:
Scripting, Github, Gerrit, Data Structures, Unit Testing, Automation, Sql, Nosql, Python Scripting, Jenkins, Algorithms, Concurrency, Git, Perl, C++ Programming, Network Analysis, Multi-threading, File Structures, Unix/Linux internals, IP filters, TCP/IP and network protocols
Skills:
Lightning Web Components (LWC), Permission Sets, Sharing Rules, Profiles, Triggers, Sdlc, Sosl, Devops, Agile, APEX, Soql, Salesforce Sales Cloud, Integration Procedures, FlexCards, Salesforce OmniStudio Development, Salesforce security model, OmniScripts, DataRaptors, API integrations, middleware platforms
Skills:
.Net Core, C#, SQL Server, Git, Azure Functions, Storage, App Services, ASP.NET, Microsoft Azure, Restful Apis, Azure DevOps, Key Vault, CI/CD pipelines, Application Insights
Skills:
data engineering , Power Bi, Pyspark, Data Warehouse, Sql, Dax, Python, Etl, Azure DevOps, Medallion Architecture, CI CD, Lakehouse, Microsoft Fabric