
Search by job, company or skills
In The role of Sr Software Engineer II, you willbe responsible fortaking on the role of an individual contractorfortheGCPapplicationswhich iscritical in the Amex environment.
We develop Engineering Development strategic frameworks, processes,toolsand actionable insights.
As a Data Engineer, you willbe responsible fordesigning, developing, andmaintainingrobust and scalable framework/services/application/pipelines for processing huge volume of data. You will work closely with cross-functional teams to deliver high-quality software solutions that meet our organizational needs.
Preferably aB.TechorM.Techdegree in computer science, computer engineering, or other technical discipline
8+ years of software development experience
GCP Architecture design and build solutions, SQL,PySpark, Python, Cloud technologies
Design and develop solutions using Bigdata tools and technologies like MapReduce, Hive, Spark etc.
Extensive hands-on experience in GCP and object-oriented programming using Python,PySparketc.
Experience in building data pipelines for huge volume of data.
Experience in designing, implementing, and managing various ETL job execution flows.
Experience in implementing andmaintainingData Ingestion process.
Hands on experience in writing basic to advance level of optimized queries using HQL, SQL & Spark.
Hands on experience in designing, implementing, andmaintainingData Transformation jobs using most efficient tools/technologies.
Ensure the performance, quality, and responsiveness of solutions.
Participate in code reviews tomaintaincode quality.
Should be able to write shell scripts.
Utilize Git for source version control.
Set up andmaintainCI/CD pipelines.
Troubleshoot, debug, and upgrade existing application & ETL job chains.
Ability to effectively interpret technical and businessobjectivesand challenges and articulate solutions
Experience withmanaging teams and balance multiple priorities.
Willingness to learnnew technologiesand exploit them to theiroptimalpotential
Strong experience with DataEngineering, Big Data Applications
Strong background with Python,PySpark,Java ,Airflow ,Spark ,PL/SQL, AirflowDags
Cloud experience with GCPis must
Conduct ITrequirementsgathering.
Define problems andprovidesolutionalternatives.
Create detailed computer system design documentation.
Implementdeployment plan.
Conduct knowledge transfer with theobjectiveof providing high-quality IT consulting solutions
Support consulting team indifferent phasesof the project including problem definition, effort estimation, diagnosis, solution generation,designand deployment.
Undersupervisionparticipatein unit-level and organizational initiatives with theobjectiveof providing high-quality and value adding consulting solutions.
Understand issues and diagnoseroot-causeof issues. Perform secondary research as instructed by supervisor toassistin strategy and business planning.
Excellent communication and analytical skills
Excellent team-player with ability to work with global team
Job ID: 142646033