Pyspark Developer

Title- Pyspark Developer

Job Description

Must-Have

• Minimum 6-8 years of experience in build & deployment of Bigdata applications using SparkSQL, SparkStreaming in Python;
• Minimum 5 years of extensive experience in design, build and deployment of Python-based applications;
• Design and develop ETL integration patterns using Python on Spark.
  
  Develop framework for converting existing PowerCenter mappings and to PySpark(Python and Spark) Jobs.
• Create Pyspark frame to bring data from multiple databases to Amazon S3.
  
  Expertise on graph algorithms and advanced recursion techniques.
  
  Hands-on experience in generating/parsing XML, JSON documents, and REST API request/responses.

Good-to-Have

• Hands-on experience writing complex SQL queries, exporting and importing large amounts of data using utilities.