<p><p><b>About the Role :</b><br/><br/></p><p>We are seeking highly skilled Python Developers with extensive hands-on experience in PySpark, Python scripting, and Big Data technologies to join our innovative and fast-paced team.
The ideal candidate will be passionate about developing scalable data solutions and automating data processes in complex data Responsibilities : </b></p><p><b><br/></b></p>- Design, develop, and maintain efficient, reusable, and reliable Python and PySpark code to support data processing and analytics workflows.<br/><br/></p><p>- Collaborate with data engineers, analysts, and other stakeholders to build robust data pipelines and ETL processes.<br/><br/></p><p>- Develop automation scripts to streamline data processing, transformation, and validation.<br/><br/></p><p>- Work extensively with Big Data ecosystems including Hadoop, Hive, and Spark to manage and manipulate large datasets.<br/><br/></p><p>- Manage and optimize database operations across various platforms such as AWS Redshift, AWS RDS, Oracle, and Azure SQL.<br/><br/></p><p>- Monitor and troubleshoot performance issues in data pipelines and workflows.<br/><br/></p><p>- Ensure data integrity and security by implementing best practices across all data handling processes.</p><p><br/></p><p>- Stay up-to-date with the latest trends and technologies in Big Data and cloud platforms to continuously improve data engineering Skills and Qualifications :</b></p><p><br/></p>- Proven expertise in Python programming and PySpark development.<br/><br/></p><p>- Strong hands-on experience with Big Data ecosystems including Hadoop, Hive, and Spark.<br/><br/></p><p>- Proficiency in scripting for automation, data processing, and ETL workflows.<br/><br/></p><p>- Experience with cloud-based database platforms such as AWS Redshift, AWS RDS, Oracle, and Azure SQL.<br/><br/></p><p>- Solid understanding of data pipeline architecture, ETL processes, and cloud platform services.<br/><br/></p><p>- Familiarity with version control tools (e.g., Git) and development best practices.<br/><br/></p><p>- Excellent problem-solving skills and ability to work in a collaborative team environment.<br/><br/></p><p>- Strong communication skills, both verbal and Qualifications :</b></p><p><br/></p>- Experience working in Agile/Scrum development environments.<br/><br/></p><p>- Knowledge of containerization and orchestration tools such as Docker and Kubernetes.<br/><br/></p><p>- Familiarity with data visualization and reporting :</b></p><p><br/></p>- Bachelors degree in Computer Science, Information Technology, Engineering, or a related field, or equivalent practical experience.</p><br/></p> (ref:hirist.tech)