Web Scraping Engineer - Python Frameworks

<p><p><b>Note : This is a remote opportunity<br/></b><br/><b>Requirements :</b><br/><br/><b>- Proven experience of 3 to 7 years as a Web Scraping Specialist or similar role, with a track record of successful web scraping projects.</b><br/><br/>- Expertise in handling dynamic content, user-agent rotation, bypass CAPTCHAs, rate limits, and utilization of proxy services.<br/><br/>- Knowledge on browser fingerprinting<br/><br/>- Has leadership experience.<br/><br/>- Proficiency in programming languages commonly used for web scraping, such as Python, BeautifulSoup, Scrapy, or Selenium.<br/><br/>- Strong knowledge of HTML, CSS, XPath, and other web technologies relevant to web scraping and Coding.<br/><br/>- Knowledge and experience in best of class data storage and retrieval of large volume of scraped data.<br/><br/>- Understanding of web scraping best practices, including handling dynamic content, user-agent rotation, and IP address management.<br/><br/>- Attention to detail and the ability to handle and process large volumes of data accurately.<br/><br/>- Familiarity with data cleansing techniques and data validation processes.<br/><br/>- Good communication skills and the ability to collaborate effectively with cross-functional teams.<br/><br/>- Knowledge of web scraping ethics, legal considerations, and compliance with website terms of service.<br/><br/>- Strong problem-solving skills and the ability to adapt to changing web environments <br/><br/><b>Preferred Qualifications :</b><br/><br/>- Bachelor's degree in Computer Science, Data Science, Information Technology, or related fields.<br/><br/>- Experience with cloud-based solutions and distributed web scraping systems.<br/><br/>- Familiarity with APIs and data extraction from non-public sources.<br/><br/>- Knowledge of machine learning techniques for data extraction and natural language processing is desired but not mandatory<br/><br/>- Prior experience in handling large-scale data projects and working with big data frameworks.<br/><br/>- Understanding of various data formats such as JSON, XML, CSV, etc.<br/><br/>- Experience with version control systems like Git.</p><br/></p> (ref:hirist.tech)