Python Developer - Web Crawling Specialist

Job Overview

We are seeking an experienced Python developer with a strong background in web crawling and scraping projects. The role involves maintaining full-stack applications related to web crawlers and automating data extraction processes using a variety of tools and frameworks.

Responsibilities

• Oversee and maintain operational web crawlers and their associated full-stack applications
• Develop data scraping solutions using Python and related libraries
• Implement automation scripts to enhance efficiency of data extraction workflows

Requirements

• At least 5 years of professional experience with data crawling projects
• Proficient in Python programming and automation scripting
• Experience with web scraping tools such as Scrapy, Beautiful Soup, Selenium, and Playwright
• Familiarity with SQL and HTTP requests for data manipulation
• Good analytical abilities and communication skills
• Knowledge of Natural Language Processing (NLP), NLTK, and machine learning applications is advantageous
• Experience with AWS services is a plus but not mandatory