We are seeking a skilled freelancer to develop, test, and deliver a custom web scraping tool that will help us verify leads by extracting SEO descriptions and website descriptions from a list of company domains. Once the tool is built and verified to work as intended, you will also provide basic training to ensure we can operate the tool independently for future use.
Responsibilities:
Develop a Custom Tool: Create a web scraping tool that can extract SEO descriptions and website content for a list of company domains. The tool should output the data in a structured format (e.g., CSV).
Test and Verify: Ensure the tool is fully functional, accurate, and capable of handling lists of 10,000+ domains.
Provide Training: Deliver a walkthrough or tutorial on how to use the tool, including installation, setup, and troubleshooting tips.
Documentation: Provide clear written instructions for running the tool, along with any dependencies or software requirements.
Requirements:
Proven experience building web scraping tools (e.g., using Python with BeautifulSoup, Scrapy, Selenium, or similar frameworks).
Strong knowledge of web scraping best practices, including handling anti-scraping measures and proxies if necessary.
Familiarity with SEO metadata and website structure.
Ability to explain technical concepts clearly for non-technical users.
Deliverables:
A fully functional web scraping tool (preferably script-based or easily runnable software).
A completed sample CSV file showing the extracted descriptions for provided test domains.
A live training session or recorded tutorial to guide tool usage.
Documentation covering tool setup, operation, and troubleshooting.
This is a one-time project with the potential for future collaboration if additional features or refinements are needed.
To Apply Please Include:
Examples of web scraping tools or scripts you’ve developed.
A brief explanation of your approach to building and delivering this tool.
Your estimated timeline for completion.
