Job Scraper Automation System thumbnail

Job Scraper Automation System

Period: 2025

About this project

  • An intelligent job scraping automation system that aggregates job postings from multiple platforms simultaneously and delivers them directly to email.
  • The tool scrapes positions from 8 different job boards including global platforms (Indeed, LinkedIn, Glassdoor) and India-specific sites (Naukri, Internshala), processes the data, and sends formatted CSV reports via SMTP integration with n8n workflow automation.
  • Optimized for entry-level positions with multi-site concurrent scraping and configurable search parameters including location, job type, and remote filter options.
  • Implemented SSL/TLS handling for macOS compatibility and local JSON backup system for data persistence.
  • Integrated n8n webhook automation for seamless workflow orchestration and SMTP email delivery with CSV attachments.

Key Features

  • Multi-platformconcurrent job scraping (8+ job boards)
  • n8nwebhook integration for workflow automation
  • SMTPemail delivery with CSV attachments
  • Configurablesearch parameters (location, job type, remote filter)
  • SSL/TLShandling for macOS compatibility
  • LocalJSON backup system

Technologies Used

n8nPythonBeautifulSoup4TLS-clientJobSpyPandasNumPyRequestsurllib3SMTPPydanticpython-dotenv