Web Scraping Engineer

Experience : 5+ Years Skills : TypeScript, Python, Web Scraping, Automation Domain : Dental Insurance / Healthcare Location : Remote Job Description: We are looking for a Web Scraping Engineer with strong experience in TypeScript and Python to build and maintain robust automation solutions for dental insurance payor portals. The ideal candidate has hands-on experience extracting structured data from secure, authenticated web portals while ensuring compliance with legal and ethical standards. Key Responsibilities: Design, develop, and maintain web scraping and automation solutions for dental insurance payor portals Handle complex authentication flows (SSO, MFA, session management, CAPTCHA-aware strategies) Build scalable, fault-tolerant scraping pipelines using TypeScript (Node.js) and Python Parse and normalize extracted data into structured formats (JSON, CSV, databases) Implement logging, monitoring, retries, and error-handling mechanisms Collaborate with backend and data teams to integrate scraped data into downstream systems Ensure adherence to compliance, security, and ethical scraping practices ✅ Required Qualifications 5+ years of hands-on experience in web scraping and browser automation Strong proficiency in TypeScript (Node.js) and Python Experience with tools such as: Playwright / Puppeteer / Selenium BeautifulSoup, Scrapy, Requests Deep understanding of: HTML, DOM, JavaScript rendering Network requests, cookies, headers, tokens Experience scraping secure portals (healthcare or insurance preferred) Familiarity with cloud environments (Azure / AWS / GCP is a plus) ⭐ Nice to Have Prior experience with dental or medical insurance payor portals Knowledge of HIPAA or healthcare data compliance Experience with proxy management, rate limiting, and anti-bot mitigation CI/CD and containerization (Docker)