Web Scraping Engineer – Global Team
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Web Scraping Engineer building resilient scrapers for YipitData, a market research and analytics firm. Improving data extraction, monitoring, and quality for critical reports and customer experiences.
Responsibilities:
- Design, build, and maintain robust web scrapers powering critical reports and customer experiences
- Refactor existing scraping scripts to improve reliability, maintainability, and efficiency
- Implement clean code, modular architecture, code reviews, and other best coding practices
- Use fingerprinting methods such as cookies, headers, user-agent rotation, and proxies to avoid detection and blocking
- Handle dynamic content, complex DOM structures, and session/cookie lifecycles
- Collaborate with analysts and stakeholders to gather requirements, align on targets, and ensure data quality
- Provide support, documentation, and best practices for internal stakeholders using web-scraped data
- Develop monitoring solutions and alerting frameworks to identify and address failures
- Evaluate scraper performance and diagnose bottlenecks and scaling issues
- Propose tooling, methodologies, and technologies to improve scraping capabilities and processes
- Stay current with bot-detection tactics and novel web data extraction approaches
Requirements:
- Effective communication in English with both technical and non-technical stakeholders
- 3+ years of experience with web scraping frameworks such as Selenium, Playwright, or Puppeteer
- Strong understanding of HTTP, RESTful APIs, HTML parsing, browser rendering, and TLS/SSL mechanics
- Expertise in advanced fingerprinting and evasion strategies, including browser fingerprint spoofing and request signature manipulation
- Deep experience managing cookies, headers, session states, and proxy rotations
- Experience deploying both residential and data center proxies
- Experience with logging, metrics, and alerting to ensure high availability
- Troubleshooting skills to optimize scraper performance for efficiency, reliability, and scalability
Benefits:
- Vacation time
- Parental leave
- Team events
- Learning reimbursement
- Flexible work arrangements, including flexibility around standard 11am–8pm IST work hours
- Opportunity for learning, self-improvement, and skill mastery
- People-centric culture focused on ownership, respect, and trust
Similar Jobs
Virtualization Engineer
Virtualization Engineer operating enterprise VMware virtualization, networking, and storage platforms. Supporting Bright Vision Technologies’ cloud, AI, data, and enterprise consulting solutions across the United States.
Senior SCADA Engineer – Graphics
Senior SCADA Engineer designing high-performance graphics for Divcon’s nationwide HVAC, power, and mission-critical automation solutions. Coordinating deployment, commissioning, quality control, and reusable visualization standards.
Senior Staff Performance Engineer
Senior Staff Performance Engineer optimizing Mozilla’s Firefox browser. Profiling bottlenecks, improving benchmarks, and guiding performance engineering across a distributed team.
Forward Deployed Engineer
Forward Deployed Engineer embedding with enterprise clients to deploy AI, CRM, marketing, content, and data solutions. Bluprintx is an AI-powered front-office transformation consultancy.
Forward Deployed Engineer
Forward Deployed Engineer embedding with Bluprintx consultancy clients to deploy AI, CRM, marketing, content, and data workflows. Shipping rapid releases and scaling reliable client systems.
Project Engineer
Project Engineer designing pressure vessels and supporting project execution for CECO Environmental, a provider of industrial air, water, and energy-transition solutions.
Senior HVAC Engineer – Nuclear
Senior HVAC Engineer designing ventilation, heating, chilled-water, and control-room systems for Sargent & Lundy’s nuclear engineering projects. Supporting facility designs, technical studies, and automation-enabled workflows.
Lead HVAC Engineer – Nuclear
Lead HVAC engineer designing ventilation, chilled-water, and heating systems for Sargent & Lundy’s nuclear engineering projects. Supporting facility design, upgrades, and AI-enabled engineering workflows.
Senior Software Safety Engineer
Senior Software Safety Engineer advancing safety for AeroVect’s autonomous ground-handling platforms. Performing ISO 26262 analyses, deriving requirements, and supporting airport deployment.
Audio Engineer – Speech, TTS Audio Specialist – French
Audio Engineer editing and quality-checking French speech recordings for TTS and speech AI systems. Preparing high-quality datasets for Mercor’s frontier AI model training projects.
Certification Engineer
Certification Engineer guiding Game Aerospace’s composite aircraft through FAA Part 23 certification. Managing certification strategy, schedules, documentation, safety reports, and engineering coordination.
Prin Manufacturing Engineer
Principal Manufacturing Engineer optimizing Medtronic’s medical-device contract manufacturing lines. Driving validation, automation, compliance, and continuous improvement across production operations.
Audio Engineer – Speech, TTS Specialist, French
Audio Engineer editing and quality-checking French speech recordings for Mercor’s AI model training projects. Preparing technically compliant datasets for TTS and speech systems.
Forward Deployed Engineer
Forward Deployed Engineer deploying conversational AI agents for Hippocratic AI’s healthcare platform. Building RAG pipelines, enterprise integrations, and reliable production systems at customer sites.
Senior Service Desk Engineer
Senior Service Desk Engineer delivering managed IT and cybersecurity services for NetCov clients. Leading troubleshooting, infrastructure optimization, Service Operations initiatives, and engineer mentorship.
Senior Service Desk Engineer
Senior Service Desk Engineer delivering managed IT and cybersecurity solutions for NetCov clients. Providing advanced troubleshooting, infrastructure optimization, technical leadership, and service desk mentorship.
Integration, Middleware Engineer
Integration/Middleware Engineer designing secure enterprise integrations, APIs, middleware, and cloud data pipelines. Supporting KGS solutions for Federal Government agencies across AWS and Azure Government.
MES Engineer
MES Engineer developing MES integrations and digital manufacturing solutions for Molex, a global connector and interconnection-components provider. Improving production traceability, reliability, and operational efficiency.
Citrix Engineer
Citrix Engineer administering Citrix VDI infrastructure for WCG’s clinical-trial solutions. Managing desktop images, L3 support, platform performance, and business-continuity testing.
Virtualization Engineer
Virtualization Engineer operating enterprise VMware platforms for Bright Vision Technologies’ cloud and software solutions. Automating virtualization, networking, storage, and hybrid-cloud operations.