Python Web Developer – Web Scraping, Data Extraction
Employment Information
Report this job
Job expired or something wrong with this job?
Job Description
Python web developer building web crawlers and scraping scripts for customer websites. Extracting, cleaning, and validating structured data through automated workflows.
Responsibilities:
- Develop and implement web crawlers and scraping scripts using Python
- Extract structured data from customer websites that do not support bulk data downloads
- Analyze website structures, HTML pages, and web elements to identify relevant data
- Utilize Python libraries and frameworks for automated data extraction
- Clean, validate, and organize scraped data to ensure accuracy and consistency
- Troubleshoot scraping issues and handle changes in website structures
- Work with the client-provided platform to build and execute data extraction workflows
- Collaborate with the team to meet project timelines and data delivery requirements
Requirements:
- 4–9 years of experience
- Strong experience in Python programming
- General web development experience
- Experience in web scraping and data extraction
- Understanding of web crawlers and automated data collection
- Experience working with customer websites and extracting structured data
- Knowledge of HTML, CSS, JavaScript, REST APIs, and JSON
- Nice-to-have: BeautifulSoup, Scrapy, Selenium, and Playwright
- Nice-to-have: XPath and CSS Selectors
- Nice-to-have: SQL and database knowledge
Similar Jobs
Frontend Developer – Angular
Angular frontend developer building scalable BI applications for Fusion Consulting, a global life-science consultancy. Integrating REST APIs and delivering client-facing solutions across transformation projects.
Front End Developer, Analyst
Front End Developer Analyst configuring and implementing healthcare systems for TELUS Health. Troubleshooting client issues, testing solutions, and supporting technical implementation projects.
Lead Web Developer, Marketing
Lead Marketing Web Developer building high-converting landing pages and WordPress sites for Atticor’s AI-powered legal services platform. Setting web standards, tracking, and conversion strategy across legal brands.
Full Stack Engineer, Front-End
Front-end-focused Full Stack Engineer building provider-facing healthcare applications for XO Health. Developing GraphQL APIs, serverless services, secure workflows, and accessible web experiences.
Full Stack Web Developer – PST/EST/CST Timezone
Full Stack Web Developer building scalable React and Node.js applications for Indeed. Developing APIs, databases, integrations and responsive interfaces for modern web products.
Full Stack Web Developer
Full Stack Web Developer building scalable React and Node.js applications for Indeed. Developing APIs, integrating AI and third-party services, and optimizing full-stack systems.
Senior Frontend Engineer
Senior Frontend Engineer building scalable React interfaces for Eltropy’s fintech communication platform. Delivering high-performance user experiences for financial institutions through modern SaaS technology.
Senior Frontend Engineer
Senior Frontend Engineer building accessible React and Next.js interfaces for Monks’ AI-powered digital transformation consulting. Collaborating with design, product, and backend teams to ship polished client experiences.
E-commerce, Web Developer
E-commerce developer building secure, high-performance online stores for a regenerative agriculture company. Integrating payments, business systems, and conversion optimization across remote U.S. locations.
Senior Full-Stack Web Developer, C#, MS-SQL, Front-end
Senior full-stack developer building C#/SQL web applications and APIs for Splashdot’s proprietary platform. Improving performance, security, testing, and enterprise application capabilities.
Senior Web Developer – Growth Marketing
Senior web developer building Dataiku’s AI marketing website, Contentful experiences, and growth experiments. Optimizing performance, SEO, analytics tracking, and AI-assisted release workflows.
Game UX Engineer
Game UX Engineer defining emotional logic, reward loops, and onboarding for Spawn’s AI-generated worlds. Making avatars, currencies, and dialogue feel like one coherent universe.
Front End Team Lead
Front End Team Lead supporting daily operations, process compliance, and quality standards at Rob Levine Law. Identifying improvements and assisting cross-functional teams.
Front-End Developer
Front-End Developer building pixel-accurate WordPress, Vue.js, and React interfaces for a telecommunications company. Translating Figma designs into responsive, production-ready web experiences.
Full Stack .NET Developer, Front-End
Full Stack .NET Developer building accessible .NET enterprise applications for Iowa state programs. Delivering responsive front ends, APIs, CI/CD, and WCAG-compliant user experiences.
Staff Software Engineer, UI Tooling
Staff Software Engineer leading Kyber, Airbnb’s UI prototyping and rapid deployment platform. Scaling cloud infrastructure and enabling designers, engineers, and product managers to build product prototypes.
React Developer
React Developer building and maintaining high-performance React.js web applications. Integrating APIs, creating reusable components, and collaborating on testing and deployment.
Front-end Developer
Front-end Developer building responsive Vue.js interfaces for Tebex’s virtual-economy platform. Optimizing performance, testing applications, and collaborating with backend, product, and design teams.
Senior Frontend Developer
Pessoa Desenvolvedora Frontend Sênior liderando arquitetura, qualidade e evolução técnica. Desenvolvendo software jurídico da Aurum para aumentar a produtividade de profissionais do Direito.
Technical SEO Manager – React, Next.js
Technical SEO Manager driving organic growth and hands-on React/Next.js development for UK businesses. Implementing technical SEO, analytics, content, and website updates directly.