General-purpose web scrapers and crawlers for custom data extraction from any website or web application.
Sorted by popularity. Each actor is tested weekly. Click any tool to see detailed features, pricing, and user reviews.
Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.
Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.
Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.
Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.
This actor takes a list of URLs and downloads HTML of each page.
Create a screenshot of a website based on a specified URL. The screenshot is stored as the output in a key-value store. It can be used to monitor web changes regularly after setting up the scheduler.
Scrapes vehicle listings from Copart public search URLs and single lot pages. Returns each lot as a flat row with optional VIN enrichment for manufacturer and country of origin.
Scrapes TennisExplorer match results by date and tour. Returns each match as a flat row with set-by-set scores, odds, and player details. Export to CSV, JSON, Excel, or XML.
Scrape Bring a Trailer auction listings from any page. Get titles, bids, time left, and descriptions. Export to CSV, JSON, Excel, or XML.
Scrapes Ahrefs free tools for website authority, backlinks, and keyword difficulty. Returns each result as a flat row for bulk domains or keywords.
Scrapes StubHub event listings by search query or direct URL. Returns each ticket with price, section, row, quantity, and deal score.
Scrapes FMCSA carrier safety profiles by company name, DOT number, or MC number and returns each carrier as a flat row with operating authority, safety rating, insurance status, and fleet details.
Scrapes Crunchbase company and person profiles from URLs or keyword searches. Returns funding rounds, investors, acquisitions, and firmographic data as flat rows.
Scrapes Ticketmaster events by search query, location, date range, category, or direct URL. Returns each event as a flat row with date, venue, price range, and ticket status. Optionally fetches full detail pages for pricing and descriptions.
Scrape daily product launches from Product Hunt with votes, comments, daily rank, topics, makers, descriptions and product websites.
Scrapes Indian import and export shipment records from Zauba by product keyword or direct URL. Returns HS code, date, port, country, quantity, and unit price for each row.
Scrapes government bid solicitations from BidNet Direct. Returns bid title, URL, status, publication date, closing date, and optional detail fields. Filter by keyword, location, category, agency type, and date.
Scrapes MLB StatsAPI endpoints for teams, people, schedule, venues, leagues, divisions, and seasons. Returns flat rows for easy export.
Scrape FINRA BrokerCheck for individual brokers and firms. Search by name, CRD, firm, city, state, or exam. Get registration history, disclosures, and exam records. Export to CSV, JSON, Excel, or XML.
Queries the Wayback Machine CDX index for a URL or domain and returns each snapshot as a flat row with timestamp, original URL, snapshot URL, HTTP status, MIME type, and content digest. Filter by date, status, and MIME type server-side.
Renders a list of URLs in a headless browser and returns a screenshot for each one, with optional HTML snapshots and mobile variants.
Downloads Loom videos from share or embed URLs and returns the MP4 download link, full transcript, and WebVTT captions for each video.
Scrapes Kalshi prediction markets by status, event ticker, or series ticker. Returns each market as a flat row with ticker, category, prices, volume, and settlement data.
Scrapes openly licensed images and audio from Openverse by search term, media type, license, source, and aspect ratio. Returns each result as a flat row with direct media URL, title, creator, license, and source.
Scrapes academic papers from Semantic Scholar search results. Returns each paper as a flat row with title, authors, year, citations, venue, and abstract. Supports year and PDF filters.
Extract stock and crypto price data from Yahoo Finance. Get OHLCV (open, high, low, close, volume) for any symbol. Supports stocks, crypto, forex, ETFs. Multiple intervals (1m to 1mo) and ranges (1d to max). No proxy needed.
Scrapes Google Ads from the Transparency Center by advertiser name, domain, or direct URL. Returns each ad with its creative, format, targeting, and regional stats.
Scrapes clinical trial records from ClinicalTrials.gov by search query or direct URL. Returns each trial as a flat row with status, phase, enrollment, eligibility, contacts, locations, and posted dates.
Scrapes professor and school profiles from Rate My Professors by search query or direct URL. Returns ratings, difficulty, reviews, and school metrics as flat rows.
Scrapes Podchaser podcasts, episodes, or creator profiles by search query or direct URL. Each row returns the title, description, rating, host and guest names, social links, and optional Apple Podcasts and Spotify chart positions.
Scrapes Finviz stock screener results by ticker, signal, or any filter combination. Returns each stock as a flat row with price, valuation, fundamentals, technicals, and ownership data. Optional enrichment adds 70+ fields per ticker.
Scrapes Chrome Web Store extension listings by keyword search or extension ID. Returns each extension as a flat row with title, description, rating, user count, category, and developer details.
Track FedEx packages by tracking number and get every scan event with status, location, timestamp, and delivery estimate in a structured dataset. Residential proxies handle Akamai protection.
Convert images between JPEG, PNG, WEBP, AVIF, and SVG formats. Upload files or paste URLs, set quality and aspect ratio, and get converted images as a dataset.
Scrapes the FAA aircraft registry from seven official datasets. Returns aircraft registration, dealer, engine, and document records as flat rows with full detail.
Scrapes MMA events, UFC news, and team listings from ESPN. Returns each fight result, news article, or athlete record as a flat row.
Scrapes yacht listings from a YATCO search URL and returns each vessel as a flat row with its specifications, pricing, and broker details.
Scrapes MLB game data from the ESPN scoreboard by season or date. Returns each game as a flat row with teams, scores, status, and box-score details.
Scrapes Apify Store actor listings by search term, category, pricing model, or maintainer. Returns each actor as a flat row with title, description, pricing, stats, and optional quality scores.
Scrapes federal award and sub-award records from USAspending.gov. Returns each award as a flat row with dollar amount, recipient, agency, location, and classification codes.
Scrapes civil and probate case records from the Harris County District Clerk public portal. Returns case number, type, status, court, filing date, and optional party and event details.
Scrapes Bing Search results for a list of queries and returns each result as a flat row with title, URL, description, and rank. Filter by country, language, freshness, and SafeSearch.
Generate short links from multiple providers (Bitly, Rebrandly, TinyURL, Short.io, L8.nu) in one run. Provide URLs and API keys, get short links with optional custom slugs.
Scrapes trademark records from TMview by name or keyword and returns each one as a flat row with Nice classes, applicant, status, and filing dates. Filter by IP office or legal status.
Scrapes iPhone and iPad apps from the Apple App Store by search term, app ID, or top chart collection. Returns each app as a flat row with name, developer, price, rating, and category.
Scrapes Liquipedia wiki pages by exact title or category across 24 esports games. Returns each page with its full parsed HTML body and metadata.
Scrapes Data.gov catalog search results by keyword or URL. Returns each dataset as a flat row with title, description, publisher, formats, and metadata. Export to CSV, JSON, Excel, or XML.
Scrapes arXiv preprints by search query, category, or paper ID and returns each paper's metadata as a flat row. Supports bulk collection up to a million papers per run.
Scrapes Numbeo cost of living indices, country rankings, city prices, and two-city comparisons. Returns each item as a flat row for export to CSV, JSON, Excel, or XML.
Access detailed nonprofit data from ProPublica's Nonprofit Explorer. For grant researchers, fundraising teams, and due diligence professionals who need accurate nonprofit financials without manual lookup. Unofficial tool, not affiliated with or endorsed by Candid, GuideStar, or ProPublica, Inc.
Scrapes exercises from the wger open fitness database. Returns name, description, category, muscles, equipment, and image URLs. Filter by language, category, equipment, or muscle.
Scrape Google Play Store app listings by keyword search or package ID. Returns each app's title, developer, rating, installs, price, description, reviews, and similar apps as a flat row.
Search crt.sh certificate transparency logs for a domain and discover subdomains. Get common name, SANs, issuer, validity dates, and serial number per certificate.
Scrapes FRED economic data series by search query or category ID. Returns series metadata and optional historical observations as flat rows.
Scrapes OpenAlex scholarly works, authors, institutions, sources, concepts, publishers, and funders. Returns each record as a flat row with metadata, citations, and open access links.
Scrapes franchise registration records from the NASAA Electronic Filing Depository by keyword or full directory crawl. Returns each franchise as a flat row with optional detail-page fields including contacts and state filings.
Scrapes live soccer scores and match results from the ESPN scoreboard for 19 major leagues. Returns each match as a flat row with teams, score, and status.
Scrapes the Have I Been Pwned breach catalog by full list, domain filter, or single breach name. Returns each breach as a flat row with title, date, compromised accounts, and exposed data classes.
Export football competitions, standings, fixtures, results, and team data covering the Premier League, La Liga, Bundesliga, Serie A, Ligue 1, Champions League, and 180+ other competitions worldwide.
Queries the Common Crawl URL index for a domain or URL and returns each crawl record as a flat row with timestamp, status code, MIME type, and crawl ID. Supports filters for date, status, and MIME type.
The full list, sorted by user count. The most popular data extraction actors are shown as cards above.
Pick a tool from our data extraction collection. Most have free tiers. Get your first data in under 5 minutes.