General-purpose web scrapers and crawlers for custom data extraction from any website or web application.
Sorted by recorded actor user counts. Open a listing for publisher details, pricing, and platform ratings.
Crawls arbitrary websites using a web browser and extracts structured data from web pages using a provided JavaScript function. The Actor supports both recursive crawling and lists of URLs, and automatically manages concurrency for maximum performance.
Crawls websites using raw HTTP requests, parses the HTML with the Cheerio library, and extracts data from the pages using a Node.js code. Supports both recursive crawling and lists of URLs. This actor is a high-performance alternative to apify/web-scraper for websites that do not require JavaScript.
Crawls websites with the headless Chromium, Chrome, or Firefox browser and Playwright library using a provided server-side Node.js code. Supports both recursive crawling and a list of URLs. Supports login to a website.
Crawls websites with the headless Chrome and Puppeteer library using a provided server-side Node.js code. This crawler is an alternative to apify/web-scraper that gives you finer control over the process. Supports both recursive crawling and list of URLs. Supports login to website.
This actor takes a list of URLs and downloads HTML of each page.
Create a screenshot of a website based on a specified URL. The screenshot is stored as the output in a key-value store. It can be used to monitor web changes regularly after setting up the scheduler.
Scrapes TennisExplorer match results by date and tour. Returns each match as a flat row with set-by-set scores, odds, and player details. Export to CSV, JSON, Excel, or XML.
Pull SEO metrics from Ahrefs free tools: Domain Rating, backlinks, referring domains, organic traffic, keyword difficulty, and search volume. Submit a domain or keyword and get structured results. Export to JSON, CSV, or Excel for SEO research.
Collect public government bid listings from BidNetDirect using direct listing URLs or live search filters such as keywords, status, category, location, publish date, and agency type.
Scrapes Indian import and export shipment records from Zauba by product keyword or direct URL. Returns HS code, date, port, country, quantity, and unit price for each row.
Renders a list of URLs in a headless browser and returns a screenshot for each one, with optional HTML snapshots and mobile variants.
Scrapes MLB StatsAPI endpoints for teams, people, schedule, venues, leagues, divisions, and seasons. Returns flat rows for easy export.
Queries the Wayback Machine CDX index for a URL or domain and returns each snapshot as a flat row with timestamp, original URL, snapshot URL, HTTP status, MIME type, and content digest. Filter by date, status, and MIME type server-side.
Downloads Loom videos from share or embed URLs and returns the MP4 download link, full transcript, and WebVTT captions for each video.
Scrapes Kalshi prediction markets by status, event ticker, or series ticker. Returns each market as a flat row with ticker, category, prices, volume, and settlement data.
Scrapes academic papers from Semantic Scholar search results. Returns each paper as a flat row with title, authors, year, citations, venue, and abstract. Supports year and PDF filters.
Extract stock and crypto price data from Yahoo Finance. Get OHLCV (open, high, low, close, volume) for any symbol. Supports stocks, crypto, forex, ETFs. Multiple intervals (1m to 1mo) and ranges (1d to max). No proxy needed.
Scrapes openly licensed images and audio from Openverse by search term, media type, license, source, and aspect ratio. Returns each result as a flat row with direct media URL, title, creator, license, and source.
Scrapes Google Ads from the Transparency Center by advertiser name, domain, or direct URL. Returns each ad with its creative, format, targeting, and regional stats.
Scrapes clinical trial records from ClinicalTrials.gov by search query or direct URL. Returns each trial as a flat row with status, phase, enrollment, eligibility, contacts, locations, and posted dates.
Scrape Action Network sports odds with public betting splits, line movement, player props, weather, injuries and ATS standings. NFL, NBA, MLB, NHL, NCAAF, soccer, UFC and tennis. No login, no API key, no proxy.
Scrapes professor and school profiles from Rate My Professors by search query or direct URL. Returns ratings, difficulty, reviews, and school metrics as flat rows.
Get YouTube transcripts from video URLs or IDs: timestamped segments, plain text, word count, optional SRT, plus title, channel, views and caption languages. Creator-made captions come first. Videos without captions get a free error row. 37 of 37 test requests returned a transcript.
Scrapes Finviz stock screener results by ticker, signal, or any filter combination. Returns each stock as a flat row with price, valuation, fundamentals, technicals, and ownership data. Optional enrichment adds 70+ fields per ticker.
Scrapes Podchaser podcasts, episodes, or creator profiles by search query or direct URL. Each row returns the title, description, rating, host and guest names, social links, and optional Apple Podcasts and Spotify chart positions.
Scrapes Chrome Web Store extension listings by keyword search or extension ID. Returns each extension as a flat row with title, description, rating, user count, category, and developer details.
Scrapes MMA events, UFC news, and team listings from ESPN. Returns each fight result, news article, or athlete record as a flat row.
Scrapes federal award and sub-award records from USAspending.gov. Returns each award as a flat row with dollar amount, recipient, agency, location, and classification codes.
Scrapes Apify Store actor listings by search term, category, pricing model, or maintainer. Returns each actor as a flat row with title, description, pricing, stats, and optional quality scores.
Scrape ESPN MLB public scoreboard for games, innings, scores, pitcher, batter, venue, weather, and probables.
Convert images between JPEG, PNG, WEBP, AVIF, and SVG formats. Upload files or paste URLs, set quality and aspect ratio, and get converted images as a dataset.
Scrapes the FAA aircraft registry from seven official datasets. Returns aircraft registration, dealer, engine, and document records as flat rows with full detail.
Search crt.sh certificate transparency logs for a domain and discover subdomains. Get common name, SANs, issuer, validity dates, and serial number per certificate.
Generate short links from multiple providers (Bitly, Rebrandly, TinyURL, Short.io, L8.nu) in one run. Provide URLs and API keys, get short links with optional custom slugs.
Scrapes Liquipedia wiki pages by exact title or category across 24 esports games. Returns each page with its full parsed HTML body and metadata.
Scrapes exercises from the wger open fitness database. Returns name, description, category, muscles, equipment, and image URLs. Filter by language, category, equipment, or muscle.
Scrapes trademark records from TMview by name or keyword and returns each one as a flat row with Nice classes, applicant, status, and filing dates. Filter by IP office or legal status.
Scrapes Data.gov catalog search results by keyword or URL. Returns each dataset as a flat row with title, description, publisher, formats, and metadata. Export to CSV, JSON, Excel, or XML.
Scrapes Numbeo cost of living indices, country rankings, city prices, and two-city comparisons. Returns each item as a flat row for export to CSV, JSON, Excel, or XML.
Scrapes arXiv preprints by search query, category, or paper ID and returns each paper's metadata as a flat row. Supports bulk collection up to a million papers per run.
Scrapes live soccer scores and match results from the ESPN scoreboard for 19 major leagues. Returns each match as a flat row with teams, score, and status.
Scrapes DAT Trendlines national rate history, load-to-truck ratios, trend percentages, and fuel prices. Returns each observation as a flat row tagged by dataset.
Scrapes the Have I Been Pwned breach catalog by full list, domain filter, or single breach name. Returns each breach as a flat row with title, date, compromised accounts, and exposed data classes.
Scrapes Songlink / Odesli to resolve track and album URLs from any platform into links on all other streaming services. Returns one row per resolved link with source platform, destination platform, and URL. Supports country-specific links and bulk processing.
Queries the Common Crawl URL index for a domain or URL and returns each crawl record as a flat row with timestamp, status code, MIME type, and crawl ID. Supports filters for date, status, and MIME type.
Scrape 240,000+ football matches from Football-Data.co.uk: 38 competitions, results, half-time scores, shots, cards, corners, referees, xG, and 1X2 / over-under / Asian handicap odds from 22 bookmakers.
Scrapes FRED economic data series by search query or category ID. Returns series metadata and optional historical observations as flat rows.
Export football competitions, standings, fixtures, results, and team data covering the Premier League, La Liga, Bundesliga, Serie A, Ligue 1, Champions League, and 180+ other competitions worldwide.
Scrapes anime and manga entries from AniList by search term with filters for format, status, season, year, and genre. Returns each title as a flat row with full metadata.
Export nflverse NFL data releases. Pull play-by-play, schedules, rosters, player stats, weekly stats, snap counts, and more. Filter by dataset type and season. Returns release metadata + download links for CSV / Parquet / RDS files covering all NFL seasons.
Scrapes OpenAlex scholarly works, authors, institutions, sources, concepts, publishers, and funders. Returns each record as a flat row with metadata, citations, and open access links.
Scrape Google Play Store app listings by keyword search or package ID. Returns each app's title, developer, rating, installs, price, description, reviews, and similar apps as a flat row.
Scrapes Soccerway football match data by date offset, status, and league name. Returns each fixture or result as a flat row with score, kick-off time, and competition.
Search every US state franchise registry that publishes FDD filings in one run: California DFPI, Wisconsin DFI, Minnesota CARDS, Virginia SCC and the NASAA depository states. Returns filings, dates, status, document links, FDD PDFs, Item 19 data and fee and investment ranges.
Scrapes MetalPrices.com for historical and current prices of 23 metals. Returns each price record with metal, price, unit, date, and currency in one flat row.
Scrapes TMDB movie, TV show, and person records by search term or curated list (popular, trending, top-rated, now playing, upcoming). Returns each title as a flat row with ratings, release date, overview, and poster path.
Scrapes MTG Commander rankings and deck composition from EDHREC. Returns top commanders by week, month, year, or all-time, and full card breakdowns with synergy scores for any commander slug. Optional card details include prices, salt, and color identity.
Scrape municipal bond securities from EMMA by state, with optional filters for issuer name and coupon rate. Returns issuer, coupon, maturity, yield, principal, and rating.
Scrapes Justia case law by court and year range. Returns full opinion text, docket number, date, court, and citation for each case.
Scrapes the Official World Golf Ranking for players matching a name or country filter. Returns each player's rank, average points, total points, events played, and points lost and gained this week.
The full list, sorted by user count. The most popular data extraction actors are shown as cards above.
Pick a tool from our data extraction collection. Review current actor charges before running a small sample.