Website Content Crawler
by parseforge
Crawls websites from starting URLs and returns each page's full text content as Markdown and cleaned HTML, ready for AI and LLM pipelines. It runs on Apify at $0.0250/result and has 116 users.
Actor pages combine Apify platform data with editorial review. We keep affiliate links separate from the ranking and update or remove pages when the actor changes. Read our methodology or send a correction to hello@tryapify.com.
TL;DR: Website Content Crawler by parseforge is built for ai & llm workflows. It has 116 users and runs on $0.0250/result.
What It Does
Crawls websites from starting URLs and returns each page's full text content as Markdown and cleaned HTML, ready for AI and LLM pipelines.
Key Stats
- Users
- 116
- Total Runs
- 378
- Pricing
- $0.0250/result
- Rating
- View on Apify →
Quick Answers
Teams that need a ready-made ai & llm actor and want to compare pricing, reviews, and actor activity before running it.
Test a small run first, export the sample output, then decide whether the pricing model works for your volume.
parseforge/website-content-crawler
$0.0250/result
Related Docs
What is Apify? Plain-English review of actors, pricing, and pros
Apify is a cloud platform with 2,000+ pre-built web scrapers (actors). Free tier included. Here is what it does, how pricing works, and who it suits.
Read guide →Apify API: get your token and run actors from Python or JavaScript
How to use the Apify API: get your token, install the Python or JS client, start actor runs, and pull datasets into your app. Code examples included.
Read guide →Scraping Dynamic Websites
How to scrape JavaScript-rendered websites using Playwright and Puppeteer. Learn browser automation, wait strategies, and handling single-page apps for dynamic scraping.
Read guide →Common Questions
What is Website Content Crawler?
Crawls websites from starting URLs and returns each page's full text content as Markdown and cleaned HTML, ready for AI and LLM pipelines.
How much does Website Content Crawler cost?
Website Content Crawler costs $0.0250/result on Apify, and the free tier lets you test it before upgrading.
Is Website Content Crawler free?
Website Content Crawler is not fully free, but Apify provides a free tier so you can test it before paying for usage.
How to use Website Content Crawler?
Open Website Content Crawler on Apify, configure the input for the data you want to scrape, run the actor, and export the results when the run completes.
Free tier available. No credit card needed.
We earn commission from qualifying purchases. This does not affect our ratings.
Related Tools
RAG Web Browser
Web search and fetch tool for AI agents and RAG pipelines. It queries Google Search, scrapes the top N pages using a full web browser, and returns their content as clean Markdown for further processing by an LLM. Can also fetch individual URLs.
Website Content Crawler
Crawl websites and extract text content to feed AI models, LLM applications, vector databases, or RAG pipelines. The Actor supports rich formatting using Markdown, cleans the HTML, downloads files, and integrates well with 🦜🔗 LangChain, LlamaIndex, and the wider LLM ecosystem.
Manga Colorizer
AI-powered manga page colorizer. Takes black-and-white manga image URLs and returns fully colored pages with the original line art preserved. Supports batch processing and multiple original languages for accurate text region handling.
Audio Transcriber - Speech to Text
Transcribes audio files from URL or upload into text with timestamps, language, and confidence. Supports WAV, MP3, AIFF, AAC, OGG, FLAC, and more.