Documentation / Changelog

Changelog

Full release history for WebPeel. New versions ship frequently — follow GitHub Releases or @webpeel_dev for updates.

v0.21.39 — 2026-03-16
Domain Extraction Error Diagnostics Patch
  • Domain extraction errors now exposed in the warnings response field for easier debugging
v0.21.38 — 2026-03-16
Research LLM Prompt Optimization Patch
  • Compact Ollama prompt — research synthesis now 8.5s (was 26s)
  • Reduced source content to 800 chars with 30s timeout for faster responses
v0.21.37 — 2026-03-16
Research Quality Overhaul Patch
  • Research quality overhaul with SearXNG Google boost and debug logging
v0.21.36 — 2026-03-16
Ollama Performance Fix Patch
  • Ollama think:false — 8s synthesis (was 25s+)
v0.21.35 — 2026-03-16
Research LLM Tuning Patch
  • Reduced source content to 1200 chars, 25s timeout, 800 max tokens for research LLM
v0.21.34 — 2026-03-16
Research LLM Token Fix Patch
  • Bumped research LLM maxTokens to 1200 — Qwen3 thinking mode needs extra headroom
v0.21.33 — 2026-03-16
Self-Hosted LLM for Research Minor
  • WebPeel AI on Hetzner: Self-hosted Ollama (Qwen3 0.6B) for research synthesis — no external LLM API needed
  • Free-tier users get AI-powered research with zero BYOK configuration
v0.21.32 — 2026-03-16
SearXNG Integration Minor
  • SearXNG Stage 0 search provider: Self-hosted meta-search engine aggregating Google, Bing, Brave, Startpage, and more
  • Runs on Mac Mini with residential IP, exposed via Cloudflare Tunnel — highest reliability for search
v0.21.31 — 2026-03-16
Search Order Fix Patch
  • Reversed DDG search order — direct requests first, proxy as fallback (better latency)
v0.21.30 — 2026-03-16
Search Lockout Fix Patch
  • Fixed search provider lockout — providerStats now decays over time with higher minSamples threshold
v0.21.29 — 2026-03-16
Research Endpoint + Stealth Headers Minor
  • New POST /v1/research endpoint: Lightweight research that chains search → fetch → compile
  • Improved stealth headers for better anti-bot bypass
  • Search provider improvements and better error handling
v0.21.28 — 2026-03-15
DDG Search Proxy Fallback Patch
  • DuckDuckGo search now falls back to proxy on direct failure — improved reliability on datacenter IPs
v0.21.27 — 2026-03-15
Webshare Proxy Format Fix Patch
  • Fixed Webshare backbone proxy format — uses fixed port + slot username
v0.21.26 — 2026-03-15
Proxy-Routed Search Patch
  • DuckDuckGo search now routed through proxy — fixes 0-result issue on datacenter IPs
v0.21.25 — 2026-03-15
Domain Hints for Structured Extraction Minor
  • Structured extraction now overlays domain-specific hints for better field matching
  • Added noEscalate flag to prevent unnecessary browser escalation during extraction
v0.21.24 — 2026-03-15
OOM Prevention Patch
  • Added noEscalate on fetch and NO_BROWSER_SEARCH guard to prevent out-of-memory crashes
v0.21.23 — 2026-03-15
Lightweight Enrichment Patch
  • Search enrichment now uses simpleFetch + cheerio — no browser, no OOM risk
v0.21.22 — 2026-03-15
Search Enrichment OOM Hotfix Patch
  • Prevent OOM in search enrichment — forces render:false and stealth:false
v0.21.21 — 2026-03-15
Server-Side Search Enrichment Minor
  • New ?enrich=N parameter: Server-side fetch of top N search result pages with 4s timeout
  • Returns full markdown content alongside search snippets — no extra API calls needed
v0.21.20 — 2026-03-15
GitHub Domain Extractor Debug Patch
  • Debug fixes for GitHub domain extractor; removed health endpoint env diagnostics
v0.21.19 — 2026-03-15
Health Endpoint Diagnostics Patch
  • Added env var diagnostics to health endpoint for debugging GITHUB_TOKEN issues
v0.21.18 — 2026-03-15
Admin + Enterprise Tiers Minor
  • Fixed admin tier type and burst bypass; added enterprise tier support
  • Structured extraction improvements for edge cases
v0.21.17 — 2026-03-15
Admin Burst Bypass + Enterprise Tiers Minor
  • Admin burst bypass for unrestricted API access
  • Enterprise tier with 50K weekly / 2K burst / 500 rate limits
  • Structured extraction improvements
v0.21.16 — 2026-03-15
Structured Extraction Improvements + GitHub Token Refresh Patch
  • Structured extraction: version (semver), downloads, and population patterns added; improved field:value separator matching
  • NPM extractor now reliably extracts version, weekly_downloads, and license
  • Refreshed expired GITHUB_TOKEN on Render — resolves "Bad credentials" errors on GitHub API requests
v0.21.15 — 2026-03-15
Token Savings Fix + HN Comment Items Patch
  • tokenSavingsPercent was always 0 for domain-API extractors — now estimates raw size as 7× content for realistic savings
  • HackerNews comment items (/item?id=) now return "Comment on: {story title}" instead of blank title
v0.21.14 — 2026-03-15
GitHub API Authentication Patch
  • GitHub extractor now authenticates with GITHUB_TOKEN — raises rate limit from 60/hr (anonymous) to 5,000/hr
  • Fixes low/empty token counts for GitHub pages on Render's shared IP addresses
v0.21.13 — 2026-03-15
PyPI Title Fix + Env Var Restore Patch
  • PyPI extractor now returns a proper title field (name version format)
  • Restored all 12 required Render env vars that were accidentally wiped; fixes deploys since v0.21.5
v0.21.12 — 2026-03-15
Structured Extraction Polish Patch
  • Emoji stripping from extractor output; new director field for movies; more accurate confidence scoring
  • Richer domain extractors with smarter fallbacks; actionable error messages with docs links
v0.21.11 — 2026-03-15
PeelTLS H2 Fix + Search Relevance + CLI Progress Patch
  • Fixed double-decompression bug on HTTP/2 responses; added forceHttp1 option
  • relevanceScore (0–1) now returned on search results (BM25 score against query)
  • Better CLI progress indicators for long-running fetches
v0.21.9–10 — 2026-03-15
Complete Anti-Bot Stealth Upgrade Minor
  • Nine independent anti-bot detection patches — TLS fingerprinting, header ordering, timing randomization
  • Improved PeelTLS escalation logic — triggers earlier on Cloudflare/DataDome sites
  • Full test verification pass after stealth upgrade
v0.21.8 — 2026-03-15
Proxy Routing for Search and Browser Minor
  • --proxy now applies to search providers and headless browser rendering
  • Shared proxy-config module — centralized proxy parsing across all transport layers
v0.21.7 — 2026-03-14
Smart Heuristic Extraction + Improved Error Classification Minor
  • Auto-extraction uses page-type-specific heuristics (product, article, recipe, job listing)
  • Errors now categorized as blocked, timeout, parse_error, or network_error with hint fields
v0.21.6 — 2026-03-14
Dashboard Polish + Docs Visual Upgrade Patch
  • Activity log color-coded latency (green <3s, yellow 3–8s, red >8s)
  • Improved code block styling, better mobile layout, fixed sidebar active states
v0.21.5 — 2026-03-14
Structured JSON Extraction Minor
  • POST /v1/extract — LLM-powered extraction using JSON Schema or natural language prompts (BYOK)
  • GET /v1/extract/auto — Zero-LLM heuristic extraction with page-type detection and confidence score
v0.19.5 — 2026-03-07
Architecture Cleanup Minor
  • Shared MCP handler registry — eliminated duplicate handler code across standalone and HTTP paths
  • CLI split into modular command files; entry point trimmed to 81 lines
  • Removed dead endpoints (/v1/agent, /v1/answer/quick)
  • GitHub CI pipeline, issue templates, and release automation added
  • Quality gates: MCP parity check, CLI DX test, and pre-publish gate
v0.19.3 — 2026-03-07
CLI DX Patch
  • Verb-first aliases: webpeel fetch / get / scrape / peel <url> all work
  • --format text|html|json|markdown flag for controlling output format
  • webpeel doctor — diagnostic command to verify config, auth, and connectivity
  • Smarter error messages for invalid or malformed URLs
v0.19.0 — 2026-03-07
Major Features Major
  • /v1/ask — LLM-free web Q&A using search + fetch + BM25 sentence scoring
  • /v1/session — Stateful browser sessions: create, navigate, act, screenshot, close
  • webpeel_act MCP tool wired to live browser interaction
  • CLI webask command for quick web Q&A from the terminal
  • Fixed content field in deep-fetch responses
  • extract/auto POST endpoint added
v0.18.7 — 2026-03-06
CLI Rewrite Minor
  • CLI is now a pure API client — no local Playwright dependency required
  • Install size dropped from ~150 MB to ~2 MB
  • All CLI commands route through api.webpeel.dev
v0.18.5 — 2026-03-06
Dashboard Polish Patch
  • Plan badge capitalization fix
  • Live-refresh sidebar usage counter
  • Usage counter fallback for JWT-authenticated users
  • Product Hunt RSS extractor
v0.18.2 — 2026-03-06
Full Audit Patch
  • 10+ critical/high bugs fixed from 5-agent audit
  • Security: health endpoint no longer exposes version string
  • Dashboard dark mode conversion across 36 files
  • Inline welcome banner replaced blocking modal on first login
v0.18.0 — 2026-03-05
MCP + API Consolidation Major
  • Consolidated 20 MCP tools down to 7 public tools — all 20 legacy names still work
  • Screenshot mode param dispatch (mode selection via request parameter)
  • /v1/fetch enhanced with question=, summary=, and budget= params
  • Email alerts feature for page monitoring
v0.17.26 — 2026-03-04
Product Features Patch
  • Token savings metrics: rawTokenEstimate and tokenSavingsPercent in fetch responses
  • Auto-interact with page obstacles using 60+ CSS selectors (cookie banners, paywalls, overlays)
  • Watch diff mode — ?diff=true returns only changed content
  • Search performance: auto-skip failing providers to reduce latency
Older releases are available on GitHub Releases and the npm version history.