From the #404 audit (docs/BUG_AUDIT.md → DOC-04).
A config that omits max_pages crawls the whole site (DEFAULT_MAX_PAGES = -1 → unlimited). A finite default would be safer, but it's a user-visible behavior change for every existing config.
Decision (2026-06-10): keep -1 (unbounded) for now — do not change the default unilaterally. Tracking here so the footgun is documented. If revisited, the fix is a finite default + a documented --max-pages -1 / config opt-in for unlimited + CHANGELOG note.
From the #404 audit (
docs/BUG_AUDIT.md→ DOC-04).A config that omits
max_pagescrawls the whole site (DEFAULT_MAX_PAGES = -1→ unlimited). A finite default would be safer, but it's a user-visible behavior change for every existing config.Decision (2026-06-10): keep
-1(unbounded) for now — do not change the default unilaterally. Tracking here so the footgun is documented. If revisited, the fix is a finite default + a documented--max-pages -1/ config opt-in for unlimited + CHANGELOG note.