Skip to content

DOC-04: DEFAULT_MAX_PAGES = -1 means configs without max_pages crawl unbounded (decision: keep -1 for now) #408

@yusufkaraaslan

Description

@yusufkaraaslan

From the #404 audit (docs/BUG_AUDIT.md → DOC-04).

A config that omits max_pages crawls the whole site (DEFAULT_MAX_PAGES = -1 → unlimited). A finite default would be safer, but it's a user-visible behavior change for every existing config.

Decision (2026-06-10): keep -1 (unbounded) for now — do not change the default unilaterally. Tracking here so the footgun is documented. If revisited, the fix is a finite default + a documented --max-pages -1 / config opt-in for unlimited + CHANGELOG note.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions