fix: make small pageless documents work on langflowless ingestion

[lucaseduoli]

This pull request introduces several improvements and fixes across both the frontend and backend. The main changes include registering the RowApiModule for AG Grid in the frontend, enhancing the robustness of document processing utilities, and ensuring configuration values for chunking are properly set in the document processor.

Frontend Enhancements:

• AG Grid configuration:
  • Registered the RowApiModule in both the module imports and the ModuleRegistry.registerModules call to enable additional row-level API features in AG Grid. [1] [2]

Backend Improvements:

• Document processing utilities:

  • Improved extraction of page_no in extract_relevant by adding a type check for provenance data, preventing errors if the provenance is not a dictionary. [1] [2]

• Document processor configuration:

  • Updated process_document_standard to fall back to workspace configuration values for chunk_size and chunk_overlap if they are not explicitly provided, ensuring consistent chunking behavior.

[coderabbitai]

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: 40c94998-42e3-41fb-9b51-a322cc610ab2

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

• 🔍 Trigger review

✨ Finishing Touches

🧪 Generate unit tests (beta)

• Create PR with unit tests
• Commit unit tests in branch fix/disable_ingestion_page_n

---

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

• X
• Mastodon
• Reddit
• LinkedIn

_{Comment @coderabbitai help to get the list of available commands.}

[mfortman11]

Good fix