Skip to content

fix: Add 'openrag' auth mode and ingest fields#1683

Merged
phact merged 1 commit into
group-dls-part-2from
hotfix_flows
May 26, 2026
Merged

fix: Add 'openrag' auth mode and ingest fields#1683
phact merged 1 commit into
group-dls-part-2from
hotfix_flows

Conversation

@edwinjosechittilappilly

Copy link
Copy Markdown
Collaborator

Introduce support for an 'openrag' authentication mode that delegates writes to an OpenRAG backend ingest callback. Adds new inputs (openrag_ingest_token, openrag_ingest_run_id) and exposes openrag_ingest_url/batch_size fields as configurable (and required when openrag is selected). Update auth_mode options/default to include 'openrag', validate required OPENRAG_* fields in _build_auth_kwargs, and adjust the dynamic UI build logic to show/require OpenRAG fields when appropriate. Update ingestion flow JSON to mirror these input/option changes. This enables ingestion via OpenRAG callbacks without direct OpenSearch credentials.

Introduce support for an 'openrag' authentication mode that delegates writes to an OpenRAG backend ingest callback. Adds new inputs (openrag_ingest_token, openrag_ingest_run_id) and exposes openrag_ingest_url/batch_size fields as configurable (and required when openrag is selected). Update auth_mode options/default to include 'openrag', validate required OPENRAG_* fields in _build_auth_kwargs, and adjust the dynamic UI build logic to show/require OpenRAG fields when appropriate. Update ingestion flow JSON to mirror these input/option changes. This enables ingestion via OpenRAG callbacks without direct OpenSearch credentials.
Copilot AI review requested due to automatic review settings May 26, 2026 18:01
@coderabbitai

coderabbitai Bot commented May 26, 2026

Copy link
Copy Markdown
Contributor

Important

Review skipped

Auto reviews are disabled on base/target branches other than the default branch.

Please check the settings in the CodeRabbit UI or the .coderabbit.yaml file in this repository. To trigger a single review, invoke the @coderabbitai review command.

⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: CHILL

Plan: Pro

Run ID: d487602b-1aa9-499d-9985-92546b4e074e

You can disable this status message by setting the reviews.review_status to false in the CodeRabbit configuration file.

Use the checkbox below for a quick retry:

  • 🔍 Trigger review
✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
  • Commit unit tests in branch hotfix_flows

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

@github-actions github-actions Bot added the bug 🔴 Something isn't working. label May 26, 2026
@github-actions github-actions Bot added the lgtm label May 26, 2026
@phact
phact merged commit 1096d07 into group-dls-part-2 May 26, 2026
8 of 10 checks passed
@github-actions
github-actions Bot deleted the hotfix_flows branch May 26, 2026 18:02
@edwinjosechittilappilly
edwinjosechittilappilly removed the request for review from Copilot May 26, 2026 18:22
edwinjosechittilappilly added a commit that referenced this pull request May 29, 2026
* group canonicalization to avoid collisions, security config, integration test

* style: ruff format (auto)

* centralize jwt construction path, fix webhook bug

* bug fixes

* style: ruff format (auto)

* pr feedback

* style: ruff format (auto)

* missing etst

* remove doc loading from playwright e2e test, add new integration test for coverage

* style: ruff format (auto)

* lint, mypy fixes

* Fix integration test startup lifecycle

* Fix onboarding integration and e2e flakes

* new shape, dls principals backed by OS principals index

* fix so ibm does index refresh

* principal per user refresh ttl for check and index update

* Fix DLS ingestion mapping client

* style: ruff format (auto)

* Fix DLS writes in ingestion paths

* Repair roleless users during sign-in

* Fix integration reload isolation

* Fix Langflow DLS ingestion preflight

* style: ruff format (auto)

* Avoid delete by query under DLS

* Avoid bulk writes under DLS

* Stabilize onboarding e2e waits

* pre merge

* mypy fix

* OR does the ingest instead of langflow

* use gvpassthrough

* Fix Langflow ingest callback globals

* Wire Langflow ingest callback globals through flow

* Fix Langflow ingest callback globals

* Fix Langflow response fallback and env globals

* fix nudges

* Fix OpenSearch search results table output

* Restore sample docs Langflow indexing coverage

* Use real default docs in onboarding sample test

* style: ruff autofix (auto)

* Re-enable sample data ingest in e2e

* Fix Langflow ingest callback token handling

* Fix Langflow callback ids and chat sources

* skip source extraction integration test

* get rid of per request opensearch jwts

* style: ruff autofix (auto)

* Use keyed hashes for API keys

* Fix OpenSearch JWT propagation

* style: ruff autofix (auto)

* Fix operator env example merge markers

* Add 'openrag' auth mode and ingest fields (#1683)

Introduce support for an 'openrag' authentication mode that delegates writes to an OpenRAG backend ingest callback. Adds new inputs (openrag_ingest_token, openrag_ingest_run_id) and exposes openrag_ingest_url/batch_size fields as configurable (and required when openrag is selected). Update auth_mode options/default to include 'openrag', validate required OPENRAG_* fields in _build_auth_kwargs, and adjust the dynamic UI build logic to show/require OpenRAG fields when appropriate. Update ingestion flow JSON to mirror these input/option changes. This enables ingestion via OpenRAG callbacks without direct OpenSearch credentials.

* Add OpenRAG ingest debug logging and token masking (#1684)

Improve observability and safety for OpenRAG ingest callbacks: trim callback inputs, mask tokens when logging, and emit structured debug payloads. Added request-level summaries and per-batch/response logging (including status, headers and body preview) and attempt to call self.log where available. Also include the callback URL in error messages to aid troubleshooting. Changes touch the OpenSearch multimodal component and the flow JSON that embeds the updated component code.

* readable principal names

* style: ruff autofix (auto)

* lint fix

* style: ruff autofix (auto)

* lint fix

* style: ruff autofix (auto)

* Add typing annotations to services and settings

Import typing.Any and add explicit type annotations to several module-level and local variables for better static type checking: DLS_PRINCIPAL_INDEX_BODY in src/config/settings.py; query in src/services/file_service.py; filter_clauses and fallback_search_body in src/services/search_service.py. No functional changes; only type hints added for clarity and mypy/IDE support.

* lint fix

* style: ruff autofix (auto)

* lint fix

* strip issue regression

* style: ruff autofix (auto)

* faster integration tests / better instrumentation

* Add split integration suite runner

---------

Co-authored-by: autofix-ci[bot] <114827586+autofix-ci[bot]@users.noreply.github.com>
Co-authored-by: Edwin Jose <edwin.jose@datastax.com>
Co-authored-by: Edwin Jose <edwinjose900@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

bug 🔴 Something isn't working. lgtm

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants