Commit 55f0ca1
committed
feat: Implement support for a new Azure Blob connector
Issue
- #1957
Summary
- Expanded the Azurite seed script to cover multi-container seeding,
Office document formats (docx, xlsx, pptx, csv, html), and an
in-place `--update` mode for re-ingestion / change-detection testing.
- Standardized bucket/container restriction label copy across S3, IBM
COS, and Azure Blob settings forms.
- Improved `.env.example` Azurite config docs and removed redundant
echo output from the `azurite-up` Makefile target.
Developer Tooling — `scripts/connectors/azure/seed_azurite.py`
- Split single `openrag-test` container into two: `openrag-test-1`
(plain text, markdown, PDF) and `openrag-test-2` (Office/web formats).
- Added pure-Python OOXML builders (`_make_docx`, `_make_xlsx`,
`_make_pptx`) using `zipfile` — no external dependencies.
- Added `BLOBS_1_V2` fixture set (VERSION_2 tagged content) to exercise
re-ingestion and change-detection flows.
- Added `--update` CLI flag to overwrite specific blobs in place without
recreating containers.
- Refactored seeding logic into `_seed_container` and `_update_blobs`
helpers.
Configuration — `.env.example` / `Makefile`
- Expanded Azurite account-key mode docs with explicit per-variable
format for both host-side and in-compose backends.
- Removed redundant configuration echo lines from `azurite-up` target
(now documented in `.env.example`).
Frontend — Connector Settings Forms
- Renamed label "Restrict to Specific Buckets/Containers" →
"Restrict Ingestion to Buckets/Containers" across S3, IBM COS,
and Azure Blob settings forms.
- Shortened helper text to "(optional)" (removed the redundant
"leave all unchecked" parenthetical).1 parent d6596e5 commit 55f0ca1
6 files changed
Lines changed: 492 additions & 39 deletions
File tree
- frontend
- app/settings/_components
- enhancements/connectors
- azure-blob
- ibm-cos
- scripts/connectors/azure
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
180 | 180 | | |
181 | 181 | | |
182 | 182 | | |
183 | | - | |
184 | | - | |
185 | | - | |
| 183 | + | |
| 184 | + | |
| 185 | + | |
| 186 | + | |
| 187 | + | |
| 188 | + | |
| 189 | + | |
| 190 | + | |
186 | 191 | | |
187 | 192 | | |
188 | 193 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
671 | 671 | | |
672 | 672 | | |
673 | 673 | | |
674 | | - | |
675 | | - | |
676 | | - | |
677 | | - | |
678 | | - | |
679 | | - | |
680 | 674 | | |
681 | 675 | | |
682 | 676 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
170 | 170 | | |
171 | 171 | | |
172 | 172 | | |
173 | | - | |
| 173 | + | |
174 | 174 | | |
175 | | - | |
| 175 | + | |
176 | 176 | | |
177 | 177 | | |
178 | 178 | | |
| |||
Lines changed: 2 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
217 | 217 | | |
218 | 218 | | |
219 | 219 | | |
220 | | - | |
| 220 | + | |
221 | 221 | | |
222 | | - | |
| 222 | + | |
223 | 223 | | |
224 | 224 | | |
225 | 225 | | |
| |||
Lines changed: 2 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
275 | 275 | | |
276 | 276 | | |
277 | 277 | | |
278 | | - | |
| 278 | + | |
279 | 279 | | |
280 | | - | |
| 280 | + | |
281 | 281 | | |
282 | 282 | | |
283 | 283 | | |
| |||
0 commit comments