mjasin/Nexus.Reader
1
0
Fork 0
Code Issues 9 Pull Requests 2 Actions Packages Projects Releases Wiki Activity

feat: KM-RAG Polyglot Ingestion Pipeline Migration #46

Merged
mjasin merged 1 commits from feature/km-rag-migration into develop 2026-05-20 18:15:28 +00:00
Conversation 1 Commits 1 Files Changed 15
+348 -287
Antigravity commented 2026-05-20 17:55:52 +00:00
Collaborator
Copy Link
Copy Source

Resolves the KM-RAG Polyglot Persistence and Background Ingestion Pipeline Migration task.

Key Changes

  1. Infrastructure Migration: Integrated Qdrant (for vector embeddings) and Neo4j (for concept graphs), reducing reliance on PostgreSQL pgvector storage.
  2. Concurrent Background Job: Implemented a robust Hangfire EbookIngestionJob utilizing Polly exponential retries for transient 429 rate limits, executing three core ingestion tasks concurrently via Task.WhenAll.
  3. Data Layer: Standardized database schemas and entities; retained Pgvector.EntityFrameworkCore for migration compilation compatibility.
  4. Wasm Client & Tests: Implemented client support for semantic search and refactored related tests in QueryTests.cs to mock IKnowledgeService.

Verification Status

  • Build: Successfully compiles with dotnet build NexusReader.slnx --no-restore (0 errors).
  • Tests: All 5 unit tests pass cleanly with dotnet test NexusReader.slnx --no-restore.

Resolve #47

Resolves the KM-RAG Polyglot Persistence and Background Ingestion Pipeline Migration task. ### Key Changes 1. **Infrastructure Migration**: Integrated Qdrant (for vector embeddings) and Neo4j (for concept graphs), reducing reliance on PostgreSQL pgvector storage. 2. **Concurrent Background Job**: Implemented a robust Hangfire `EbookIngestionJob` utilizing Polly exponential retries for transient 429 rate limits, executing three core ingestion tasks concurrently via `Task.WhenAll`. 3. **Data Layer**: Standardized database schemas and entities; retained `Pgvector.EntityFrameworkCore` for migration compilation compatibility. 4. **Wasm Client & Tests**: Implemented client support for semantic search and refactored related tests in `QueryTests.cs` to mock `IKnowledgeService`. ### Verification Status - **Build**: Successfully compiles with `dotnet build NexusReader.slnx --no-restore` (0 errors). - **Tests**: All 5 unit tests pass cleanly with `dotnet test NexusReader.slnx --no-restore`. **Resolve** #47
Antigravity added 1 commit 2026-05-20 17:55:52 +00:00
feat: complete KM-RAG polyglot ingestion pipeline migration 03bc649335
mjasin approved these changes 2026-05-20 18:15:23 +00:00
mjasin merged commit 23acaeb705 into develop 2026-05-20 18:15:28 +00:00
mjasin deleted branch feature/km-rag-migration 2026-05-20 18:15:29 +00:00
Sign in to join this conversation.
Reviewers
No Reviewers
mjasin
Labels
No items
No Label
Milestone
No items
No Milestone
Projects
Clear projects
No project
Assignees
Clear assignees
Antigravity M.Wojtaszek mjasin (Marek Jaisński)
No Assignees
2 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: mjasin/Nexus.Reader#46
Delete Branch "feature/km-rag-migration"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?