feat(search/rag): implement NexusSearchBox, dynamic Qdrant collection auto-provisioning, batch vector ingestion, mobile Serilog logging, and resolve 401 auth handler error (#51)

Resolves #52 This Pull Request introduces the **NexusSearchBox** search feature with premium unified styling, implements a robust **dynamic Qdrant collection auto-provisioning and batch-vector ingestion pipeline**, integrates a unified **Serilog logging infrastructure** for the Blazor Hybrid environment (MAUI), and resolves the **401 Unauthorized API header propagation error** inside mobile builds. ### 🚀 Key Implementations #### 1. Premium `NexusSearchBox` & Semantic Search UI * **NexusSearchBox Component:** Created an elegant search-as-you-type search box with smooth key navigation, quick-clearing, and seamless dynamic styling. * **Unified Aesthetics:** Refactored the search box isolated styling to align perfectly with the dashboard's design system using glassmorphism, `--nexus-neon` token gradients, and smooth pulse/fade animations. * **Semantic Search Integration:** Integrated semantic search query dispatching (`SearchLibrarySemanticallyQuery`) and wired up navigation seamlessly through the updated `ReaderNavigationService`. * **Tests Hardening:** Added/adapted query assertions in `QueryTests.cs` to guarantee safe parameterization and error boundary mapping. #### 2. Qdrant Collection Provisioning & Vector Ingestion * **Dynamic Auto-Provisioning:** Implemented dynamic checking and lazy-creation of the `knowledge_units` collection using 768 dimensions and Cosine distance. * **High-Performance Ingestion:** Optimized `ProcessKnowledgeUnitsAsync` with high-performance batch embedding generation using `_embeddingGenerator` and deterministic MD5 GUIDs for stable, duplicate-free upsertion. * **Database Cache Clear Sync:** Integrated Qdrant collection deletion in `ClearCacheAsync` to ensure absolute consistency between the PostgreSQL database cache and vector database indices. #### 3. Cross-Platform MAUI Logging (Serilog Infrastructure) * **Serilog Integration:** Configured cross-platform Serilog routing in `SerilogConfiguration.cs`, streaming diagnostic logs safely across native platforms and the Blazor Webview container. * **Interop Bridge:** Built `BlazorLoggingBridge.cs` to capture web console messages and pipe them directly to the native host logger. * **Demo Interface:** Added an interactive `SerilogDemo.razor` sandbox under Pages. #### 4. Resolving 401 Load Errors (Authentication Handler Flow) * **Authentication Header Handler:** Implemented the `MobileAuthenticationHeaderHandler` to correctly extract, validate, and inject bearer JWT tokens into outbound API requests. * **Configuration-based API Host:** Structured standard API URI routing to use clean configuration bindings in `appsettings.json`. --- ### 🧪 Verification & Build Status * Run `dotnet build` from the solution root: Successfully compiled the full multi-targeted solution (`Liczba błędów: 0`). * All unit and integration tests successfully executed and verified (`dotnet test`). --------- Co-authored-by: Marek Jasiński <jasins.marek@gmail.com> Co-authored-by: Marek Jaisński <jasins.marek@gmail.com> Reviewed-on: #51 Co-authored-by: Antigravity <antigravity@google.com> Co-committed-by: Antigravity <antigravity@google.com>
2026-05-26 12:15:28 +00:00
parent 758b152a0c
commit a0bf6c15f4
61 changed files with 5111 additions and 570 deletions
@@ -2,12 +2,14 @@
@using NexusReader.Application.Abstractions.Services
@using NexusReader.Application.Queries.Reader
@using NexusReader.Application.Commands.Library
+@using NexusReader.UI.Shared.Services
@using System.Net.Http.Json
@inject IEpubMetadataExtractor MetadataExtractor
@inject ILogger<BookIngestionModal> Logger
@inject HttpClient Http
@inject IReaderNavigationService ReaderNavigation
@inject IJSRuntime JSRuntime
+@inject ISyncService SyncService
@implements IAsyncDisposable

@if (IsOpen)
@@ -16,20 +18,23 @@
        <div class="modal-content glass-panel" @onclick:stopPropagation>
            <div class="modal-header">
                <h2>Add New Book</h2>
-                <button class="close-btn" @onclick="CloseModal">
-                    <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round"><line x1="18" y1="6" x2="6" y2="18"></line><line x1="6" y1="6" x2="18" y2="18"></line></svg>
-                </button>
+                @if (!IsIngesting && !IsIndexing)
+                {
+                    <button class="close-btn" @onclick="CloseModal">
+                        <svg xmlns="http://www.w3.org/2000/svg" width="24" height="24" viewBox="0 0 24 24" fill="none" stroke="currentColor" stroke-width="2" stroke-linecap="round" stroke-linejoin="round"><line x1="18" y1="6" x2="6" y2="18"></line><line x1="6" y1="6" x2="18" y2="18"></line></svg>
+                    </button>
+                }
            </div>

            <div class="modal-body">
-                <div class="parsing-state shimmer" style="@(IsParsing ? "display:flex;" : "display:none;")">
+                <div class="parsing-state shimmer" style="@(IsParsing && !IsIndexing ? "display:flex;" : "display:none;")">
                    <div class="shimmer-content">
                        <div class="spinner"></div>
                        <p>Scanning metadata...</p>
                    </div>
                </div>
                
-                <div class="verification-state" style="@(IsVerifying && !IsParsing ? "display:flex;" : "display:none;")">
+                <div class="verification-state" style="@(IsVerifying && !IsParsing && !IsIndexing ? "display:flex;" : "display:none;")">
                    @if (Metadata != null)
                    {
                        <div class="verification-layout">
@@ -74,7 +79,7 @@
                </div>
                
                <div class="upload-state @(_isDragging ? "drag-over" : "")" 
-                     style="@(!IsParsing && !IsVerifying ? "display:flex;" : "display:none;")"
+                     style="@(!IsParsing && !IsVerifying && !IsIndexing ? "display:flex;" : "display:none;")"
                     @ondragenter="OnDragEnter" 
                     @ondragleave="OnDragLeave">
                    <div class="drop-zone">
@@ -87,6 +92,18 @@
                    </div>
                </div>

+                <div class="indexing-state" style="@(IsIndexing ? "display:flex;" : "display:none;")">
+                    <div class="indexing-content">
+                        <div class="spinner"></div>
+                        <h3>Nexus AI Indexing</h3>
+                        <p class="status-msg">@IngestionStatusMessage</p>
+                        <div class="progress-bar-container">
+                            <div class="progress-bar-fill" style="width: @((IngestionProgressPercent * 100).ToString("F0"))%"></div>
+                        </div>
+                        <span class="percent">@((IngestionProgressPercent * 100).ToString("F0"))%</span>
+                    </div>
+                </div>
+
                
                @if (!string.IsNullOrEmpty(ErrorMessage))
                {
@@ -118,15 +135,61 @@
    private bool IsParsing { get; set; }
    private bool IsVerifying { get; set; }
    private bool IsIngesting { get; set; }
+    private bool IsIndexing { get; set; }
+    private string IngestionStatusMessage { get; set; } = "Initializing...";
+    private double IngestionProgressPercent { get; set; }
+    private Guid IngestedBookId { get; set; } = Guid.Empty;
    private LocalEpubMetadata? Metadata { get; set; }
    private string? ErrorMessage { get; set; }
    private byte[]? _epubBytes;
+    private bool _disposed;
    
    // Allow up to 50 MB
    private const long MaxFileSize = 50 * 1024 * 1024;

+    protected override async Task OnInitializedAsync()
+    {
+        await SyncService.InitializeAsync();
+        SyncService.OnIngestionProgressReceived += HandleIngestionProgress;
+    }
+
+    private async Task HandleIngestionProgress(string message, double progress)
+    {
+        if (_disposed) return;
+        if (!IsIndexing) return;
+
+        IngestionStatusMessage = message;
+        IngestionProgressPercent = progress;
+        
+        if (!_disposed)
+        {
+            await InvokeAsync(StateHasChanged);
+        }
+
+        if (progress >= 1.0)
+        {
+            // Give the user a moment to see the completion message
+            await Task.Delay(2500);
+            
+            if (_disposed) return;
+
+            // Now close the modal and navigate to the book
+            if (IngestedBookId != Guid.Empty)
+            {
+                var bookId = IngestedBookId;
+                await InvokeAsync(async () => {
+                    if (_disposed) return;
+                    await CloseModal();
+                    ReaderNavigation.NavigateToBook(bookId);
+                });
+            }
+        }
+    }
+
    private async Task CloseModal()
    {
+        if (IsIngesting || IsIndexing) return;
+
        IsOpen = false;
        Reset();
        await IsOpenChanged.InvokeAsync(false);
@@ -137,6 +200,10 @@
        IsParsing = false;
        IsVerifying = false;
        IsIngesting = false;
+        IsIndexing = false;
+        IngestionStatusMessage = "Initializing...";
+        IngestionProgressPercent = 0.0;
+        IngestedBookId = Guid.Empty;
        Metadata = null;
        ErrorMessage = null;
        _isDragging = false;
@@ -168,10 +235,12 @@
            using var stream = file.OpenReadStream(MaxFileSize);
            using var memoryStream = new MemoryStream();
            await stream.CopyToAsync(memoryStream);
+            if (_disposed) return;
            _epubBytes = memoryStream.ToArray();
            
            memoryStream.Position = 0;
            var result = await MetadataExtractor.ExtractMetadataAsync(memoryStream);
+            if (_disposed) return;

            if (result.IsSuccess)
            {
@@ -186,12 +255,18 @@
        catch (Exception ex)
        {
            Logger.LogError(ex, "Error uploading EPUB");
-            ErrorMessage = $"An unexpected error occurred: {ex.Message}";
+            if (!_disposed)
+            {
+                ErrorMessage = $"An unexpected error occurred: {ex.Message}";
+            }
        }
        finally
        {
-            IsParsing = false;
-            StateHasChanged();
+            if (!_disposed)
+            {
+                IsParsing = false;
+                StateHasChanged();
+            }
        }
    }

@@ -214,39 +289,55 @@
            );

            var response = await Http.PostAsJsonAsync("api/library/ingest", request);
+            if (_disposed) return;

            if (response.IsSuccessStatusCode)
            {
                var result = await response.Content.ReadFromJsonAsync<IngestResult>();
+                if (_disposed) return;
                if (result != null)
                {
-                    await CloseModal();
-                    ReaderNavigation.NavigateToBook(result.Id);
+                    IngestedBookId = result.Id;
+                    IsVerifying = false;
+                    IsIngesting = false;
+                    IsIndexing = true;
+                    IngestionStatusMessage = "Book saved! Starting background indexing...";
+                    IngestionProgressPercent = 0.0;
+                    StateHasChanged();
                }
            }
            else
            {
                ErrorMessage = await response.Content.ReadAsStringAsync();
+                IsIngesting = false;
            }
        }
        catch (Exception ex)
        {
            Logger.LogError(ex, "Error during ingestion");
-            ErrorMessage = "Failed to save book to library. Please try again.";
+            if (!_disposed)
+            {
+                ErrorMessage = "Failed to save book to library. Please try again.";
+                IsIngesting = false;
+            }
        }
        finally
        {
-            IsIngesting = false;
-            StateHasChanged();
+            if (!_disposed)
+            {
+                StateHasChanged();
+            }
        }
    }

    private record IngestResult(Guid Id);

-    public ValueTask DisposeAsync()
+    public async ValueTask DisposeAsync()
    {
+        _disposed = true;
+        SyncService.OnIngestionProgressReceived -= HandleIngestionProgress;
        // Clear the large byte array so it is eligible for GC even if the component is cached.
        _epubBytes = null;
-        return ValueTask.CompletedTask;
+        await ValueTask.CompletedTask;
    }
 }
@@ -377,6 +377,72 @@
    animation: spin 0.8s linear infinite;
 }

+/* Indexing State */
+.indexing-state {
+    flex: 1;
+    display: flex;
+    justify-content: center;
+    align-items: center;
+    border-radius: 12px;
+    background: rgba(255, 255, 255, 0.02);
+    border: 1px solid rgba(255, 255, 255, 0.05);
+    box-shadow: inset 0 0 12px rgba(255, 255, 255, 0.02);
+    position: relative;
+    overflow: hidden;
+    padding: 2rem;
+    animation: fadeIn 0.4s ease-out;
+}
+
+.indexing-content {
+    display: flex;
+    flex-direction: column;
+    align-items: center;
+    text-align: center;
+    width: 100%;
+    gap: 1.25rem;
+}
+
+.indexing-content h3 {
+    margin: 0;
+    font-size: 1.25rem;
+    color: var(--nexus-neon, #00ffaa);
+    text-shadow: 0 0 10px rgba(0, 255, 153, 0.2);
+    letter-spacing: 0.5px;
+}
+
+.status-msg {
+    margin: 0;
+    font-size: 0.9rem;
+    color: var(--nexus-text-muted, #888);
+    min-height: 2.5rem;
+    line-height: 1.4;
+}
+
+.progress-bar-container {
+    width: 100%;
+    height: 8px;
+    background: rgba(255, 255, 255, 0.05);
+    border-radius: 4px;
+    overflow: hidden;
+    position: relative;
+    border: 1px solid rgba(255, 255, 255, 0.05);
+}
+
+.progress-bar-fill {
+    height: 100%;
+    background: linear-gradient(90deg, var(--nexus-neon, #00ffaa) 0%, #00b3ff 100%);
+    box-shadow: 0 0 10px rgba(0, 255, 153, 0.4);
+    border-radius: 4px;
+    transition: width 0.4s cubic-bezier(0.4, 0, 0.2, 1);
+}
+
+.percent {
+    font-family: var(--nexus-font-mono, monospace);
+    font-size: 1.1rem;
+    font-weight: 700;
+    color: var(--nexus-text);
+}
+
@keyframes fadeIn {
    from { opacity: 0; }
    to { opacity: 1; }
@@ -67,6 +67,7 @@
    private bool _isJsInitialized;
    private ElementReference _containerRef;
    private bool _isInteractive;
+    private string? _currentActiveBlockId;

    protected override async Task OnInitializedAsync()
    {
@@ -143,6 +144,7 @@
    [JSInvokable]
    public async Task HandleBlockReached(string blockId, string content)
    {
+        _currentActiveBlockId = blockId;
        await Coordinator.OnBlockReachedAsync(blockId, content);

        if (ViewModel != null)
@@ -160,8 +162,15 @@

    private async Task HandleSyncProgressReceived(string blockId, DateTime timestamp)
    {
+        if (string.IsNullOrEmpty(blockId) || blockId == _currentActiveBlockId)
+        {
+            Logger.LogDebug("[Sync] Received progress {BlockId} is empty or matches active block. Ignoring scroll.", blockId);
+            return;
+        }
+
        Logger.LogInformation("[Sync] Received progress from another device: block {BlockId} at {Timestamp}", blockId, timestamp);

+        _currentActiveBlockId = blockId;
        await ScrollToNodeAsync(blockId);
        await InvokeAsync(StateHasChanged);
    }
@@ -211,6 +220,8 @@

    private async Task LoadChapterAsync(int index)
    {
+        await Coordinator.ClearAsync();
+        _isJsInitialized = false; // Reset JS initialization to re-bind the scroll observer to new DOM elements!
        _isLoadingChapter = true;
        StatusMessage = "Wczytywanie treści...";
        StateHasChanged();
@@ -247,6 +258,18 @@

        _isLoadingChapter = false;
        StateHasChanged();
+
+        if (result.IsSuccess && !string.IsNullOrEmpty(NavigationService.PendingScrollBlockId))
+        {
+            var targetBlockId = NavigationService.PendingScrollBlockId;
+            NavigationService.PendingScrollBlockId = null; // Clear it to prevent multiple scrolls
+            _currentActiveBlockId = targetBlockId;
+
+            // Give the browser slightly more than one frame to render the loaded blocks
+            await Task.Delay(150);
+            await ScrollToNodeAsync(targetBlockId);
+            await InteractionService.RequestHighlightBlock(targetBlockId);
+        }
    }

    public async Task ScrollToNodeAsync(string id)