Skip to content

Source_files bulk excluse/include functions implementation#131

Open
ruwinirathnamalala wants to merge 16 commits intobuerokratt:wipfrom
rootcodelabs:feat/bulk-include-exclude-files
Open

Source_files bulk excluse/include functions implementation#131
ruwinirathnamalala wants to merge 16 commits intobuerokratt:wipfrom
rootcodelabs:feat/bulk-include-exclude-files

Conversation

@ruwinirathnamalala
Copy link
Collaborator

feat: Add bulk exclude/include functionality for source files

Implemented bulk operations to exclude/include multiple source files simultaneously with optimized processing and improved user experience.

Backend Changes:

  • Created bulk-exclude endpoint (DSL/Ruuter/ckb/POST/source-file/bulk-exclude.yml)
  • Added update_source_files_exclude_batch.sql with array handling via json_array_elements_text
  • Implemented conditional path transformation for exclude/include operations
  • Added WHERE clause to skip files already in desired state (performance optimization)
  • Switched to async file moving (/move-files-async) to prevent timeout errors
  • Created DMapper templates for S3 path transformations (exclude/include)

Frontend Changes:

  • Added bulk include/exclude actions to multiselect menu
  • Implemented bulkUpdateFileExclusion API service
  • Added confirmation dialogs with file count display
  • Implemented client-side filtering to only send files needing state change
  • Added info toast notifications when all files already in desired state

Technical Improvements:

  • Dual-layer optimization: frontend filters before API call, SQL filters before DB update
  • Async S3 operations prevent ReadTimeoutException on large batches
  • Proper error handling with user-friendly messages
  • Row selection cleared after successful operations

Resolves timeout issues and unnecessary database updates for bulk file operations.

@ruwinirathnamalala ruwinirathnamalala marked this pull request as draft February 23, 2026 11:26
@ruwinirathnamalala ruwinirathnamalala marked this pull request as ready for review February 23, 2026 14:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants