Skip to content

Data volume monitoring in user interface - for #355 #358

@miranov25

Description

@miranov25

In RootInteractive, the data are stored in a ColumnDataSource where columns are compressed in memory using both lossy and lossless compression techniques. This typically results in a reduction factor of about 10 between the original and compressed representation, depending on the configuration used.

Only the columns that are actively used at any given moment (in ND groupby operations (mean,median, entries, fits) , custom functions) should be expanded and cached. Currently, columns used in widgets are also expanded, but this behavior will change soon after finishing #355.

For the user interface, we can implement a strategy for column caching (NCache) and monitor current memory usage via console output. This approach allows users to control the balance between memory and CPU usage.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions