Skip to content

Investigate using cffi to speed up git lfs interface #242

@blester125

Description

@blester125

Currently we store a serialized parameter group with git lfs by making a subprocess call. This means that process needs to be spun up and the serialized data is passed via a pipe.

Look if using the c foreign function interface in python can let us call the git lfs filters (written in go) directly, avoiding spin up and piping. Example https://blog.kchung.co/faster-python-with-go-shared-objects/

This will most likely make packaging a bit harder, but maybe remove the need to install git lfs?

Metadata

Metadata

Assignees

No one assigned

    Labels

    Speed UpWorking towards decreasing the latency of git theta commands.

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions