-
Notifications
You must be signed in to change notification settings - Fork 8
Investigate using cffi to speed up git lfs interface #242
Copy link
Copy link
Open
Labels
Speed UpWorking towards decreasing the latency of git theta commands.Working towards decreasing the latency of git theta commands.
Description
Currently we store a serialized parameter group with git lfs by making a subprocess call. This means that process needs to be spun up and the serialized data is passed via a pipe.
Look if using the c foreign function interface in python can let us call the git lfs filters (written in go) directly, avoiding spin up and piping. Example https://blog.kchung.co/faster-python-with-go-shared-objects/
This will most likely make packaging a bit harder, but maybe remove the need to install git lfs?
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
Speed UpWorking towards decreasing the latency of git theta commands.Working towards decreasing the latency of git theta commands.