notes on running scancode-toolkit on freebsd 15

[JonoYang]

prereq: sudo pkg install python314 rust magic libarchive 7-zip, we need rust to build dependencies during the pip install

0. python314 -m venv venv in scancode-toolkit directory and . venv/bin/activate
1. comment out existing entries for typecode[full] and extractcode[full] in setup.cfg
2. add extractcode, typecode-libmagic-system-provided, extractcode-libarchive-system-provided, extractcode-7z-system-provided to install requires in setup.cfg
3. run pip install -e .
   3.1. pip install pytest-xdist setuptools if you want to run the tests
4. run scancode-reindex-licenses and scancode-train-gibberish-gibberish-model
5. run scancode on samples dir scancode -clipeu -n 10 samples/ --json-pp samples.json to check functionality

thoughts:

• update setup.cfg and configure to have an option to use system provided libraries without having to do the above
• we can remove our dependency on prebuilt binaries from https://github.com/aboutcode-org/scancode-plugins/tree/main/builtins from scancode eventually, simplifying running scancode on other architectures and os'
• maybe these notes would be useful for existing efforts to run scancode on linux and macos arm systems