Skip to content

Commit 5a0ae6e

Browse files
committed
2 parents b1a6aae + 7f1c558 commit 5a0ae6e

File tree

1 file changed

+2
-2
lines changed

1 file changed

+2
-2
lines changed

README.md

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
# FastAPI-BitNet
22

3-
This project uses a combination of [Uvicorn](https://www.uvicorn.org/), [FastAPI](https://fastapi.tiangolo.com/) (Python) and [Docker](https://www.docker.com/) to provide a reliable REST API for testing [Microsoft's BitNet](https://github.com/microsoft/BitNet) out locally!
3+
This project uses a combination of [Uvicorn](https://www.uvicorn.org/), [FastAPI](https://fastapi.tiangolo.com/) (Python) and [Docker](https://www.docker.com/) to provide a reliable REST API for testing [Microsoft's BitNet inference framework](https://github.com/microsoft/BitNet) out locally, specifically their [BitNet b1.58 2B4T](https://huggingface.co/microsoft/bitnet-b1.58-2B-4T) model!
44

55
It supports running the inference framework, running BitNet model benchmarks and calculating BitNet model perplexity values.
66

@@ -59,4 +59,4 @@ Enter into the URL field `http://127.0.0.1:8080/mcp` then your copilot will be a
5959

6060
https://github.com/grctest/BitNet-VSCode-Extension
6161

62-
https://marketplace.visualstudio.com/items?itemName=nftea-gallery.bitnet-vscode-extension
62+
https://marketplace.visualstudio.com/items?itemName=nftea-gallery.bitnet-vscode-extension

0 commit comments

Comments
 (0)