fix(tokenizer): document ACI_TOKENIZER and fix offline test failures caused by tiktoken network dependency#24

AperturePlus merged 2 commits intodevelopAperturePlus/augmented-codebase-indexer:developfrom

copilot/fix-indexing-failureAperturePlus/augmented-codebase-indexer:copilot/fix-indexing-failureCopy head branch name to clipboard