1@j UddlmZddlZddlZddlZddlZddlmZmZm Z ddl Z ddl Z ddl m Z ejZiZded<daded<ejdd Zdd ZddZddZdS)) annotationsN)AnyCallableSequence)Encodingzdict[str, Encoding] ENCODINGSz.dict[str, Callable[[], dict[str, Any]]] | NoneENCODING_CONSTRUCTORSreturn Sequence[str]cg}tjtjtjdz}|D]\}}}|||S)N.)pkgutil iter_modules tiktoken_ext__path____name__append)mods plugin_mods_mod_names BC:\Projects\Historical\venv\Lib\site-packages\tiktoken/registry.py_available_plugin_modulesrsV D&|'SVY>YZZK%8Q H KNonec t5t ddddSia tD]}tj|} |j}n&#t $r}t d|d|d}~wwxYw|D]-\}}|tvrt d|d||t|<.n#t$rdawxYw ddddS#1swxYwYdS)Nztiktoken plugin z& does not define ENCODING_CONSTRUCTORSzDuplicate encoding name z in tiktoken plugin ) _lockr r importlib import_moduleAttributeError ValueErroritems Exception)rmod constructorseenc_name constructors r_find_constructorsr)!s  , !# 577 B B-h77#&#