易用

NPM轻松获取，并且支持Typescript。

模型开源

Load large language model LLaMA, RWKV and LLaMA's derived models.

跨平台

Supports Windows, Linux, and macOS. Allow full accelerations on CPU inference (SIMD powered by llama.cpp/llm-rs/rwkv.cpp).