跳到主要内容

Future plan

  • prompt extensions
  • more platforms and cross compile (performance related)
  • tweak embedding API, make end token configurable
  • cli and interactive
  • GPU inference