🔧 Runs on #vLLM with Aleph Alpha's inference plugin, exposing an OpenAI-compatible API. Needs 2x A100/H100 80 GB or 1x H200/B200/B300. Best fit: on-prem #RAG over long German documents like laws, contracts and manuals
🆓 No GPU at hand? Tesseracted Labs hosts Kolibri-1 free for anyone to try…
@michabbb@social.vivaldi.net