Gerbil: An open source desktop app for running LLMs locally

Gerbil is a cross-platform desktop GUI for local LLM text and image generation. Built on KoboldCpp (llama.cpp fork) as a backend with a greater focus on UX, automatic updates, HuggingFace model search and improved cross-platform reliability. It’s completely open source and available at: https://github.com/lone-cloud/gerbil

In terms of functionality it’s very similar to LM Studio except it’s OSS and seamlessly integrates with popular frontends like Open WebUI and Sillytavern, as well as including its own bundled frontends: KoboldAI Lite, llama.cpp and Stable UI. I added a short video of the Gerbil experience along with a few screenshots to the project’s README here: GitHub - lone-cloud/gerbil: A desktop app for running Large Language Models locally.

1 Like