• 0 Posts
  • 67 Comments
Joined 1 year ago
cake
Cake day: August 4th, 2023

help-circle







  • Yeah, systemd hater or not, runit is quite fabulous Imo.

    Some software with a hard requirement on systemd will not work, of course. I believe it is possible to run void using systemd, I’ve never tried though.

    I really like runit, but once it’s configured, like systemd, I mostly just don’t see it anymore - you know what I mean…

    Give it a shot, for me it’s the packaging system, take a look at it and at the github “void-repository”.

    I really like how it’s working, the simplicity of it, create your own package, your own repository, etc.

    The killer features, for me, isn’t really runit, but the stability of a rolling distro with the xbps package system.













  • No, Ollama is running on an old PC with a GeForce 1060 and 16gig of ram…

    Yes, it’s a “webserver” running in the background exposing an API.

    However, if I “top” my system, without chatting, it sits at 0% usage; it’s only when asking that the system peeks at around 55-70% CPU.

    You have to understand there is 2 things here: the server and the model. The server is always running, but requires next to nothing in terms of resources.

    The model is what computing your questions, this is the heavy part. It’s started on use, then after a delay, it’s closing.

    TL;DR To answer your real question, you could use Ollama on the same system that you are using.