Hi, thanks for sharing this news, but please post the release notes from the Mozilla website, instead of (or at least along with) a third party service.
Hi, thanks for sharing this news, but please post the release notes from the Mozilla website, instead of (or at least along with) a third party service.
I’ve tried it, very practical. It’s a drop in replacement for OpenAI APIs, so you can work with other tools that use their models and API as back end.
Check out localAI, an open source drop in replacement for OpenAI APIs, in particular the section about text generation. From here, you can load a model with a specific prompt, in order to summarize text.
Bazzite is built from ublue-os/main and ublue-os/nvidia using Fedora technology, which means expanded hardware support and built in drivers are included. Additionally, Bazzite adds the following features:
Proprietary Nvidia drivers pre-installed.
Full hardware accelerated codec support for H264 decoding.
Full support for AMD's ROCM OpenCL/HIP run-times.
xpadneo driver for wireless Xbox One controllers.
Full support for DisplayLink.
Includes Valve's KDE themes from SteamOS.
LatencyFleX, vkBasalt, MangoHud, and OBS VkCapture installed and available by default
Support for Wallpaper Engine. (Only on KDE)
Distrobox preinstalled with automatic updates for created containers.
Automated duperemove services for reducing the disk space used by wine prefix contents.
System76-Scheduler preinstalled, providing automatic process priority tweaks to your focused application and keeping CPU time for background processes to a minimum.
Customized System76-Scheduler config with additional rules and CFS parameters from Linux-TKG.
Uses Google's BBR TCP congestion control by default.
Input Remapper preinstalled and enabled. (Available but default-disabled on the Deck variant)
Helpful first-start installer provides an easy way to install numerous applications and tweaks, including installing CoreCtrl and GreenWithEnvy.
Nix package manager optionally available.
Waydroid preinstalled for running Android apps. Future releases will offer to set this up for you. (Not available on Nvidia builds)
OpenRGB i2c-piix4 and i2c-nct6775 drivers for controlling RGB on certain motherboards.
GCAdapter_OC driver for overclocking Nintendo's Gamecube Controller Adapter to 1000hz polling.
Out of the box support for Wooting keyboards.
The main consideration I believe is missing is the cost of the hardware where you will be hosting the server. Maybe you have a old computer lying around, in that case its not an issue of course. By the way 25$ per month seems a bit expensive, there are probably cheaper alternatives, just for the sake of comparison.
Hi, I think localAi is a good place to start.
You could also check out Conduit, it’s still in beta but very lightweight.
Conduit is a lightweight open-source server implementation of the Matrix Specification with a focus on easy setup and low system requirements. That means you can make your own Conduit setup in just a few minutes.
Thanks :)