you can add authentic/authelia with keys for login and it should be fine

https://wiki.archlinux.org/title/Firefox#Hardware_video_acceleration

Firefox is a bit annoying on wayland, you often have to force enable hw accel. If you cant figure it out send me a DM, ill be glad to help you through signal/matrix/discord

If you are willing to pay 10$ a month. You should get GithubCopilot, it provides near unlimited claude 3.5 usage. RooCode can hook into the github copilot api, and use it for its generations.

I use Qwen Coder and Mistral small locally too. It works ok, but its nowhere near GPT/Claude in terms of response quality.

As much as I’d like to praise the open-weight models. Nothing comes close to Claude sonnet in my experience too. I use local models when info are sensitive and claude when the problem requires being somewhat competent.

What setup do you use for coding? I might have a tip for minimizing claude cost you depending on what your setup is.

Their software is pretty nice. That’s what I’d recommand to someone who doesn’t want to tinker. It’s just a shame they don’t want to open source their software and we have to reinvent the wheel 10 times. If you are willing to tinker a bit koboldcpp + openewebui/librechat is a pretty nice combo.

The project is a bit out of date for newer models, Though Older ones work great.

I recommand ComfyUi if you want fine grained control over the generation and you like to tinker.

Swarm / Reforge / Invoke if you want neat, up to date UI.

Well they are fully closed source except for the open source project they are a wrapper on. The open source part is llama.cpp

Try Podman Desktop if you want a GUI to manage your container , and docker desktop is the source of the the crashes. You can run docker images / container / kube through it as well as podman one.

nixos doesn’t play well with rootless containers in my experience