Olares

The 'spent 100 hours configuring' part hits home. That fragmentation is exactly why we started building Olares (https://github.com/beclab/Olares). It’s basically an open-source OS layer that standardizes the local AI stack—Kubernetes (K3s) for orchestration, standardized model serving, and GPU scheduling. The goal is to stop fiddling with Python environments/drivers and just treat local agents like standardized containers. It runs on Mac Minis or dedicated hardware.

Many of the ones in https://github.com/beclab/terminus?tab=readme-ov-file#projec... as well as Snowinning in https://github.com/beclab

Hi HN, As a self-hosting enthusiast for years, I've encountered many challenges first hand in setting up and maintaining a secure, efficient hosting environment for my applications. I know how frustrating it can be to deal with situations like: Complicated Configurations: Setting up domain names, certificates, reverse proxies, vpn can be a time-consuming and error-prone process. Deployment Difficulties: Deploying complex applications like Gitlab or Mastodon often requires advanced technical knowledge and significant effort. Multi-Device Management: Managing multiple devices and scaling up can be overwhelming, especially with the steep learning curve of Kubernetes. That’s why we created Terminus OS, a free, versatile self-hosted OS which tackles these challenges head-on. Built on Kubernetes, Terminus OS simplifies the entire self-hosting p