SelfHosting

Vane is one of the more pragmatic entries in the “AI search with citations” space: a self-hosted answering engine that mixes live web retrieval with local or cloud LLMs, while keeping the whole stack under your control.

Text Generation Inference (TGI) has a very specific energy. It is not the newest kid in the inference street, but it is the one that already learned how production breaks -

SGLang is a high-performance serving framework for large language models and multimodal models, built to deliver low-latency and high-throughput inference across everything from a single GPU to distributed clusters.

Soon you are juggling vLLM, llama.cpp, and more—each stack on its own port. Everything downstream still wants one /v1 base URL; otherwise you keep shuffling ports, profiles, and one-off scripts. llama-swap is the /v1 proxy before those stacks.

I keep coming back to llama.cpp for local inference—it gives you control that Ollama and others abstract away, and it just works. Easy to run GGUF models interactively with llama-cli or expose an OpenAI-compatible HTTP API with llama-server.

Most local AI setups start the same way: a model, a runtime, and a chat interface.

Choosing the right headless CMS can make or break your content management strategy. Let’s compare three open-source solutions that influence how devs build content - driven applications.

Elasticsearch is a powerful distributed search and analytics engine built on Apache Lucene. This comprehensive cheatsheet covers essential commands, best practices, and quick references for working with Elasticsearch clusters.

Locally hosted Ollama allows to run large language models on your own machine, but using it via command-line isn’t user-friendly. Here are several open-source projects provide ChatGPT-style interfaces that connect to a local Ollama.

Will list here some AI-assisted coding tools and AI Coding Assistants and their nice sides.

When I started experimenting with LLMs the UIs for them were in active development and now some of them are really good.