LLM Frontends
Not so many to choose from but still....
When I started experimenting with LLMs the UIs for them were in active development and now some of them are really good.
Not so many to choose from but still....
When I started experimenting with LLMs the UIs for them were in active development and now some of them are really good.
Requires some experimenting but
Still there are some common approaches how to write good prompts so LLM would not get confused trying to understand what you wand from it.
8 llama3 (Meta+) and 5 phi3 (Microsoft) LLM versions
Testing how models with different number of parameters and quantization are behaving.
Ollama LLM model files take a lot of space
After installing ollama better to reconfigure ollama to store them in new place right away. So after we pull a new model, it doesn’t get downloaded to the old location.