Farfalle vs Perplexica
Comparing two self-hosted AI search engines
Awesome food is the pleasure for your eyes too. But in this post we will compare two AI-based search systems, Farfalle and Perplexica.
Comparing two self-hosted AI search engines
Awesome food is the pleasure for your eyes too. But in this post we will compare two AI-based search systems, Farfalle and Perplexica.
Which language to use for AWS lambda?
We can write lambda function for deployment to AWS in several languages. Let’s compare the performance of (almost empty) functions written in JavaScript, Python and Golang…
Running copilot-style service locally? Easy!
That’s very exciting! Instead of calling copilot or perplexity.ai and telling all the world what you are after, you can now host similar service on your own PC or laptop!
Testing logical fallacy detection
Recently we have seen several new LLMs were released. Exciting times. Let’s test and see how they perform when detecting logical fallacies.
Not so many to choose from but still....
When I started experimenting with LLMs the UIs for them were in active development and now some of them are really good.
Requires some experimenting but
Still there are some common approaches how to write good prompts so LLM would not get confused trying to understand what you wand from it.
Synching bookmarks across the laptops & browsers?
I’ve tried different tools and came to conclusion I like floccus the most.
Frequenly needed bits of python code
Sometimes need this but can’t find rightaway. So keeping them all here.
Labelling and training needs some glueing
When I trained object detector AI some time ago - LabelImg was a very helpful tool, but the export from Label Studio to COCO format wasn’t accepted by MMDetection framework..
8 llama3 (Meta+) and 5 phi3 (Microsoft) LLM versions
Testing how models with different number of parameters and quantization are behaving.
Ollama LLM model files take a lot of space
After installing ollama better to reconfigure ollama to store them in new place right away. So after we pull a new model, it doesn’t get downloaded to the old location.
It's so annoying to watch all those ads
You can install a browser adblock plugin or addon for google chrome, firefox or safari, but but you will have to do this on each device. The network-wide ad-blocker is my favorite solution.
Very frequent error message...
After clonning the git repository, do the local repository configuration, particularly set user name and email address.
Hugo is a static site generator
When the site is generated with hugo it’s time to deploy it to some hosting platform. Here is a howto push it to AWS S3 and serve with AWS CloudFront CDN.
Let's test the LLMs' speed on GPU vs CPU
Comparing prediction speed of several versions of LLMs: llama3 (Meta/Facebook), phi3 (Microsoft), gemma (Google), mistral(open source) on CPU and GPU.
Let's test logical fallacy detection quality of different LLMs
Here I am comparing several LLM versions: Llama3 (Meta), Phi3 (Microsoft), Gemma (Google), Mistral Nemo(Mistral AI) and Qwen(Alibaba).