LLM Performance and PCIe Lanes: Key Considerations
Thinking of installing second gpu for LLMs?
How PCIe Lanes Affect LLM Performance? Depending on the task. For training and multi-gpu inferrence - perdormance drop is significant.
Thinking of installing second gpu for LLMs?
How PCIe Lanes Affect LLM Performance? Depending on the task. For training and multi-gpu inferrence - perdormance drop is significant.
quick ubuntu and mint version check
To determine the Ubuntu version that your Linux Mint installation is based on, you can use several methods involving command-line tools and system files.
After setting upd the Gitea and Hugo on AWS S3...
The next step is to implement some CI/CD and setup Gitea Actions for Hugo website, to push website to AWS S3 automatically when master branch is updated.
OK. Now generating PDFs in GO!
Generating PDF documents programmatically can be an important feature in your application. Here we explore and give short review with examples of the libraries available in the Go programming language (Golang) for generating PDF files.
My favorite lib is pdf-reports
Generating PDF Reports Using Python
Python, with its extensive libraries and modules, offers powerful tools for generating professional PDF reports. This guide explores various methods to create PDF documents using Python, covering popular libraries like ReportLab, FPDF, Xhtml2pdf, WeasyPrint, Jinja2, pdf-reports and PdfKit.
Continuing the topic of extracting data from html
If you’re looking for a Beautiful Soup equivalent in Go, several libraries offer similar HTML parsing and scraping functionality:
LLM to extract text from HTML...
In the Ollama models library there are models that able convert HTML content to Markdown, which is useful for content conversion tasks.
And why have I been seeing this BSOD...
I was hit hard by this issue. But you should investigate and test your PC if your BSOD is like mine. The cause was Intel’s CPU Degradation Issue in 13th and 14th generation.
How different are they?
Cursor AI vs GitHub Copilot vs Cline AI vs...
Will list here some AI-assisted coding tools and AI Coding Assistants and their nice sides.
Short list of LLM providers
Using LLMs is not very expensive, might be no need to buy new awesome GPU. Here is a list if LLM providers in the cloud with LLMs they host.
Ollama on Intel CPU Efficient vs Performance cores
I’ve got a theory to test - if utilising ALL cores on Intel CPU would raise the speed of LLMs? This is bugging me that new gemma3 27 bit model (gemma3:27b, 17GB on ollama) is not fitting into 16GB VRAM of my GPU, and partially running on CPU.
Useful MinIO Commands
MinIO provides two standard UIs: (1) MinIO Console - That’s a web UI, and
(2) MinIO Command - this is a commandline util mc.
Overview and installing Minio
MinIO is an open-source, high-performance, distributed object storage system designed to be fully compatible with the Amazon S3 API.
Rearrange terminal windows right from the start
There are several ways to start a group of terminal tools in Linux Mint and have the terminal windows tiled, depending on your workflow and the level of automation you want.
AI requires a lot of power...
In the midst of the modern world’s turmoil here I’m comparing tech specs of different cards suitable for AI tasks (Deep Learning, Object Detection and LLMs). They are all incredibly expensive though.