DeepLearning

How PCIe Lanes Affect LLM Performance? Depending on the task. For training and multi-gpu inferrence - perdormance drop is significant.

In the midst of the modern world’s turmoil here I’m comparing tech specs of different cards suitable for AI tasks (Deep Learning, Object Detection and LLMs). They are all incredibly expensive though.

I’ve used MMDetection (mmengine, mdet, mmcv) quite a bit, And now looks like it’s out of the game. It’s a pity. I liked it’s model zoo.