Vitalij Neverkevic Blog

Topic

ARTIFICIAL INTELLIGENCE

Artificial intelligence topics

IBM Introduces Granite 3.0: High Performing AI Models

Listen to a podcast0:00/542.511021× Introduction On October 21, 2024, IBM announced the release of its most advanced family of AI models to date, Granite 3.0, at the annual TechXchange event. This third-generation flagship language model series is designed to outperform or match similarly sized models from

InstructLab Deep Dive Part 5

Index: InstructLab Deep Dive Part 1 What is InstructLab and what problem does it solve? InstructLab Deep Dive Part 2 Installing InstructLab on Fedora 40 with enabled CUDA. InstructLab Deep Dive Part 3 Installing InstructLab on Fedora 40 with Ansible InstructLab Deep Dive Part 4 Building InstructLab Podman/Docker container

InstructLab Deep Dive Part 4

Index: InstructLab Deep Dive Part 1 What is InstructLab and what problem does it solve? InstructLab Deep Dive Part 2 Installing InstructLab on Fedora 40 with enabled CUDA. InstructLab Deep Dive Part 3 Installing InstructLab on Fedora 40 with Ansible InstructLab Deep Dive Part 4 Building InstructLab Podman/Docker container

InstructLab Deep Dive Part 3

Index: InstructLab Deep Dive Part 1 What is InstructLab and what problem does it solve? InstructLab Deep Dive Part 2 Installing InstructLab on Fedora 40 with enabled CUDA. InstructLab Deep Dive Part 3 Installing InstructLab on Fedora 40 with Ansible InstructLab Deep Dive Part 4 Building InstructLab Podman/Docker container

InstructLab Deep Dive Part 2

Index: InstructLab Deep Dive Part 1 What is InstructLab and what problem does it solve? InstructLab Deep Dive Part 2 Installing InstructLab on Fedora 40 with enabled CUDA. InstructLab Deep Dive Part 3 Installing InstructLab on Fedora 40 with Ansible InstructLab Deep Dive Part 4 Building InstructLab Podman/Docker container

InstructLab Deep Dive Part 1

Index: InstructLab Deep Dive Part 1 What is InstructLab and what problem does it solve? InstructLab Deep Dive Part 2 Installing InstructLab on Fedora 40 with enabled CUDA. InstructLab Deep Dive Part 3 Installing InstructLab on Fedora 40 with Ansible InstructLab Deep Dive Part 4 Building InstructLab Podman/Docker container

The Six Levels of LLM Applications

Amidst the prevalent myths and misconceptions about what LLMs can and cannot do, it's crucial to have a clear perspective on their practical applications. This is an attempt to provide you with a mental model, detailing various levels at which LLMs operate, which can help you determine where

Fast AI Inference: Etched - Sohu Chip

Is it a good time to short NVidia? It's no secret that NVidia is one of the best-performing assets in a bucket of S&P500, dragging the entire market up. So, it would make sense to think about where the price would find its resistance and what

AI models Cheat Sheet with a simple explanation for non-tech audience

Intro I always had this feeling that I never properly understood the various areas of machine learning. There is deep learning and there is machine learning, and then there are different models, each trained differently and designed to work with different types of data. It was a mess in my

Are you planning to buy GPU to run LLMs at home? Cost/Benefit analysis in 2024.

Summary * Cost Efficiency: APIs are generally more cost-effective for heavy users due to payment based on actual usage, unlike fixed monthly subscriptions which may include usage limits. * Local Hardware Expenses: High-end GPUs like the Nvidia RTX 3090 or RTX 4090 incur significant upfront and ongoing electricity costs, making them less