InstructLab Deep Dive Part 4

Index:
InstructLab Deep Dive Part 1
What is InstructLab and what problem does it solve?

InstructLab Deep Dive Part 2
Installing InstructLab on Fedora 40 with enabled CUDA.

InstructLab Deep Dive Part 3
Installing InstructLab on Fedora 40 with Ansible

InstructLab Deep Dive Part 4
Building InstructLab Podman/Docker container and running it on runpod.io

InstructLab Deep Dive Part 5
Advanced techniques with InstructLab, AI Agents and Function calling

In progress...

The content of this article is still being researched and written. I do enjoy using runpod.io and just like InstructLab simplifies and lowers the point of entry into LLM fine-tuning runpod.io guys make it easier and cheaper to rent the GPUs lowering the barrier of entry for those with smaller budgets.

At this stage I have a Dockerfile that successfully builds the image with InstructLab however when I attempt to serve the model or train the model it doesn't work with CUDA and everything gets executed on CPU. I will update this part as soon as I have a solution working on runpod.io