Deploying Gemma 1B GGUF model with llama.cpp on Ubuntu

For this guide we should be using an Ubuntu server with atleast 2 GiB of GPU VRAM, 2 VCPU Cores, 8 GiB RAM, and 50 GiB of storage. Let’s start by updating and installing necessary libraries. sudo apt update && sudo apt upgrade -y sudo apt install -y ...