sylentbobnj/home-llm
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Editing Readme.md file

Browse Source
This commit is contained in:
Dad
2025-08-11 21:31:11 -04:00
parent 22cd6bde60
commit 298b1c2489
1 changed files with 37 additions and 0 deletions
Download Patch File Download Diff File Expand all files Collapse all files

37
Readme.md
View File

@ -0,0 +1,37 @@
**home-llm Docker Compose**
So far, just the docker-compose.yml file used to pull and run the containers for ollama and open-webui.
**nvidia-container Installation**
Step 1: Download the NVIDIA Docker Packages
Download the NVIDIA Container Toolkit and its dependencies:
You can use the following commands to download the necessary packages. Make sure to adjust the version numbers if needed:
bash
```
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64/nvidia-docker2_2.16.0-1_amd64.deb
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64/nvidia-container-runtime_3.11.0-1_amd64.deb
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2204/x86_64/nvidia-container-toolkit_1.12.0-1_amd64.deb
```
Note: The version numbers may change, so you might want to check the NVIDIA website for the latest versions.
Step 2: Install the Downloaded Packages
Install the downloaded packages:
Run the following command to install the packages:
bash
```
sudo dpkg -i nvidia-container-runtime_3.11.0-1_amd64.deb nvidia-container-toolkit_1.12.0-1_amd64.deb nvidia-docker2_2.16.0-1_amd64.deb
```
If you encounter any dependency issues, you can resolve them by running:
bash
```
sudo apt-get install -f
```