SelfHosting

Documentation

Linux + The Cloud

SelfHosting

SelfHosting 101

You can do SelfHosting with a Raspberry Pi, with and old laptop, in the cloud…

But you can even do it in the very same computer you are reading this.

Get Docker/Podman installed to manage the containerized apps
Get the Docker-Compose ready
Deploy!

Follow these CLI’s to SelfHost with Containers! 🐋 🚀

If you are using a server, make sure it has SSH and the firewall allowing the connection:

sudo apt update
sudo apt install openssh-server
#systemctl status ssh

sudo ufw allow ssh

#ssh username@<local_minipc_server_ip>

Check running processes with:

#systemctl status
htop

#systemctl list-units --type=service
systemctl list-units --type=service --state=running

And the ports used:

sudo lsof -i -P -n

Follow the steps of this SelfHosting-101 script:

curl -O https://raw.githubusercontent.com/JAlcocerT/Linux/main/Z_Linux_Installations_101/Selfhosting_101.sh

#nano Selfhosting_101.sh #MAKE SURE YOU UNDERSTAND WHAT YOU WILL BE RUNNING
chmod +x Selfhosting_101.sh
sudo ./Selfhosting_101.sh

Remember to go to your Portainer instance and setup the user/pass quickly: localhost:9000

If you forget, you will need to restart Portainer, so that you are able to setu the password:

docker restart portainer

graph LR
    A[Connect via SSH] -- Open f/w if needed --> 
    C(Install Docker/Podman)
    C --> D(Spin your ❤️ Services)

SelfHosting with a Raspberry Pi

Beyond SelfHosting - Linux can onboard you to the IoT and Embedding World. Are you ready?

SelfHosting Cool Stuff

GenAI

To try new Gen AI Projects within Linux, you can setup a Docker Container Python environment with these 3 artifacts:

Dockerfile:

This will help you encapsulate the project dependencies:

FROM python:3.11-slim

# Copy local code to the container image.
ENV APP_HOME /app
WORKDIR $APP_HOME

RUN apt-get update && apt-get install -y \
  git \
  build-essential

# Clone the private repository
RUN git clone https://github.com/lllyasviel/Fooocus

WORKDIR /app/Fooocus
RUN pip install -r requirements_versions.txt

#python entry_with_update.py

requirements:

#Not needed here, provided by repo.

Config: Make sure to build the image first with:

docker build -t fooocus .
#docker-compose up -d

Then, use this compose file to spin up the container:

version: '3'

services:
sd-fooocus:
  image: fooocus #python:3.11-slim
  container_name: fooocus
  command: tail -f /dev/null
  volumes:
    - ai_fooocus:/app
  working_dir: /app  # Set the working directory to /app
  ports:
    - "7865:7865"

volumes:
ai_fooocus:

LLMs

Ollama

ℹ️

The ML Compilation for LLMs project aims to spread the development and deployment of AI Models.

Home LLM + Home Assistant - https://www.youtube.com/watch?v=kJfIM9siD00
- https://github.com/acon96/home-llm

https://flathub.org/apps/com.cassidyjames.butler #HA visualizer

This repo contains interesting projects (𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀) to have a look: https://github.com/iusztinpaul/hands-on-llms

Affordable Local Gen AI with iGPU’s

Thanks to to Tech-Practice for inspiration.

FAQ

Where to Learn More about SelfHosting?

Windows inside Docker

Thanks to the Dockur Project and by using the Image

With this Docker-Compose 👈

version: '3.3'

services:
  windows:
    image: dockurr/windows
    container_name: windows
    devices:
      - /dev/kvm
    cap_add:
      - NET_ADMIN
    ports:
      - "8006:8006" #UI
      - "3389:3389/tcp"
      - "3389:3389/udp"
    stop_grace_period: 2m
    restart: on-failure
    volumes:
      - ./data:/storage
    environment:
      RAM_SIZE: 8GB
      CPU_CORES: 3
      DISK_SIZE: 75GB
      VERSION: "win10"

LLMs on Linux