SelfHosting

You can do it with a Raspberry Pi, with and old laptop, in the cloud…

But you can even do it in the very same computer you are reading this.

Get Docker/Podman installed
Get the Docker-Compose ready
Deploy!

Follow these CLI’s! 🚀

sudo apt update
sudo apt install openssh-server
#systemctl status ssh

sudo ufw allow ssh

#ssh username@<local_minipc_server_ip>

Check processes with:

#systemctl status
htop

#systemctl list-units --type=service
systemctl list-units --type=service --state=running

And the ports used:

sudo lsof -i -P -n

Follow the steps of this SelfHosting-101 script:

curl -O https://raw.githubusercontent.com/JAlcocerT/Linux/main/Z_Linux_Installations_101/Selfhosting_101.sh
#nano Selfhosting_101.sh #MAKE SURE YOU UNDERSTAND WHAT YOU WILL BE RUNNING

chmod +x Selfhosting_101.sh
sudo ./Selfhosting_101.sh

Remember to go to your Portainer instance and setup the user/pass: localhost:9000

If you forget, you will need to restart Portainer:

docker restart portainer

graph LR
    A[Connect via SSH] -- Open f/w if needed --> 
    C(Install Docker/Podman)
    C --> D(Spin your ❤️ Services)

IoT with Raspberry Pi

Linux will onboard you to the IoT and Embedding World. Are you ready to take the first step?

GenAI

Dockerfile:

FROM python:3.11-slim

# Copy local code to the container image.
ENV APP_HOME /app
WORKDIR $APP_HOME

RUN apt-get update && apt-get install -y \
  git \
  build-essential

# Clone the private repository
RUN git clone https://github.com/lllyasviel/Fooocus

WORKDIR /app/Fooocus
RUN pip install -r requirements_versions.txt

#python entry_with_update.py

requirements:

#Not needed here, provicded by repo.

Config: Make sure to build the image first with:

docker build -t fooocus .
#docker-compose up -d

Then, use this to spin up the container:

version: '3'

services:
sd-fooocus:
  image: fooocus #python:3.11-slim
  container_name: fooocus
  command: tail -f /dev/null
  volumes:
    - ai_fooocus:/app
  working_dir: /app  # Set the working directory to /app
  ports:
    - "7865:7865"

volumes:
ai_fooocus:

You can also try with

python -m venv your-env #(create a virtual environment)
source your-env/bin/activate #(or on Windows your-env\Scripts\activate) (activatea the venv)
#deactivate

conda create -n yourcondaenvironment python=3.11
conda activate yourcondaenvironment
conda deactivate

LLMs

Ollama

ℹ️

The ML Compilation for LLMs project aims to spread the development and deployment of AI Models.

Home LLM + Home Assistant - https://www.youtube.com/watch?v=kJfIM9siD00
- https://github.com/acon96/home-llm

https://flathub.org/apps/com.cassidyjames.butler #HA visualizer

This repo contains interesting projects (𝗟𝗟𝗠𝘀, 𝗟𝗟𝗠𝗢𝗽𝘀, and 𝘃𝗲𝗰𝘁𝗼𝗿 𝗗𝗕𝘀) to have a look: https://github.com/iusztinpaul/hands-on-llms

Voice to Text

Piper - Also works Text to Voice
- Voices at HF

Affordable Local Gen AI with iGPU’s

Thanks to to Tech-Practice for inspiration.

FAQ

Where to Learn More about SelfHosting

How to Secure my Services?

NGINX
Cloudflare
- It allows
Authelia / Zitadel / Authentik

Decentralized Storage

Centralization -> Simplicity and Single Point of Failure
Some alternatives:
- IPFS - an open system to manage data without a central server
- Filecoin - an open-source cloud storage marketplace, protocol, and incentive layer.

Great intro video from Naomi on Decentralized Storage

How to Back Up my Server?

Duplicati to other location (HD / Mega, One drive, s3…)

Windows inside Docker

Thanks to the Dockur Project and by using the Image

With this Docker-Compose 👈

version: '3.3'

services:
  windows:
    image: dockurr/windows
    container_name: windows
    devices:
      - /dev/kvm
    cap_add:
      - NET_ADMIN
    ports:
      - "8006:8006" #UI
      - "3389:3389/tcp"
      - "3389:3389/udp"
    stop_grace_period: 2m
    restart: on-failure
    volumes:
      - ./data:/storage
    environment:
      RAM_SIZE: 8GB
      CPU_CORES: 3
      DISK_SIZE: 75GB
      VERSION: "win10"

LLMs on Linux