No internet, API or payment needed

This home server also serves as my self hosted password manager, VPN and cloud

Background

While in Cambodia during HAX I was using ChatGPT which is extremely useful. Since non-Chinese AI is largely blocked in China, I decided to research options to self-host, while not being limited by censored content.

I got a bunch of spare junk parts from friends and family. Put together a functioning Ubuntu server.

I think the most amazing part about this project is that ALL the parts were scrap parts handed to me.

Update: bought a RTX3090

Ubuntu server specs

Old intel i5 - from brother

Fractal case - from friend

DDR3 16GB ram - from brother

Old unused motherboard - from brother

AMD Direct Cu ii - 780 4GB vRAM - from friend

Looking to upgrade to RTX3090 (24GB ram)

update: Upgraded to 3090

IMG20240109212554.jpg

WIP

Documentation

KoboldAI

WIP - Needs NVIDIA GPU to work, requires cuda cores

Next - Draggan

Modifying images on the fly


Completed

WhisperAI

Translates audio files into text, with time stamping, good for subtitiles

GPT4ALL

Free opensource version of chat gpt

Running in the background on CPU only (no GPU)