I’ve spent most of this week trying to get Gitpod working on my k3s clusters launched with terraform on Hetzner Cloud. It has been a long process of trial and error, debugging and finding the missing pieces in a combination of the docs, this forum, issue and in some config files from the gitpod repo (especially the docker based installs have been useful) to try and come up with the requirements for setting everything up. Interesting, but not very effective use of time. I’d much rather be playing with Gitpod and working out how we can use it with my project
So… I would very much welcome a complete list of the requirements and limitations on Gitpod self hosted, as I am not seeing this in enough detail in the docs to be able to get a setup working.
My current PoC setup using the Helm installer (testing version 0.8.0. and 0.9.0-alpha1 right now), I have so far found that I need the following:
ubuntu 18.04 - this seems to be the only supported version of ubuntu at them moment,
k3s (looks like it can be the latest version judging by the docker based setups, although the docs say 1.17 is the highest version) - has to be configured correctly with Calico instead of Flannel which is the default on k3s.
I have found that there are issues with 0.9.0-alpha1 with a containerd higher than 1.2 - so sticking with the very old 1.1.7 for now.
Make sure your certs are created and that a kubernetes secret (https-certificates) for these has been created (manually in the cluster) before trying to do the helm install.
use the internal registry by default - using external registries seems limited. External registries have to support nested repositories (had an issue with quay.io not liking the way gitpod creates repositories).
use minio for storage. I’ve tried using external storage (Scaleway’s S3 compatible storage, but this gives errors. Unless you have tons of storage space on your nodes (500Gi which is the default for minio), then you will also need to fix the default minio PVC to be less than 500GiB.
After working out the various combinations of things that should work. I’ve been so close to getting things working - but keep running into problems when starting up a workspace.
This issue is the one that is giving problems now with both 0.8.0 and 0.9.0-alpha1:
Has anyone been able to create a fully working self-hosted setup recently?
I also spent a long time on this about a year ago as well - and came to the conclusion that self-hosted was just not ready for prime time then. Is this still the case?