Having Issues With Private Repository and Dockerfile

Hello,

I have finally gotten a self-hosted installation of Gitpod up and running. For some reason when I try opening a specific private repository in Gitpod it doesn’t seem to run the stuff I have defined in my .gitpod.Dockerfile. However, if I set the repository to be public, it works fine. In fact, my .gitpod.Dockerfile is the same as the gitpod-io/self-hosted one. The same for the .gitpod.yml file, same contents as the one in the gitpod-io/self-hosted repository.

I am using GitHub Enterprise with my Gitpod instance.

I also noticed that this seems to happen with any private repository. If I have something like this in my Dockerfile it won’t work:

FROM gitpod/workspace-full

USER root

### cloud_sql_proxy ###
ARG CLOUD_SQL_PROXY=/usr/local/bin/cloud_sql_proxy
RUN curl -fsSL https://dl.google.com/cloudsql/cloud_sql_proxy.linux.amd64 > $CLOUD_SQL_PROXY \
    && chmod +x $CLOUD_SQL_PROXY

Any ideas?

1 Like

hi @astuffedtiger!

based on your description… no idea, unfortunately.
Did you get an error message?
Are the error messages in the logs of the pods/containers named server, ws-manager, or image-builder?

Hello!

I don’t think there was any error message. I have, unfortunately had to tear down my Gitpod instance as it was really expensive at both GCP and DigitalOcean. I am working on setting up a new server at home to see if I can get it working there. If/when I do I will try replicating there to see if I can. If so, I will check logs and report back here.

Thanks!

Alright, I got another Gitpod instance spun up. The only place where I see what looks suspicious is in the ws-manager-node pod logs:

2020-06-19T01:28:17.132089147Z  {"@type":"type.googleapis.com/google.devtools.clouderrorreporting.v1beta1.ReportedErrorEvent","containerID":"a837624d83449c8754cbf9105b8ac4419ac4425bec7d2e0059242ac83ab3bacc","containerImage":"","error":"not found\ngithub.com/containerd/containerd/errdefs.init\n\t/workspace/go/pkg/mod/github.com/containerd/containerd@v1.3.2/errdefs/errors.go:45\nruntime.doInit\n\t/home/gitpod/go/src/runtime/proc.go:5414\nruntime.doInit\n\t/home/gitpod/go/src/runtime/proc.go:5409\nruntime.doInit\n\t/home/gitpod/go/src/runtime/proc.go:5409\nruntime.doInit\n\t/home/gitpod/go/src/runtime/proc.go:5409\nruntime.doInit\n\t/home/gitpod/go/src/runtime/proc.go:5409\nruntime.doInit\n\t/home/gitpod/go/src/runtime/proc.go:5409\nruntime.doInit\n\t/home/gitpod/go/src/runtime/proc.go:5409\nruntime.main\n\t/home/gitpod/go/src/runtime/proc.go:190\nruntime.goexit\n\t/home/gitpod/go/src/runtime/asm_amd64.s:1373\ncontainer \"a837624d83449c8754cbf9105b8ac4419ac4425bec7d2e0059242ac83ab3bacc\" in namespace \"k8s.io\"\ngithub.com/containerd/containerd/errdefs.FromGRPC\n\t/workspace/go/pkg/mod/github.com/containerd/containerd@v1.3.2/errdefs/grpc.go:107\ngithub.com/containerd/containerd.(*remoteContainers).Get\n\t/workspace/go/pkg/mod/github.com/containerd/containerd@v1.3.2/containerstore.go:50\ngithub.com/typefox/gitpod/ws-manager-node/pkg/resourcegov.(*WorkspaceDispatch).handleContainerdEvent\n\t/tmp/build/components-ws-manager-node--app.8e0db19911e99d92b1f222461aa2637685dd9639/pkg/resourcegov/dispatch.go:187\ngithub.com/typefox/gitpod/ws-manager-node/pkg/resourcegov.(*WorkspaceDispatch).Start\n\t/tmp/build/components-ws-manager-node--app.8e0db19911e99d92b1f222461aa2637685dd9639/pkg/resourcegov/dispatch.go:171\nruntime.goexit\n\t/home/gitpod/go/src/runtime/asm_amd64.s:1373","message":"cannot find container we just received a create event for","serviceContext":{"service":"ws-manager-node","version":""},"severity":"warning","time":"2020-06-19T01:28:17Z"}
2020-06-19T01:28:18.571126928Z  {"@type":"type.googleapis.com/google.devtools.clouderrorreporting.v1beta1.ReportedErrorEvent","containerID":"ef38658adfbca0ff177404e8ec37195360b315206021edcf78a23c12e5790ded","containerImage":"","error":"not found\ngithub.com/containerd/containerd/errdefs.init\n\t/workspace/go/pkg/mod/github.com/containerd/containerd@v1.3.2/errdefs/errors.go:45\nruntime.doInit\n\t/home/gitpod/go/src/runtime/proc.go:5414\nruntime.doInit\n\t/home/gitpod/go/src/runtime/proc.go:5409\nruntime.doInit\n\t/home/gitpod/go/src/runtime/proc.go:5409\nruntime.doInit\n\t/home/gitpod/go/src/runtime/proc.go:5409\nruntime.doInit\n\t/home/gitpod/go/src/runtime/proc.go:5409\nruntime.doInit\n\t/home/gitpod/go/src/runtime/proc.go:5409\nruntime.doInit\n\t/home/gitpod/go/src/runtime/proc.go:5409\nruntime.main\n\t/home/gitpod/go/src/runtime/proc.go:190\nruntime.goexit\n\t/home/gitpod/go/src/runtime/asm_amd64.s:1373\ncontainer \"ef38658adfbca0ff177404e8ec37195360b315206021edcf78a23c12e5790ded\" in namespace \"k8s.io\"\ngithub.com/containerd/containerd/errdefs.FromGRPC\n\t/workspace/go/pkg/mod/github.com/containerd/containerd@v1.3.2/errdefs/grpc.go:107\ngithub.com/containerd/containerd.(*remoteContainers).Get\n\t/workspace/go/pkg/mod/github.com/containerd/containerd@v1.3.2/containerstore.go:50\ngithub.com/typefox/gitpod/ws-manager-node/pkg/resourcegov.(*WorkspaceDispatch).handleContainerdEvent\n\t/tmp/build/components-ws-manager-node--app.8e0db19911e99d92b1f222461aa2637685dd9639/pkg/resourcegov/dispatch.go:187\ngithub.com/typefox/gitpod/ws-manager-node/pkg/resourcegov.(*WorkspaceDispatch).Start\n\t/tmp/build/components-ws-manager-node--app.8e0db19911e99d92b1f222461aa2637685dd9639/pkg/resourcegov/dispatch.go:171\nruntime.goexit\n\t/home/gitpod/go/src/runtime/asm_amd64.s:1373","message":"cannot find container we just received a create event for","serviceContext":{"service":"ws-manager-node","version":""},"severity":"warning","time":"2020-06-19T01:28:18Z"}

I also see this in the server pod logs, but I think it might be unrelated:

2020-06-19T01:37:50.76196932Z  {"@type":"type.googleapis.com/google.devtools.clouderrorreporting.v1beta1.ReportedErrorEvent","serviceContext":{"service":"server","version":"v0.4.0"},"component":"server","severity":"ERROR","time":"2020-06-19T01:37:50.761Z","environment":"production","region":"local","message":"Error in fetching sampling strategy: Error: connect ECONNREFUSED 0.0.0.0:5778.","loggedViaConsole":true}
2020-06-19T01:37:51.255098934Z  {"@type":"type.googleapis.com/google.devtools.clouderrorreporting.v1beta1.ReportedErrorEvent","serviceContext":{"service":"server","version":"v0.4.0"},"component":"server","severity":"ERROR","time":"2020-06-19T01:37:51.254Z","environment":"production","region":"local","message":"Error in fetching sampling strategy: Error: connect ECONNREFUSED 0.0.0.0:5778.","loggedViaConsole":true}

Does that help any?

Thanks!

I can still confirm this is an issue with a brand spankin’ new fresh setup:

gitpod /workspace/self-hosted $  HISTFILE=/workspace/.gitpod/cmd-0 history -r; {
> gp open values.yaml
> ./utils/create-gcp-resources.go
> 
> }
This is the GCP project setup script for Gitpod.
It is re-entrant, meaning that if it fails at any point you should be able to run it again without the script failing before that point.

- check environment


failure: Google Cloud SDK is not installed - head over to https://cloud.google.com/sdk/install and install it
exit status 1

Where else can we look to troubleshoot this?

Thanks!

Bump! I can confirm this is still happening.

Having problem here as well. Was working with gipod-selfhosted/v0.4.0 and redeployed using gitpod/0.5.0 (now that self-hosted is deprecated) and now I get the error message regarding ws-sync not being able to connect.

I also went from a 1-node to 3-node K8s cluster deployment. Other than that no significant changes other than the 0.4.0 to 0.5.0 upgrade/redeploy.