Dashboard throws 500 when saving settings


#1

Customer attempted to update SSL certificate in dashboard and started receiving 500 errors. Logs for the replicated container show the following:

[Recovery] panic recovered:
PUT /v0.1/console/settings? HTTP/1.1
Host: replicated
Accept: application/json
Accept-Language: en-US,en;q=0.9
Authorization: Token
Content-Length: 690
Content-Type: application/json; charset=utf-8
User-Agent: Replicated-Client/2_6_0
runtime error: invalid memory address or nil pointer dereference
/usr/local/go/src/runtime/panic.go:458 (0x4326c3)
/usr/local/go/src/runtime/panic.go:62 (0x4311ed)
/usr/local/go/src/runtime/sigpanic_unix.go:24 (0x447ac4)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/scheduler/native/models/container_logopts.go:63 (0xee1686)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/scheduler/native/models/app_version.go:312 (0xed02f4)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/scheduler/native/models/app_version.go:474 (0xed1b21)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/scheduler/native/models/app_version.go:555 (0xed2682)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/scheduler/native/models/app_version.go:443 (0xed173b)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/scheduler/native/scheduler.go:284 (0x94bc5b)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/daemon/handlers/restarts.go:24 (0x738743)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/daemon/handlers/restarts.go:17 (0x7386da)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/daemon/handlers/component_config.go:167 (0x726823)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/daemon/handlers/console_settings.go:114 (0x728478)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/daemon/handlers/console_settings.go:152 (0x7286cc)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/daemon/daemon.go:964 (0x4c7254)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/vendor/github.com/gin-gonic/gin/context.go:97 (0x68d5ea)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/vendor/github.com/replicatedcom/premkit/log/gin.go:28 (0x57565f)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/vendor/github.com/gin-gonic/gin/context.go:97 (0x68d5ea)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/daemon/middleware/version_headers.go:12 (0x745fc4)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/vendor/github.com/gin-gonic/gin/context.go:97 (0x68d5ea)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/vendor/github.com/gin-gonic/gin/recovery.go:45 (0x69bfea)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/vendor/github.com/gin-gonic/gin/context.go:97 (0x68d5ea)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/vendor/github.com/gin-gonic/gin/gin.go:294 (0x69368e)
/home/jenkins/workspace/replicated-2-beta/PROJ_PACKAGETYPE/docker/label/jenkins-slave-docker-golang1.7/go/src/github.com/replicatedcom/replicated/vendor/github.com/gin-gonic/gin/gin.go:275 (0x692f70)
/usr/local/go/src/net/http/server.go:2202 (0x65736d)
/usr/local/go/src/net/http/server.go:1579 (0x653c07)
/usr/local/go/src/runtime/asm_amd64.s:2086 (0x463f51)

I’m unsure if it’s explicitly related but it looks like something that should be fixed. Have any of you seen this behavior before?


#2

I have not seen that before! However, I also don’t know what that’s coming from - at least not without the Replicated version, etc. (I can see the same file in the current version, but the panic - container_logopts.go:63 - occurs at a nonsensical location, and golang 1.7 is old and we haven’t built with that in quite some time)

Would you be willing to provide a support bundle? Does support bundle even exist as a concept in that version of Replicated?

As to whether it’s been fixed, it’s been 4+ years since that version was released, so my guess is yes.