Skip to content

configs service fails on upgrade #1972

Closed
@bboreham

Description

@bboreham

Trying to update from ed7c302f to v0.5.0-rc.0 fails as follows:

level=info ts=2020-01-10T10:26:00.169747333Z caller=cortex.go:236 msg=initialising module=server
level=info ts=2020-01-10T10:26:00.170110809Z caller=server.go:117 http=[::]:80 grpc=[::]:9095 msg="server listening on addresses"
level=info ts=2020-01-10T10:26:00.170230687Z caller=cortex.go:236 msg=initialising module=configs
level=info ts=2020-01-10T10:26:00.23272648Z caller=postgres.go:89 msg="running database migrations..."
level=error ts=2020-01-10T10:26:00.236942291Z caller=log.go:141 msg="error initializing cortex" err="pq: column \"dirty\" does not exist in line 0: SELECT version, dirty FROM \"schema_migrations\" LIMIT 1\ndatabase migrations failed\ngithub.com/cortexproject/cortex/pkg/configs/db/postgres.New\n\t/go/src/github.com/cortexproject/cortex/pkg/configs/db/postgres/postgres.go:93\ngithub.com/cortexproject/cortex/pkg/configs/db.New\n\t/go/src/github.com/cortexproject/cortex/pkg/configs/db/db.go:88\ngithub.com/cortexproject/cortex/pkg/cortex.(*Cortex).initConfigs\n\t/go/src/github.com/cortexproject/cortex/pkg/cortex/modules.go:422\ngithub.com/cortexproject/cortex/pkg/cortex.(*Cortex).initModule\n\t/go/src/github.com/cortexproject/cortex/pkg/cortex/cortex.go:238\ngithub.com/cortexproject/cortex/pkg/cortex.(*Cortex).init\n\t/go/src/github.com/cortexproject/cortex/pkg/cortex/cortex.go:232\ngithub.com/cortexproject/cortex/pkg/cortex.New\n\t/go/src/github.com/cortexproject/cortex/pkg/cortex/cortex.go:185\nmain.main\n\t/go/src/github.com/cortexproject/cortex/cmd/cortex/main.go:73\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:203\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1357\nerror initialising module: configs\ngithub.com/cortexproject/cortex/pkg/cortex.(*Cortex).initModule\n\t/go/src/github.com/cortexproject/cortex/pkg/cortex/cortex.go:239\ngithub.com/cortexproject/cortex/pkg/cortex.(*Cortex).init\n\t/go/src/github.com/cortexproject/cortex/pkg/cortex/cortex.go:232\ngithub.com/cortexproject/cortex/pkg/cortex.New\n\t/go/src/github.com/cortexproject/cortex/pkg/cortex/cortex.go:185\nmain.main\n\t/go/src/github.com/cortexproject/cortex/cmd/cortex/main.go:73\nruntime.main\n\t/usr/local/go/src/runtime/proc.go:203\nruntime.goexit\n\t/usr/local/go/src/runtime/asm_amd64.s:1357"

Apparently the update via intermediate steps did work in my staging environment. No it didn't; I had stopped it updating due to the issue at #1802 (comment)

Metadata

Metadata

Assignees

No one assigned

    Labels

    component/rulesBits & bobs todo with rules and alerts: the ruler, config service etc.type/bug

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions