Community Packages

Please read this before reporting a bug:
https://wiki.archlinux.org/title/Bug_reporting_guidelines

Do NOT report bugs when a package is just outdated, or it is in the AUR. Use the 'flag out of date' link on the package page, or the Mailing List.

REPEAT: Do NOT report bugs for outdated packages!
Tasklist

FS#75339 - [gitlab] Migrating the database does not finish

Attached to Project: Community Packages
Opened by Nico (nico) - Saturday, 16 July 2022, 11:41 GMT
Last edited by Toolybird (Toolybird) - Monday, 01 August 2022, 22:01 GMT
Task Type Bug Report
Category Packages
Status Closed
Assigned To No-one
Architecture All
Severity Low
Priority Normal
Reported Version
Due in Version Undecided
Due Date Undecided
Percent Complete 100%
Votes 0
Private No

Details

Description:

When running `(cd /usr/share/webapps/gitlab && sudo -u gitlab $(cat environment | xargs) bundle-2.7 exec rake db:migrate)` the execution does not finish.

When looking with `top` at the process, you can see that the CPU load goes to 0 after ~10sec runtime. I've waited for ~15min for the migration to finish, without any results.


Additional info:
Terminal output after Ctrl+C:

```
# (cd /usr/share/webapps/gitlab && sudo -u gitlab $(cat environment | xargs) bundle-2.7 exec rake db:migrate)
^C^Crake aborted!
Interrupt:
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/pg-1.3.5/lib/pg/connection.rb:627:in `wait_writable'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/pg-1.3.5/lib/pg/connection.rb:627:in `async_connect_or_reset'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/pg-1.3.5/lib/pg/connection.rb:707:in `new'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/pg-1.3.5/lib/pg.rb:69:in `connect'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/activerecord-6.1.4.7/lib/active_record/connection_adapters/postgresql_adapter.rb:78:in `new_client'
/usr/share/webapps/gitlab/config/initializers/00_connection_logger.rb:21:in `new_client'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/activerecord-6.1.4.7/lib/active_record/connection_adapters/postgresql_adapter.rb:37:in `postgresql_connection'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/activerecord-6.1.4.7/lib/active_record/connection_adapters/abstract/connection_pool.rb:882:in `public_send'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/activerecord-6.1.4.7/lib/active_record/connection_adapters/abstract/connection_pool.rb:882:in `new_connection'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/activerecord-6.1.4.7/lib/active_record/connection_adapters/abstract/connection_pool.rb:926:in `checkout_new_connection'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/activerecord-6.1.4.7/lib/active_record/connection_adapters/abstract/connection_pool.rb:905:in `try_to_checkout_new_connection'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/activerecord-6.1.4.7/lib/active_record/connection_adapters/abstract/connection_pool.rb:866:in `acquire_connection'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/activerecord-6.1.4.7/lib/active_record/connection_adapters/abstract/connection_pool.rb:588:in `checkout'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/activerecord-6.1.4.7/lib/active_record/connection_adapters/abstract/connection_pool.rb:428:in `connection'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/activerecord-6.1.4.7/lib/active_record/connection_adapters/abstract/connection_pool.rb:1128:in `retrieve_connection'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/activerecord-6.1.4.7/lib/active_record/connection_handling.rb:327:in `retrieve_connection'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/activerecord-6.1.4.7/lib/active_record/connection_handling.rb:283:in `connection'
/usr/share/webapps/gitlab/lib/gitlab/database/reflection.rb:140:in `connection'
/usr/share/webapps/gitlab/lib/gitlab/database/reflection.rb:94:in `exists?'
/usr/share/webapps/gitlab/lib/feature.rb:202:in `unsafe_get'
/usr/share/webapps/gitlab/lib/feature.rb:193:in `with_feature'
/usr/share/webapps/gitlab/lib/feature.rb:87:in `enabled?'
/usr/share/webapps/gitlab/lib/gitlab/gitaly_client/storage_settings.rb:43:in `block in rugged_enabled?'
/usr/share/webapps/gitlab/lib/gitlab/gitaly_client/storage_settings.rb:42:in `any?'
/usr/share/webapps/gitlab/lib/gitlab/gitaly_client/storage_settings.rb:42:in `rugged_enabled?'
/usr/share/webapps/gitlab/lib/gitlab/gitaly_client/storage_settings.rb:34:in `disk_access_denied?'
/usr/share/webapps/gitlab/lib/gitlab/gitaly_client/storage_settings.rb:64:in `legacy_disk_path'
/usr/share/webapps/gitlab/config/initializers/1_settings.rb:849:in `block (2 levels) in <top (required)>'
/usr/share/webapps/gitlab/config/initializers/1_settings.rb:849:in `any?'
/usr/share/webapps/gitlab/config/initializers/1_settings.rb:849:in `block in <top (required)>'
/usr/share/webapps/gitlab/lib/gitlab/gitaly_client/storage_settings.rb:30:in `block in allow_disk_access'
/usr/share/webapps/gitlab/lib/gitlab/temporarily_allow.rb:9:in `temporarily_allow'
/usr/share/webapps/gitlab/lib/gitlab/gitaly_client/storage_settings.rb:30:in `allow_disk_access'
/usr/share/webapps/gitlab/config/initializers/1_settings.rb:848:in `<top (required)>'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/railties-6.1.4.7/lib/rails/engine.rb:681:in `load'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/railties-6.1.4.7/lib/rails/engine.rb:681:in `block in load_config_initializer'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/activesupport-6.1.4.7/lib/active_support/notifications.rb:205:in `instrument'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/railties-6.1.4.7/lib/rails/engine.rb:680:in `load_config_initializer'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/railties-6.1.4.7/lib/rails/engine.rb:634:in `block (2 levels) in <class:Engine>'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/railties-6.1.4.7/lib/rails/engine.rb:633:in `each'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/railties-6.1.4.7/lib/rails/engine.rb:633:in `block in <class:Engine>'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/railties-6.1.4.7/lib/rails/initializable.rb:32:in `instance_exec'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/railties-6.1.4.7/lib/rails/initializable.rb:32:in `run'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/railties-6.1.4.7/lib/rails/initializable.rb:61:in `block in run_initializers'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/railties-6.1.4.7/lib/rails/initializable.rb:50:in `each'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/railties-6.1.4.7/lib/rails/initializable.rb:50:in `tsort_each_child'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/railties-6.1.4.7/lib/rails/initializable.rb:60:in `run_initializers'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/railties-6.1.4.7/lib/rails/application.rb:391:in `initialize!'
/usr/share/webapps/gitlab/config/environment.rb:7:in `<top (required)>'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/zeitwerk-2.6.0/lib/zeitwerk/kernel.rb:35:in `require'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/zeitwerk-2.6.0/lib/zeitwerk/kernel.rb:35:in `require'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/activesupport-6.1.4.7/lib/active_support/dependencies.rb:332:in `block in require'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/activesupport-6.1.4.7/lib/active_support/dependencies.rb:299:in `load_dependency'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/activesupport-6.1.4.7/lib/active_support/dependencies.rb:332:in `require'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/railties-6.1.4.7/lib/rails/application.rb:367:in `require_environment!'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/railties-6.1.4.7/lib/rails/application.rb:533:in `block in run_tasks_blocks'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/sentry-ruby-core-5.1.1/lib/sentry/rake.rb:24:in `execute'
/usr/share/webapps/gitlab/vendor/bundle/ruby/2.7.0/gems/rake-13.0.6/exe/rake:27:in `<top (required)>'
Tasks: TOP => db:migrate => db:load_config => environment
(See full trace by running task with --trace)
```

Current gitlab package versions:
```
gitlab: 15.0.2-1
gitlab-gitaly: 5.0.2-1
gitlab-runner: 15.0.0-2
gitlab-shell: 3:14.7.3-1
```
This task depends upon

Closed by  Toolybird (Toolybird)
Monday, 01 August 2022, 22:01 GMT
Reason for closing:  Not a bug
Additional comments about closing:  See comments
Comment by Toolybird (Toolybird) - Sunday, 24 July 2022, 03:30 GMT
Is it still happening and have you reported this and/or sought help upstream? I'm sure you've already read this [1]. Arch gitlab pkg has been updated 3 times since the version you're running. Not sure there is much we can do about this with the info provided.

[1] https://docs.gitlab.com/ee/development/database_debugging.html
Comment by Nico (nico) - Monday, 01 August 2022, 16:32 GMT
I solved it. I missed that there was a major change in `/etc/webapps/gitlab/database.yml` for the version above 15.0.2. See https://wiki.archlinux.org/title/GitLab#PostgreSQL_database.
I updated my `database.yml` as described in the wiki and the migration worked again.

Just for the record:
I was stuck since 15.0.2-1 and I tried to upgrade 2-3 times in between different versions including the version available right now (15.1.2-1).

Issue can be closed.
Comment by Toolybird (Toolybird) - Monday, 01 August 2022, 22:00 GMT
Ah, wiki comes to the rescue yet again! Glad you solved it. Thanks for getting back to us.

Loading...