Part of https://gitlab.com/gitlab-org/gitlab-ce/issues/54255

Spawned from https://gitlab.com/gitlab-org/omnibus-gitlab/merge_requests/3220