CI: Use gcr mirror in DinD (17.9 Backport)

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2304



Merged-by: Siddharth Kannan <skannan@gitlab.com>
Approved-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Co-authored-by: Clemens Beck <cbeck@gitlab.com>

Merge branch 'fixup-non-based-ubi' into '17-9-stable'

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2276



Merged-by: Jenny Kim <yjeankim@gitlab.com>
Approved-by: Jon Doveston <jdoveston@gitlab.com>
Approved-by: Andrew Patterson <apatterson@gitlab.com>
Co-authored-by: Jason Plum <jplum@gitlab.com>

UBI/FIPS: Fixup container_version when not using gitlab-base

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2274



Merged-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Approved-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Co-authored-by: Jason Plum <jplum@gitlab.com>

(cherry picked from commit 269c3755)

a6485421

 UBI/FIPS: Fixup container_version when not using gitlab-base

Co-authored-by: Balasankar 'Balu' C <balasankar@gitlab.com>

Bump go to v1.23.6

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2264



Merged-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Approved-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Co-authored-by: Robert Marshall <rmarshall@gitlab.com>

- Updates dependency golang/go to v1.23.6
- Backported because we shipped this in Omnibus GitLab in version 17.9
  and we promise parity.
- See https://gitlab.com/gitlab-org/omnibus-gitlab/-/merge_requests/8163
- Backports https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2251



Changelog: changed
Signed-off-by: Robert Marshall <rmarshall@gitlab.com>

Update dependency gitlab-mail_room to v0.0.27

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2263



Merged-by: Jason Plum <jplum@gitlab.com>
Approved-by: Jason Plum <jplum@gitlab.com>
Co-authored-by: Stan Hu <stanhu@gmail.com>

This backports
https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2256 to
17-9-stable. This fixes a long standing problem with MailRoom not
respecting `no_proxy`:
https://gitlab.com/gitlab-org/gitlab/-/issues/402777

Changelog: fixed

PG: Upgrade client libraries and programs to 16.8

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2239



Merged-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Approved-by: Robert Marshall <rmarshall@gitlab.com>
Approved-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Co-authored-by: Jason Plum <jplum@gitlab.com>

https://www.postgresql.org/docs/release/16.8/

This does not affect servers, and allows access, backup and restore
for to servers at matching major version or earlier.

Changelog: changed

Make dev.gitlab.org use CI_TOOLS from its own instance

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2221



Merged-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Approved-by: Jason Plum <jplum@gitlab.com>
Approved-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Co-authored-by: João Cunha <j.a.cunha@gmail.com>

Fix backup-utility not evaluating environment

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2223



Merged-by: Robert Marshall <rmarshall@gitlab.com>
Approved-by: Robert Marshall <rmarshall@gitlab.com>
Co-authored-by: Stan Hu <stanhu@gmail.com>

Fix process-wrapper logic

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2225



Merged-by: Robert Marshall <rmarshall@gitlab.com>
Approved-by: Dmitry Gruzd <dgruzd@gitlab.com>
Approved-by: Robert Marshall <rmarshall@gitlab.com>
Reviewed-by: Robert Marshall <rmarshall@gitlab.com>
Co-authored-by: John Mason <9717668-johnmason@users.noreply.gitlab.com>

- The exit code did not correctly register thus
  the error message does not pop out correctly.
- The new settings for the wrapper invocation
  caused the shell to abort due to usage of
  an unbound variable.

Bump zoekt version to 0.10.0

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2220



Merged-by: Dmitry Gruzd <dgruzd@gitlab.com>
Approved-by: Dmitry Gruzd <dgruzd@gitlab.com>
Co-authored-by: rkumar555 <rkumar@gitlab.com>

This reverts 161325edf11ac1eb837e035865f7d37eec1509ef because it
does not work. `eval` is needed here.

Add support for Azure workload identity for backup-utility

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2216



Merged-by: Robert Marshall <rmarshall@gitlab.com>
Approved-by: Clemens Beck <cbeck@gitlab.com>
Approved-by: Robert Marshall <rmarshall@gitlab.com>
Reviewed-by: Robert Marshall <rmarshall@gitlab.com>
Reviewed-by: Clemens Beck <cbeck@gitlab.com>
Co-authored-by: Stan Hu <stanhu@gmail.com>

Previously it was required to have a `azure_storage_access_key` specified.
With workload identities, the key is no longer needed because Azure
can retrieve temporary credentials.

It appears that `azcopy` v10.25.0 added support for workload
identities in https://github.com/Azure/azure-storage-azcopy/pull/2619.
GitLab 17.6 shipped with `azcopy` v10.26.0 in
https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/1950. It's
not well-documented, but to use backups with a workload identity you
have to set `AZCOPY_AUTO_LOGIN_TYPE=workload` in the environment.

Relates to https://gitlab.com/gitlab-org/gitlab/-/issues/242245

Changelog: added

Raise an error if hostname is empty for zoekt pods

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2217



Merged-by: Robert Marshall <rmarshall@gitlab.com>
Approved-by: Dmitry Gruzd <dgruzd@gitlab.com>
Approved-by: Robert Marshall <rmarshall@gitlab.com>
Reviewed-by: Robert Marshall <rmarshall@gitlab.com>
Reviewed-by: Dmitry Gruzd <dgruzd@gitlab.com>
Co-authored-by: John Mason <9717668-johnmason@users.noreply.gitlab.com>

- If the result of `hostname -f` in a Zoekt pod is empty or
  throws an error, do not allow the pod to come online and
  log the error instead.

Related https://gitlab.com/gitlab-org/gitlab/-/issues/517962

This stops downloading the distribution_ci_tools built from gitlab.com
when running pipelines in dev.gitlab.org. We want to keep the instances
speparate to avoid single point of failure.

Issue: https://gitlab.com/gitlab-org/build/CNG/-/issues/2104

Update moby/buildkit Docker tag to v0.19.0

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2145



Merged-by: Robert Marshall <rmarshall@gitlab.com>
Approved-by: Jon Doveston <jdoveston@gitlab.com>
Approved-by: Robert Marshall <rmarshall@gitlab.com>
Co-authored-by: GitLab Renovate Bot <gitlab-bot@gitlab.com>

- Updates moby/buildkit Docker tag to v0.19.0

Changelog: changed

Fix warning: 'as' and 'FROM' keywords' casing do not match

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2215



Merged-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Approved-by: Dustin Collins <714871-dustinmm80@users.noreply.gitlab.com>
Approved-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Co-authored-by: Mikhail Mazurskiy <mmazurskiy@gitlab.com>