Make dev.gitlab.org use CI_TOOLS from its own instance

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2221



Merged-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Approved-by: Jason Plum <jplum@gitlab.com>
Approved-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Co-authored-by: João Cunha <j.a.cunha@gmail.com>

Fix backup-utility not evaluating environment

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2223



Merged-by: Robert Marshall <rmarshall@gitlab.com>
Approved-by: Robert Marshall <rmarshall@gitlab.com>
Co-authored-by: Stan Hu <stanhu@gmail.com>

Fix process-wrapper logic

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2225



Merged-by: Robert Marshall <rmarshall@gitlab.com>
Approved-by: Dmitry Gruzd <dgruzd@gitlab.com>
Approved-by: Robert Marshall <rmarshall@gitlab.com>
Reviewed-by: Robert Marshall <rmarshall@gitlab.com>
Co-authored-by: John Mason <9717668-johnmason@users.noreply.gitlab.com>

- The exit code did not correctly register thus
  the error message does not pop out correctly.
- The new settings for the wrapper invocation
  caused the shell to abort due to usage of
  an unbound variable.

Bump zoekt version to 0.10.0

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2220



Merged-by: Dmitry Gruzd <dgruzd@gitlab.com>
Approved-by: Dmitry Gruzd <dgruzd@gitlab.com>
Co-authored-by: rkumar555 <rkumar@gitlab.com>

This reverts 161325edf11ac1eb837e035865f7d37eec1509ef because it
does not work. `eval` is needed here.

Add support for Azure workload identity for backup-utility

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2216



Merged-by: Robert Marshall <rmarshall@gitlab.com>
Approved-by: Clemens Beck <cbeck@gitlab.com>
Approved-by: Robert Marshall <rmarshall@gitlab.com>
Reviewed-by: Robert Marshall <rmarshall@gitlab.com>
Reviewed-by: Clemens Beck <cbeck@gitlab.com>
Co-authored-by: Stan Hu <stanhu@gmail.com>

Previously it was required to have a `azure_storage_access_key` specified.
With workload identities, the key is no longer needed because Azure
can retrieve temporary credentials.

It appears that `azcopy` v10.25.0 added support for workload
identities in https://github.com/Azure/azure-storage-azcopy/pull/2619.
GitLab 17.6 shipped with `azcopy` v10.26.0 in
https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/1950. It's
not well-documented, but to use backups with a workload identity you
have to set `AZCOPY_AUTO_LOGIN_TYPE=workload` in the environment.

Relates to https://gitlab.com/gitlab-org/gitlab/-/issues/242245

Changelog: added

Raise an error if hostname is empty for zoekt pods

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2217



Merged-by: Robert Marshall <rmarshall@gitlab.com>
Approved-by: Dmitry Gruzd <dgruzd@gitlab.com>
Approved-by: Robert Marshall <rmarshall@gitlab.com>
Reviewed-by: Robert Marshall <rmarshall@gitlab.com>
Reviewed-by: Dmitry Gruzd <dgruzd@gitlab.com>
Co-authored-by: John Mason <9717668-johnmason@users.noreply.gitlab.com>

- If the result of `hostname -f` in a Zoekt pod is empty or
  throws an error, do not allow the pod to come online and
  log the error instead.

Related https://gitlab.com/gitlab-org/gitlab/-/issues/517962

This stops downloading the distribution_ci_tools built from gitlab.com
when running pipelines in dev.gitlab.org. We want to keep the instances
speparate to avoid single point of failure.

Issue: https://gitlab.com/gitlab-org/build/CNG/-/issues/2104

Update moby/buildkit Docker tag to v0.19.0

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2145



Merged-by: Robert Marshall <rmarshall@gitlab.com>
Approved-by: Jon Doveston <jdoveston@gitlab.com>
Approved-by: Robert Marshall <rmarshall@gitlab.com>
Co-authored-by: GitLab Renovate Bot <gitlab-bot@gitlab.com>

- Updates moby/buildkit Docker tag to v0.19.0

Changelog: changed

Fix warning: 'as' and 'FROM' keywords' casing do not match

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2215



Merged-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Approved-by: Dustin Collins <714871-dustinmm80@users.noreply.gitlab.com>
Approved-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Co-authored-by: Mikhail Mazurskiy <mmazurskiy@gitlab.com>

Add container build for agentk

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2197



Merged-by: Jason Plum <jplum@gitlab.com>
Approved-by: João Alexandre Cunha <j.a.cunha@gmail.com>
Approved-by: Jason Plum <jplum@gitlab.com>
Reviewed-by: Jason Plum <jplum@gitlab.com>
Reviewed-by: João Alexandre Cunha <j.a.cunha@gmail.com>
Reviewed-by: Mikhail Mazurskiy <mmazurskiy@gitlab.com>
Co-authored-by: Mikhail Mazurskiy <mmazurskiy@gitlab.com>

Co-authored-by: Jason Plum <jplum@gitlab.com>

Update dependency aws/aws-cli to v1.37.13

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2212



Merged-by: Jason Plum <jplum@gitlab.com>
Approved-by: Clemens Beck <cbeck@gitlab.com>
Approved-by: Jason Plum <jplum@gitlab.com>
Co-authored-by: GitLab Renovate Bot <gitlab-bot@gitlab.com>

Update preflight tag to 1.11.1

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2198



Merged-by: Robert Marshall <rmarshall@gitlab.com>
Approved-by: Jon Doveston <jdoveston@gitlab.com>
Approved-by: Robert Marshall <rmarshall@gitlab.com>
Co-authored-by: Lucas Li <lli@gitlab.com>

- Updates preflight tag to 1.11.1

Related to: https://gitlab.com/gitlab-org/cloud-native/preflight/-/issues/17

Changelog: changed

Update dependency aws/aws-cli to v1.37.12

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2204



Merged-by: Jason Plum <jplum@gitlab.com>
Approved-by: Lucas Li <lli@gitlab.com>
Approved-by: Jason Plum <jplum@gitlab.com>
Co-authored-by: GitLab Renovate Bot <gitlab-bot@gitlab.com>

Do not make gitlab_bundle_gemfile depend on compile_assets

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2209



Merged-by: Jason Plum <jplum@gitlab.com>
Approved-by: Hossein Pursultani <hpursultani@gitlab.com>
Approved-by: Jason Plum <jplum@gitlab.com>
Co-authored-by: Balasankar "Balu" C <balasankar@gitlab.com>

Changelog: changed

Revert "Merge branch 'ec/gitaly-cng-git-clone-instead-of-tarball' into 'master'"

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2210



Merged-by: Robert Marshall <rmarshall@gitlab.com>
Approved-by: Robert Marshall <rmarshall@gitlab.com>
Co-authored-by: Jason Plum <jplum@gitlab.com>

Update dependency Azure/azure-storage-azcopy to v10.28.0

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2203



Merged-by: Jason Plum <jplum@gitlab.com>
Approved-by: João Alexandre Cunha <j.a.cunha@gmail.com>
Approved-by: Jason Plum <jplum@gitlab.com>
Co-authored-by: GitLab Renovate Bot <gitlab-bot@gitlab.com>

Update dependency gitlab-exporter to v15.2.0

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2207



Merged-by: Jason Plum <jplum@gitlab.com>
Approved-by: João Alexandre Cunha <j.a.cunha@gmail.com>
Approved-by: Jason Plum <jplum@gitlab.com>
Co-authored-by: GitLab Renovate Bot <gitlab-bot@gitlab.com>

This reverts merge request !2156

Git clone instead of curl to retrieve Gitaly tar

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2156



Merged-by: Jason Plum <jplum@gitlab.com>
Approved-by: Jon Doveston <jdoveston@gitlab.com>
Approved-by: Jason Plum <jplum@gitlab.com>
Co-authored-by: Emily Chui <echui@gitlab.com>

Downloading the Gitaly tarball via curl does not download the .git
folder which has essential runtime build information that is required
for Gitaly Pod metrics to be labelled with the right Gitaly version
and other build information.

Update dependency redis-client to v0.23.2

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2140



Merged-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Approved-by: Lucas Li <lli@gitlab.com>
Approved-by: Balasankar 'Balu' C <balasankar@gitlab.com>
Co-authored-by: GitLab Renovate Bot <gitlab-bot@gitlab.com>

Signed-off-by: Balasankar "Balu" C <balasankar@gitlab.com>

Update dependency kubectl to v1.32.1

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2178



Merged-by: Robert Marshall <rmarshall@gitlab.com>
Approved-by: João Alexandre Cunha <j.a.cunha@gmail.com>
Approved-by: Robert Marshall <rmarshall@gitlab.com>
Co-authored-by: GitLab Renovate Bot <gitlab-bot@gitlab.com>

- Updates dependency kubectl to v1.32.1

Changelog: changed

Updates stable branch template

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2201



Merged-by: Jason Plum <jplum@gitlab.com>
Approved-by: Jason Plum <jplum@gitlab.com>
Co-authored-by: Mayra Cabrera <mcabrera@gitlab.com>

Changelog: changed

Update Rubygems and Bundler

See merge request https://gitlab.com/gitlab-org/build/CNG/-/merge_requests/2085



Merged-by: Robert Marshall <rmarshall@gitlab.com>
Approved-by: Clemens Beck <cbeck@gitlab.com>
Approved-by: Robert Marshall <rmarshall@gitlab.com>
Co-authored-by: GitLab Renovate Bot <gitlab-bot@gitlab.com>