Skip to content

Massive bandwidth usage by concourse git-upload-pack? #465

@kallisti5

Description

@kallisti5

Describe the bug

After upgrading to 7.14.2, we started seeing massive git-upload-packs in every git resource check.

For example:

XXX.139 - - [26/Jan/2026:11:38:47 +0000] "POST /buildtools.git/git-upload-pack HTTP/2.0" 200 524308386 "-" "git/2.50.1" 7924124 "webs-default-git-web-review-haiku-os-org@kubernetes" "http://10.244.1.155:8080" 24541ms
XXX.139 - - [26/Jan/2026:21:49:47 +0000] "POST /buildtools.git/git-upload-pack HTTP/2.0" 200 524308386 "-" "git/2.50.1" 7991792 "webs-default-git-web-review-haiku-os-org@kubernetes" "http://10.244.1.155:8080" 24098ms
XXX.139 - - [26/Jan/2026:22:51:52 +0000] "POST /buildtools.git/git-upload-pack HTTP/2.0" 200 524308386 "-" "git/2.50.1" 7998383 "webs-default-git-web-review-haiku-os-org@kubernetes" "http://10.244.1.155:8080" 32037ms
XXX.139 - - [27/Jan/2026:01:55:24 +0000] "POST /buildtools.git/git-upload-pack HTTP/2.0" 200 524308386 "-" "git/2.50.1" 8019075 "webs-default-git-web-review-haiku-os-org@kubernetes" "http://10.244.1.155:8080" 24978ms
XXX.139 - - [27/Jan/2026:06:58:53 +0000] "POST /buildtools.git/git-upload-pack HTTP/2.0" 200 524308386 "-" "git/2.50.1" 8071308 "webs-default-git-web-review-haiku-os-org@kubernetes" "http://10.244.1.155:8080" 26081ms
XXX.139 - - [27/Jan/2026:09:00:38 +0000] "POST /buildtools.git/git-upload-pack HTTP/2.0" 200 524308386 "-" "git/2.50.1" 8090417 "webs-default-git-web-review-haiku-os-org@kubernetes" "http://10.244.1.155:8080" 24045ms
XXX.139 - - [27/Jan/2026:10:01:29 +0000] "POST /buildtools.git/git-upload-pack HTTP/2.0" 200 524308386 "-" "git/2.50.1" 8098602 "webs-default-git-web-review-haiku-os-org@kubernetes" "http://10.244.1.155:8080" 24845ms
XXX.139 - - [27/Jan/2026:14:05:21 +0000] "POST /buildtools.git/git-upload-pack HTTP/2.0" 200 524308386 "-" "git/2.50.1" 8133644 "webs-default-git-web-review-haiku-os-org@kubernetes" "http://10.244.1.155:8080" 26202ms
XXX.139 - - [27/Jan/2026:19:11:26 +0000] "POST /buildtools.git/git-upload-pack HTTP/2.0" 200 524308386 "-" "git/2.50.1" 8187809 "webs-default-git-web-review-haiku-os-org@kubernetes" "http://10.244.1.155:8080" 25771ms
XXX.139 - - [27/Jan/2026:20:12:03 +0000] "POST /buildtools.git/git-upload-pack HTTP/2.0" 200 524308386 "-" "git/2.50.1" 8196930 "webs-default-git-web-review-haiku-os-org@kubernetes" "http://10.244.1.155:8080" 24657ms
XXX.139 - - [27/Jan/2026:21:12:53 +0000] "POST /buildtools.git/git-upload-pack HTTP/2.0" 200 524308386 "-" "git/2.50.1" 8205394 "webs-default-git-web-review-haiku-os-org@kubernetes" "http://10.244.1.155:8080" 24917ms
XXX.139 - - [27/Jan/2026:22:13:55 +0000] "POST /buildtools.git/git-upload-pack HTTP/2.0" 200 524308386 "-" "git/2.50.1" 8214829 "webs-default-git-web-review-haiku-os-org@kubernetes" "http://10.244.1.155:8080" 25195ms

Just in a sample of 263 of these over 37 days, we're totaling:

cat git-upload-packs.log | awk '{Total=Total+$10} END{print "Total is:" Total}'
Total is:555635047110

That's roughly 517 GiB per node * 4 (we have 4 nodes handling ingress)

Reproduction steps

More details

Expected behavior

Not eat up bandwidth

Additional context

No response

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions