Skip to content

Conversation

@thearyanahmed
Copy link
Contributor

This PR limits error response that is sent to kubernetes, to the first 1000 characters.

Context:
App platform received resource exhausted alert on flipop :
ResourceExhausted error (desc = trying to send message larger than max (2361634 vs. 2097152)) in the flipop pod (5 restarts in 30h).

flipop updates the status message in the floatingippool resource when it encounters an error. That message includes the response it got back from the API. When Cloud Control Panel / API is down (see inci-1955), we display a big html file containing an image.

Which made the response size > 2MB , which is gRPC's default.

https://logs.internal.digitalocean.com/goto/f4a59480-f483-11ef-9702-c10ab0923a22

@thearyanahmed thearyanahmed marked this pull request as ready for review February 26, 2025 21:00
@thearyanahmed thearyanahmed merged commit 5323091 into main Feb 27, 2025
2 checks passed
fgrutsch added a commit to lovelysystems/flipop that referenced this pull request Jul 17, 2025
* Upgrade Golang to 1.22 and all dependencies to their latest state

* add modern leases to RBAC

* dns only for assigned ips

* fix test

* update dns on all ip allocation changes (digitalocean#35)

* Upgrade go version in Makefile (digitalocean#32)

* Fix typo in comments (digitalocean#31)

* bump dependencies (digitalocean#36)

* fix examples to use common namespace + recent versions (digitalocean#37)

* Limit provider error response to 1000 characters (digitalocean#38)

* APPS-10526 Upgrade go deps (digitalocean#40)

* Use docker's recommend key value format

* Upgrade deps

* Generate k8s

* add annotation when IP assigned or change in assignments

* only ignore updates if both match status and reserved IP are not changed

* ndoedns controller supports flipop.digitalocean.com/ipv4-reserved-ip addressType

* README update

* annotationUpdater now uses NodeInformer cache to validate current annotation value

* don't use latest tag for docker image

---------

Co-authored-by: Markus Thömmes <mthoemmes@digitalocean.com>
Co-authored-by: Cody Baker <cbaker@digitalocean.com>
Co-authored-by: Aryan Ahmed <thearyanahmed@gmail.com>
Co-authored-by: kibeom lee <46297213+lkb85@users.noreply.github.com>
Co-authored-by: Aryan Ahmed <paryan@digitalocean.com>
Co-authored-by: Joe Keegan <jkeegan@digitalocean.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants