OOMKilled at 2am: requests, limits, and the JVM that didnt know about either
Quick write up because I have now explained this in three separate incident channels this month and I would like to just paste a link next time. Symptom: a Java service in kubernetes restarts every few hours. No exception in the logs, no stack trace, nothing. The app just... stops. kubectl describe pod shows this: Last State: Terminated Reason: OOMKilled Exit Code: 137 137 is 128 + 9, meaning the process got…