AKAisha Khan
The four golden signals for model inference
Latency, traffic, errors, saturation — adapted for GPU serving.
@aisha
Observability & reliability
If you can't measure it, you can't autoscale it. Prometheus, OTel, SLOs.
2
Stories
306
Views
11
Likes
5
Followers