-
Notifications
You must be signed in to change notification settings - Fork 3.8k
Closed
Description
Describe the bug
I deploy frontend+scheduler+querier 3 components in k8s to complete logql API query.
According to my observation, when the queryer is killed by k8s due to OOM, the logql query will be unavailable. And the log keeps reporting errors.
frontend log
level=error ts=2022-11-18T10:52:00.862957605Z caller=retry.go:77 org_id=123_qaawmopdln
msg=\"error processing request\" try=0 err=\"context canceled\"
The phenomenon is somewhat similar to deadlock. But I'm still investigating the rootcause.
To Reproduce
I deploy loki without helm, it's diffcult to reproduce .
Expected behavior
if querier was killed, logql should be available.
Environment:
- Infrastructure: [Kubernetes]
- Deployment tool: [deploy yaml one by one]
- loki code branch : github master
Screenshots, Promtail config, or terminal output
scheduler log
marcusteixeira
Metadata
Metadata
Assignees
Labels
No labels