Skip to content

v1.18.0, custom namespace, Waiting for CRDs to be installed #2732

@Tri0L

Description

@Tri0L

Fission/Kubernetes version

$ kubectl version
Client Version: version.Info{Major:"1", Minor:"23", GitVersion:"v1.23.5", GitCommit:"c285e781331a3785a7f436042c65c5641ce8a9e9", GitTreeState:"clean", BuildDate:"2022-03-16T15:51:05Z", GoVersion:"go1.17.8", Compiler:"gc", Platform:"darwin/arm64"}
Server Version: version.Info{Major:"1", Minor:"25", GitVersion:"v1.25.4", GitCommit:"872a965c6c6526caa949f0c6ac028ef7aff3fb78", GitTreeState:"clean", BuildDate:"2022-11-09T13:29:58Z", GoVersion:"go1.19.3", Compiler:"gc", Platform:"linux/arm64"}

Kubernetes platform (e.g. Google Kubernetes Engine)
docker-desktop

Describe the bug

Restarting pods when installed to custom namespace

{"level":"error","ts":"2023-02-28T11:15:47.217Z","caller":"fission-bundle/main.go:304","msg":"mqt scaler manager exited","error":"error waiting for CRDs: timeout waiting for CRDs","errorVerbose":"timeout waiting for CRDs\nerror waiting for CRDs\ngithub.com/fission/fission/pkg/mqtrigger.StartScalerManager\n\tpkg/mqtrigger/scalermanager.go:166\nmain.runMQManager\n\tcmd/fission-bundle/main.go:83\nmain.main\n\tcmd/fission-bundle/main.go:302\nruntime.main\n\t/opt/hostedtoolcache/go/1.19.4/x64/src/runtime/proc.go:250\nruntime.goexit\n\t/opt/hostedtoolcache/go/1.19.4/x64/src/runtime/asm_arm64.s:1172","stacktrace":"main.main\n\tcmd/fission-bundle/main.go:304\nruntime.main\n\t/opt/hostedtoolcache/go/1.19.4/x64/src/runtime/proc.go:250"}

To Reproduce

% export FISSION_NAMESPACE="first"

% kubectl create namespace $FISSION_NAMESPACE
namespace/first created

% kubectl create -k "github.com/fission/fission/crds/v1?ref=v1.18.0"
customresourcedefinition.apiextensions.k8s.io/canaryconfigs.fission.io created
customresourcedefinition.apiextensions.k8s.io/environments.fission.io created
customresourcedefinition.apiextensions.k8s.io/functions.fission.io created
customresourcedefinition.apiextensions.k8s.io/httptriggers.fission.io created
customresourcedefinition.apiextensions.k8s.io/kuberneteswatchtriggers.fission.io created
customresourcedefinition.apiextensions.k8s.io/messagequeuetriggers.fission.io created
customresourcedefinition.apiextensions.k8s.io/packages.fission.io created
customresourcedefinition.apiextensions.k8s.io/timetriggers.fission.io created

% helm upgrade --install --version v1.18.0 --namespace $FISSION_NAMESPACE fission fission-charts/fission-all --set defaultNamespace=$FISSION_NAMESPACE
Release "fission" does not exist. Installing it now.
NAME: fission
LAST DEPLOYED: Tue Feb 28 14:13:02 2023
NAMESPACE: first
STATUS: deployed
REVISION: 1
TEST SUITE: None
NOTES: ....

Expected result

All pods are up.

Actual result
Pods kubewatcher, mqtrigger-keda, router, timer restarts with same error.
Logs:

{"level":"info","ts":"2023-02-28T11:18:33.129Z","caller":"otel/provider.go:50","msg":"OTEL_EXPORTER_OTLP_ENDPOINT not set, skipping Opentelemtry tracing"}
{"level":"info","ts":"2023-02-28T11:18:33.130Z","caller":"crd/client.go:105","msg":"Waiting for CRDs to be installed"}
{"level":"error","ts":"2023-02-28T11:19:03.165Z","caller":"fission-bundle/main.go:304","msg":"mqt scaler manager exited","error":"error waiting for CRDs: timeout waiting for CRDs","errorVerbose":"timeout waiting for CRDs\nerror waiting for CRDs\ngithub.com/fission/fission/pkg/mqtrigger.StartScalerManager\n\tpkg/mqtrigger/scalermanager.go:166\nmain.runMQManager\n\tcmd/fission-bundle/main.go:83\nmain.main\n\tcmd/fission-bundle/main.go:302\nruntime.main\n\t/opt/hostedtoolcache/go/1.19.4/x64/src/runtime/proc.go:250\nruntime.goexit\n\t/opt/hostedtoolcache/go/1.19.4/x64/src/runtime/asm_arm64.s:1172","stacktrace":"main.main\n\tcmd/fission-bundle/main.go:304\nruntime.main\n\t/opt/hostedtoolcache/go/1.19.4/x64/src/runtime/proc.go:250"}

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions