Fission Version:
client:
fission/core:
BuildDate: "2024-09-02T07:18:37Z"
GitCommit: cf55fbe
Version: v1.20.4
server:
fission/core:
BuildDate: "2024-09-02T07:18:37Z"
GitCommit: cf55fbe
Version: v1.20.4

Kubectl version

Client Version: v1.26.3
Kustomize Version: v4.5.7
Server Version: v1.28.9

To Reproduce

Current version of fission installed: 1.20.1
New Version Installed : 1.20.4

When upgrading the fission version from 1:20.1->1.20.4

Model creation is working fine on 1.20.1

when updated fto 1.20.4 got the following error in router:-
2024-09-20T08:55:54.824961861Z {"level":"info","ts":"2024-09-20T08:55:54.824Z","caller":"crd/client.go:143","msg":"Checking function CRD access","namespace":"default","timeout":"30s"}
2024-09-20T08:55:55.909738766Z {"level":"info","ts":"2024-09-20T08:55:55.909Z","caller":"router/router.go:217","msg":"starting router","port":8888}
2024-09-20T08:55:55.909893968Z {"level":"info","ts":"2024-09-20T08:55:55.909Z","caller":"httpserver/server.go:22","msg":"starting server","service":"router/metrics","addr":":8080"}
2024-09-20T08:55:55.918949597Z {"level":"info","ts":"2024-09-20T08:55:55.909Z","caller":"httpserver/server.go:22","msg":"starting server","service":"router","addr":":8888"}
2024-09-20T09:36:39.124555051Z 2024/09/20 09:36:39 [DEBUG] POST http://executor.fission/v2/getServiceForFunction
2024-09-20T09:36:51.628764549Z 2024/09/20 09:36:51 [DEBUG] POST http://executor.fission/v2/getServiceForFunction
2024-09-20T09:38:39.112724503Z 2024/09/20 09:38:39 [ERR] POST http://executor.fission/v2/getServiceForFunction request failed: Post "http://executor.fission/v2/getServiceForFunction": context deadline exceeded
2024-09-20T09:38:39.115076240Z {"level":"error","ts":"2024-09-20T09:38:39.112Z","logger":"triggerset.http_trigger_set.e52bbe-http","caller":"router/functionHandler.go:653","msg":"error from GetServiceForFunction","trace_id":"8f8a7ae09bd8195da651597327d857b6","error":"error posting to getting service for function: POST http://executor.fission/v2/getServiceForFunction giving up after 1 attempt(s): context deadline exceeded","errorVerbose":"POST http://executor.fission/v2/getServiceForFunction giving up after 1 attempt(s): context deadline exceeded\nerror posting to getting service for function\ngithub.com/fission/fission/pkg/executor/client.(*client).GetServiceForFunction\n\tpkg/executor/client/client.go:94\ngithub.com/fission/fission/pkg/router.functionHandler.getServiceEntryFromExecutor\n\tpkg/router/functionHandler.go:650\ngithub.com/fission/fission/pkg/router.functionHandler.getServiceEntry\n\tpkg/router/functionHandler.go:674

Executor logs:-

{"level":"info","ts":"2024-09-23T10:38:04.818Z","logger":"generic_pool_manager.generic_pool","caller":"poolmgr/gp.go:113","msg":"creating pool","environment":{"apiVersion":"fission.io/v1","kind":"Environment","namespace":"default","name":"python-env-build-198406-1f04db"}}
{"level":"info","ts":"2024-09-23T10:38:04.818Z","logger":"generic_pool_manager.pool_pod_controller","caller":"poolmgr/poolpodcontroller.go:321","msg":"created pool for the environment","env":"python-env-build-144900-95ee40","namespace":"default"}
{"level":"info","ts":"2024-09-23T10:38:05.122Z","logger":"generic_pool_manager.generic_pool","caller":"poolmgr/gp_deployment.go:233","msg":"deployment created","deployment":"poolmgr-python-env-build-1-default-538367009","ns":"fission-function","environment":{"apiVersion":"fission.io/v1","kind":"Environment","namespace":"default","name":"python-env-build-198406-1f04db"}}
{"level":"info","ts":"2024-09-23T10:38:05.122Z","logger":"generic_pool_manager.generic_pool","caller":"poolmgr/readyPodController.go:49","msg":"readyPod controller started","env":"python-env-build-198406-1f04db","envID":"56436248-9065-443c-9162-a5f8e19e6e42"}
{"level":"info","ts":"2024-09-23T10:38:05.122Z","logger":"generic_pool_manager.generic_pool","caller":"poolmgr/gp.go:113","msg":"creating pool","environment":{"apiVersion":"fission.io/v1","kind":"Environment","namespace":"default","name":"python-env-build-215465-0b9da2"}}
{"level":"info","ts":"2024-09-23T10:38:05.122Z","logger":"generic_pool_manager.pool_pod_controller","caller":"poolmgr/poolpodcontroller.go:321","msg":"created pool for the environment","env":"python-env-build-198406-1f04db","namespace":"default"}
{"level":"info","ts":"2024-09-23T10:38:05.420Z","caller":"httpserver/server.go:22","msg":"starting server","service":"executor/metrics","addr":":8080"}
{"level":"info","ts":"2024-09-23T10:38:05.421Z","logger":"executor","caller":"httpserver/server.go:22","msg":"starting server","service":"executor","addr":":8888"}
{"level":"info","ts":"2024-09-23T10:38:05.422Z","logger":"generic_pool_manager.generic_pool","caller":"poolmgr/gp_deployment.go:233","msg":"deployment created","deployment":"poolmgr-python-env-build-2-default-535606343","ns":"fission-function","environment":{"apiVersion":"fission.io/v1","kind":"Environment","namespace":"default","name":"python-env-build-215465-0b9da2"}}
{"level":"info","ts":"2024-09-23T10:38:05.422Z","logger":"generic_pool_manager.generic_pool","caller":"poolmgr/readyPodController.go:49","msg":"readyPod controller started","env":"python-env-build-215465-0b9da2","envID":"af92bce6-a5e2-46f7-854f-db823daf830f"}
{"level":"info","ts":"2024-09-23T10:38:05.422Z","logger":"generic_pool_manager.generic_pool","caller":"poolmgr/gp.go:113","msg":"creating pool","environment":{"apiVersion":"fission.io/v1","kind":"Environment","namespace":"default","name":"python-env-build-143593-97cd15"}}
{"level":"info","ts":"2024-09-23T10:38:05.422Z","logger":"generic_pool_manager.pool_pod_controller","caller":"poolmgr/poolpodcontroller.go:321","msg":"created pool for the environment","env":"python-env-build-215465-0b9da2","namespace":"default"}
{"level":"info","ts":"2024-09-23T10:38:05.728Z","logger":"generic_pool_manager.generic_pool","caller":"poolmgr/gp_deployment.go:233","msg":"deployment created","deployment":"poolmgr-python-env-build-1-default-563658646","ns":"fission-function","environment":{"apiVersion":"fission.io/v1","kind":"Environment","namespace":"default","name":"python-env-build-143593-97cd15"}}
{"level":"info","ts":"2024-09-23T10:38:05.728Z","logger":"generic_pool_manager.generic_pool","caller":"poolmgr/readyPodController.go:49","msg":"readyPod controller started","env":"python-env-build-143593-97cd15","envID":"4195575e-55e1-43ca-ba96-6b0150903ff9"}
{"level":"info","ts":"2024-09-23T10:38:05.728Z","logger":"generic_pool_manager.pool_pod_controller","caller":"poolmgr/poolpodcontroller.go:321","msg":"created pool for the environment","env":"python-env-build-143593-97cd15","namespace":"default"}