Skip to content

CI: Travis: Test/EndpointManagerSuite/TestLookup fails due to unexpected endpoint #28878

@joestringer

Description

@joestringer

Failure:
https://app.travis-ci.com/github/cilium/cilium/builds/266927007

The endpointmanager has a test at the start of TestLookup which ensures that endpoint 1234 doesn't exist. It's the first test in the set of lookup tests. It appears to be flaky, sometimes failing since it actually finds an endpoint unexpectedly.

Unclear whether this is newly introduced by recent endpointmanager changes, or simply a rare case of leftover state from running another test.

┏━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┓
┃   FAIL  package: github.com/cilium/cilium/pkg/endpointmanager   ┃
┗━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━┛
--- FAIL: Test (0.11s)
--- FAIL: Test/EndpointManagerSuite (0.11s)
--- FAIL: Test/EndpointManagerSuite/TestLookup (0.00s)
level=info msg="New endpoint" ciliumEndpointName=/ containerID= containerInterface= datapathPolicyRevision=0 desiredPolicyRevision=0 endpointID=1234 ipv4= ipv6= k8sPodName=/ subsys=endpoint
    manager_test.go:439: 
        ... value *endpoint.Endpoint = &endpoint.Endpoint{owner:(*endpointmanager.EndpointManagerSuite)(0x400011d1b0), policyGetter:(*endpointmanager.EndpointManagerSuite)(0x400011d1b0), namedPortsGetter:(*testipcache.MockIPCache)(0x3ab01e0), ID:0x4d2, createdAt:time.Time{wall:0xc1481d374e0726c5, ext:29863870, loc:(*time.Location)(0x3a79920)}, mutex:lock.RWMutex{internalRWMutex:lock.internalRWMutex{RWMutex:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:atomic.Int32{_:atomic.noCopy{}, v:0}, readerWait:atomic.Int32{_:atomic.noCopy{}, v:0}}}}, containerName:atomic.Pointer[string]{_:[0]*string{}, _:atomic.noCopy{}, v:(unsafe.Pointer)(nil)}, containerID:atomic.Pointer[string]{_:[0]*string{}, _:atomic.noCopy{}, v:(unsafe.Pointer)(nil)}, dockerNetworkID:"", dockerEndpointID:"", ifName:"", ifIndex:0, containerIfName:"", disableLegacyIdentifiers:false, OpLabels:labels.OpLabels{Custom:labels.Labels{}, OrchestrationIdentity:labels.Labels{}, Disabled:labels.Labels{}, OrchestrationInfo:labels.Labels{}}, identityRevision:0, bps:0x0, mac:mac.MAC(nil), IPv6:netip.Addr{addr:netip.uint128{hi:0x0, lo:0x0}, z:(*intern.Value)(nil)}, IPv6IPAMPool:"", IPv4:netip.Addr{addr:netip.uint128{hi:0x0, lo:0x0}, z:(*intern.Value)(nil)}, IPv4IPAMPool:"", nodeMAC:mac.MAC(nil), SecurityIdentity:(*identity.Identity)(nil), hasSidecarProxy:false, policyMap:(*policymap.PolicyMap)(nil), PolicyMapPressureUpdater:(*endpointmanager.policyMapPressure)(0x4000400318), Options:(*option.IntOptions)(0x40000e59b0), status:(*endpoint.EndpointStatus)(0x40000d4240), DNSRules:restore.DNSRules(nil), DNSHistory:(*fqdn.DNSCache)(0x40005f1e00), DNSZombies:(*fqdn.DNSZombieMappings)(0x40000d4200), dnsHistoryTrigger:(*trigger.Trigger)(0x400029e1e0), state:"", bpfHeaderfileHash:"", K8sPodName:"", K8sNamespace:"", pod:atomic.Pointer[github.com/cilium/cilium/pkg/k8s/slim/k8s/api/core/v1.Pod]{_:[0]*v1.Pod{}, _:atomic.noCopy{}, v:(unsafe.Pointer)(nil)}, k8sPorts:atomic.Pointer[github.com/cilium/cilium/pkg/types.NamedPortMap]{_:[0]*types.NamedPortMap{}, _:atomic.noCopy{}, v:(unsafe.Pointer)(nil)}, logLimiter:logging.Limiter{bucket:(*rate.Limiter)(0x40005f4050)}, policyRevision:0x0, policyRevisionSignals:map[*endpoint.policySignal]bool(nil), proxyPolicyRevision:0x0, proxyStatisticsMutex:lock.RWMutex{internalRWMutex:lock.internalRWMutex{RWMutex:sync.RWMutex{w:sync.Mutex{state:0, sema:0x0}, writerSem:0x0, readerSem:0x0, readerCount:atomic.Int32{_:atomic.noCopy{}, v:0}, readerWait:atomic.Int32{_:atomic.noCopy{}, v:0}}}}, proxy:(*endpoint.FakeEndpointProxy)(0x3ab01e0), proxyStatistics:map[string]*models.ProxyStatistics(nil), nextPolicyRevision:0x0, forcePolicyCompute:false, buildMutex:lock.Mutex{internalMutex:lock.internalMutex{Mutex:sync.Mutex{state:0, sema:0x0}}}, logger:atomic.Pointer[github.com/sirupsen/logrus.Entry]{_:[0]*logrus.Entry{}, _:atomic.noCopy{}, v:(unsafe.Pointer)(0x400054c1c0)}, policyLogger:atomic.Pointer[github.com/sirupsen/logrus.Entry]{_:[0]*logrus.Entry{}, _:atomic.noCopy{}, v:(unsafe.Pointer)(nil)}, controllers:(*controller.Manager)(0x40005988c0), realizedRedirects:map[string]uint16(nil), ctCleaned:false, hasBPFProgram:(chan struct {})(0x4000103140), selectorPolicy:policy.SelectorPolicy(nil), desiredPolicy:(*policy.EndpointPolicy)(0x40005f4000), realizedPolicy:(*policy.EndpointPolicy)(0x40005f4000), visibilityPolicy:(*policy.VisibilityPolicy)(nil), eventQueue:(*eventqueue.EventQueue)(0x40001e5440), skippedRegenerationLevel:0, DatapathConfiguration:models.EndpointDatapathConfiguration{DisableSipVerification:false, ExternalIpam:false, InstallEndpointRoute:false, RequireArpPassthrough:false, RequireEgressProg:false, RequireRouting:(*bool)(nil)}, aliveCtx:(*context.cancelCtx)(0x40005f40a0), aliveCancel:(context.CancelFunc)(0x17b280), regenFailedChan:(chan struct {})(0x40001031a0), allocator:(*testidentity.MockIdentityAllocator)(0x40000e5620), isIngress:false, isHost:false, noTrackPort:0x0, ciliumEndpointUID:"", reporterScope:cell.Scope(nil), closeHealthReporter:(func())(nil)} ("{\n  \"ID\": 1234,\n  \"ContainerName\": \"\",\n  \"DockerNetworkID\": \"\",\n  \"DockerEndpointID\": \"\",\n  \"IfName\": \"\",\n  \"IfIndex\": 0,\n  \"ContainerIfName\": \"\",\n  \"DisableLegacyIdentifiers\": false,\n  \"OpLabels\": {\n    \"Custom\": {},\n    \"OrchestrationIdentity\": {},\n    \"Disabled\": {},\n    \"OrchestrationInfo\": {}\n  },\n  \"LXCMAC\": \"\",\n  \"IPv6\": \"\",\n  \"IPv6IPAMPool\": \"\",\n  \"IPv4\": \"\",\n  \"IPv4IPAMPool\": \"\",\n  \"NodeMAC\": \"\",\n  \"SecLabel\": null,\n  \"Options\": {\n    \"map\": {\n      \"ConntrackAccounting\": 0,\n      \"ConntrackLocal\": 0,\n      \"Debug\": 0,\n      \"DebugLB\": 0,\n      \"DebugPolicy\": 0,\n      \"DropNotification\": 0,\n      \"MonitorAggregationLevel\": 0,\n      \"PolicyAuditMode\": 0,\n      \"PolicyVerdictNotification\": 0,\n      \"SourceIPVerification\": 0,\n      \"TraceNotification\": 0\n    }\n  },\n  \"DNSRules\": null,\n  \"DNSHistory\": [],\n  \"DNSZombies\": {},\n  \"K8sPodName\": \"\",\n  \"K8sNamespace\": \"\",\n  \"DatapathConfiguration\": {},\n  \"CiliumEndpointUID\": \"\"\n}")
        ... Test Name: endpoint does not exist

Metadata

Metadata

Assignees

Labels

area/CIContinuous Integration testing issue or flakeci/flakeThis is a known failure that occurs in the tree. Please investigate me!staleThe stale bot thinks this issue is old. Add "pinned" label to prevent this from becoming stale.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions