Example of first failed run [0] was on Monday, the last good run was on Friday 2023-04-28. Only xxv710 with drv_vfio_pci seems to be unaffected, other NICs and AVF (also for xxv710, failing to create an interface) are affected. All 2n-icx testbeds seem to behave the same so far.

Verify jobs see this happening also with VPP release build, and there were no obviously dangerous merges into CSIT, so this is likely to be an infra issue. It is not clear to me how does hoststack vpp initialization differ from initialization in other vpp perf suites (which are passing).

[0] https://s3-logs.fd.io/vex-yul-rot-jenkins-1/csit-vpp-perf-hoststack-daily-master-2n-icx/51/log.html.gz#s1-s1-s1-s1-s1-t1-k2-k8-k3-k2-k1