Uploaded image for project: 'csit'
  1. csit
  2. CSIT-1962

3n-icx, 3na-spr: Udpquicscale tests sometimes fail with various symptoms

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Unresolved
    • Icon: Medium Medium
    • None
    • None
    • None

      While this has to point to a VPP bug, that bug is probably older.
      The behavior was uncovered when CSIT converted the suite to do RX on both workers (on sibling lcores of the same physical CPU code).
      Also, that [0] change has decreased the performance, but that performance was already invisible in trending due to CSIT-1935.

      Among the symptoms, I have seen client not responding [1], server (deferred) failure [2], and even VPP crashes. Usually a crash does not create a core, but once [3] it did (an assert in quicly, but looks time-related, so no direct bug).

      [0] 40977: fix(hoststack): Do not limit number of RX queues | https://gerrit.fd.io/r/c/csit/+/40977
      [1] https://s3-logs.fd.io/vex-yul-rot-jenkins-1/csit-vpp-perf-report-iterative-2406-3n-icx/98/log.html.gz#s1-s1-s1-s1-s5-t1-k2-k4-k14
      [2] https://s3-logs.fd.io/vex-yul-rot-jenkins-1/csit-vpp-perf-report-iterative-2406-3n-icx/102/log.html.gz#s1-s1-s1-s1-s13-t1-k2-k4-k18
      [3] https://s3-logs.fd.io/vex-yul-rot-jenkins-1/csit-vpp-perf-report-iterative-2406-3n-icx/110/log.html.gz#s1-s1-s1-s1-s7-t1-k3-k4-k1

            vrpolak Vratko Polak
            vrpolak Vratko Polak
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated: