Uploaded image for project: 'vpp'
  1. vpp
  2. VPP-1877

vpp crashes during csit perf tests with 10k ipsec interfaces on haswell

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Open
    • Icon: Medium Medium
    • None
    • None
    • IPsec
    • None

      During CSIT tests with vpp 20.05 rc1 and rc2 [0] as well as with vpp 20.09 rc0 [1] we can see vpp crash after starting the traffic in performance ipsec tests with 10k interfaces (tests with 1k ipsec interfaces run without failure) on haswell while these tests run well on skylake.

      VPP version: 20.05-rc2~b13
      sudo -E -S dpkg -l | grep vpp
      ii libvppinfra 20.05-rc2~b13 amd64 Vector Packet Processing--runtime libraries
      ii libvppinfra-dev 20.05-rc2~b13 amd64 Vector Packet Processing--runtime libraries
      ii python3-vpp-api 20.05-rc2~b13 amd64 VPP Python3 API bindings
      ii vpp 20.05-rc2~b13 amd64 Vector Packet Processing--executables
      ii vpp-api-python 20.05-rc2~b13 amd64 VPP Python API bindings
      ii vpp-dbg 20.05-rc2~b13 amd64 Vector Packet Processing--debug symbols
      ii vpp-dev 20.05-rc2~b13 amd64 Vector Packet Processing--development support
      ii vpp-plugin-core 20.05-rc2~b13 amd64 Vector Packet Processing--runtime core plugins
      ii vpp-plugin-dpdk 20.05-rc2~b13 amd64 Vector Packet Processing--runtime dpdk plugin

      Traceback and startup.conf files from test attached.

      [0] https://logs.fd.io/production/vex-yul-rot-jenkins-1/csit-vpp-perf-report-iterative-2005-3n-hsw/2/archives/log.html.gz#s1-s1-s1-s1

      [1] https://logs.fd.io/production/vex-yul-rot-jenkins-1/csit-vpp-perf-mrr-daily-master/1182/archives/log.html.gz#s1-s1-s1-s1

            nranns Neale Ranns
            jgelety Jan Gelety
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: