Uploaded image for project: 'vpp'
  1. vpp
  2. VPP-1497

Parallel test execution produces failures on ARM in master

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Cannot Reproduce
    • Icon: Highest Highest
    • None
    • None
    • None
    • None

      HOW TO REPRODUCE: run make test-debug TEST_JOBS=4

      The regular (non-parallel) run results in few reproducible failures. Parallel test run produces a much higher number of failures.

      Most failures result in a core dump. The two attached console logs show that there is not much variation between the failures.

      The core dumps are mostly from ACL or Classifier testcases.

      Almost all cores are produced because of the same assert:
      #10 0x0000ffff85401568 in vlib_buffer_advance (b=0xfffb4431f600, l=14) at /home/jlinkes/vpp/src/vlib/buffer.h:238
      238 ASSERT ((b->flags & VLIB_BUFFER_NEXT_PRESENT) == 0 ||
      (gdb) p b->flags
      $1 = 262158

      The flag is not always the same. In TestFIFReassembly, TestIPv4Reassembly, TestMACIP_IP4, TestMACIP_IP6 and TestMACIP it is 393222, otherwise it's 262158.

      The two tests that don't fail because of this assert are TestL2fib and TestL2xc. This failure is documented in https://jira.fd.io/browse/VPP-1476

        1. console_run1.txt
          115 kB
        2. console_run2.txt
          114 kB
        3. core_dumps.txt
          3 kB
        4. gdb.txt
          6 kB

            Unassigned Unassigned
            juraj.linkes Juraj Linkeš
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

              Created:
              Updated:
              Resolved: