Uploaded image for project: 'vpp'
  1. vpp
  2. VPP-1491

GBP L3 Endpoint Learning failure on ARM Ubuntu 1804

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Open
    • Icon: High High
    • None
    • None
    • None
    • None
    • Linux fdio-cavium4 4.15.0-38-generic #41-Ubuntu SMP Wed Oct 10 10:59:31 UTC 2018 aarch64 aarch64 aarch64 GNU/Linux
      NAME="Ubuntu"
      VERSION="18.04.1 LTS (Bionic Beaver)"
      gcc version 7.3.0 (Ubuntu/Linaro 7.3.0-27ubuntu1~18.04)

      This is not reproducible with debug build, all tests pass with it.

      At first L2 Endpoint learning was failing, but a few patches (and one new test) later there's a L3 ep failure. Looks like an endpoint is not configured after its config has been deleted:
      05:27:52,081 CLI: show gbp endpoint
      05:27:52,082 Endpoints:
      [@0] ips:[10.0.0.127/32, 2001:10::1/128, ] mac:02:01:00:00:ff:02 last-time:[52]
      control-plane
      pg0 EPG:0
      fwd:
      itf:[pg0 locks:1 input-feats: none configured output-feats: none configured]

      05:27:52,082 API: gbp_endpoint_dump ({})

      Console:
      ==============================================================================
      GBP Test Case
      ==============================================================================
      Group Based Policy OK
      GBP L2 Endpoint Learning OK
      GBP L3 Endpoint Learning FAIL [ temp dir used by test case: /tmp/vpp-unittest-TestGBP-CvZ439 ]
      GBP L2 Endpoint w/ VLANs ERROR [ temp dir used by test case: /tmp/vpp-unittest-TestGBP-CvZ439 ]
      GBP Endpoint Redirect OK

      ==============================================================================
      ERROR: GBP L2 Endpoint w/ VLANs
      ------------------------------------------------------------------------------
      Traceback (most recent call last):
      File "/home/jlinkes/vpp/test/test_gbp.py", line 1822, in test_gbp_learn_vlan_l2
      self.pg2.config_ip4()
      File "/home/jlinkes/vpp/test/vpp_interface.py", line 252, in config_ip4
      self.sw_if_index, self.local_ip4n, self.local_ip4_prefix_len)
      File "/home/jlinkes/vpp/test/vpp_papi_provider.py", line 284, in sw_interface_add_del_address
      'address': addr})
      File "/home/jlinkes/vpp/test/vpp_papi_provider.py", line 185, in api
      raise UnexpectedApiReturnValueError(msg)
      UnexpectedApiReturnValueError: API call failed, expected 0 return value instead of -127 in sw_interface_add_del_address_reply(_0=89, context=1922, retval=-127)

      ==============================================================================
      FAIL: GBP L3 Endpoint Learning
      ------------------------------------------------------------------------------
      Traceback (most recent call last):
      File "/home/jlinkes/vpp/test/test_gbp.py", line 2362, in test_gbp_learn_l3
      self.assertTrue(find_gbp_endpoint(self, ip=rep_2.ip4.address))
      AssertionError: False is not true

      Ran 5 tests in 70.348s

      FAILED (failures=1, errors=1)
      05:27:58,654 Link to the failed test already exists: /tmp/vpp-failed-unittests/vpp-unittest-TestGBP-CvZ439-FAILED -> vpp-unittest-TestGBP-CvZ439

      For reference, the previous failure:

      There are some missing packets in the regular build:
      ==============================================================================
      GBP Test Case
      ==============================================================================
      Group Based Policy OK
      GBP L2 Endpoint Learning ERROR [ temp dir used by test case: /tmp/vpp-unittest-TestGBP-O2JBOn ]
      GBP L3 Endpoint Learning OK
      GBP L2 Endpoint w/ VLANs OK

      ==============================================================================
      ERROR: GBP L2 Endpoint Learning
      ------------------------------------------------------------------------------
      Traceback (most recent call last):
      File "/home/jlinkes/vpp/test/test_gbp.py", line 1538, in test_gbp_learn_l2
      rxs = self.send_and_expect(self.pg0, p * 17, self.pg2)
      File "/home/jlinkes/vpp/test/framework.py", line 948, in send_and_expect
      rx = output.get_capture(len(pkts))
      File "/home/jlinkes/vpp/test/vpp_pg_interface.py", line 242, in get_capture
      raise Exception("No packets captured on %s" % name)
      Exception: No packets captured on pg2

      The first two learning seem to have been successful:
      06:32:26,453 CLI: sh l2fib bd_id 1
      06:32:26,463 Mac-Address BD-Idx If-Idx BSN-ISN Age(min) static filter bvi Interface-Name
      00:00:11:11:11:01 1 27 0/0 no * - - vxlan_gbp_tunnel0
      00:11:22:33:44:55 1 10 0/0 no * - * loop0
      00:00:11:11:11:02 1 27 0/0 no * - - vxlan_gbp_tunnel0
      02:01:00:00:ff:02 1 1 0/0 no * - - pg0
      L2FIB total/learned entries: 4/0 Last scan time: 2.0589e-3sec Learn limit: 4194304

      But the first "Static EP replies to dynamics" fails:
      06:32:26,630 Expecting to capture 17 (based on provided argument) packets on pg2
      06:32:26,631 Waiting for capture file /tmp/vpp-unittest-TestGBP-k2bs4U/pg2_out.pcap to appear, timeout is 1s
      06:32:27,631 Timeout - capture file still nowhere
      06:32:27,632 — addError() TestGBP.test_gbp_learn_l2( GBP L2 Endpoint Learning ) called, err is (<type 'exceptions.Exception'>, Exception('No packets captured on pg2',), <traceback object at 0xffff3c26cef0>)
      06:32:27,636 formatted exception is:
      Traceback (most recent call last):
      File "/usr/lib/python2.7/unittest/case.py", line 329, in run
      testMethod()
      File "/home/jlinkes/vpp/test/test_gbp.py", line 1537, in test_gbp_learn_l2
      rxs = self.send_and_expect(self.pg0, p * 17, self.pg2)
      File "/home/jlinkes/vpp/test/framework.py", line 948, in send_and_expect
      rx = output.get_capture(len(pkts))
      File "/home/jlinkes/vpp/test/vpp_pg_interface.py", line 242, in get_capture
      raise Exception("No packets captured on %s" % name)
      Exception: No packets captured on pg2

        1. console.log
          4 kB
        2. l3_ep_learning_console.txt
          8 kB
        3. l3_ep_learning_TestGBP.tgz
          204 kB
        4. TestGBP.tgz
          150 kB

            Lijian-Zhang Lijian Zhang
            juraj.linkes Juraj Linkeš
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: