Uploaded image for project: 'vpp'
  1. vpp
  2. VPP-1394

VPP crash on ARM64 (Cavium ThunderX)

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Done
    • Icon: Low Low
    • 18.01
    • None
    • None
    • This VPP instance run in container.

      kernel 4.15.0-20-generic

       

      Ubuntu 18.04.1 LTS, kernel  4.15.0-20-generic aarch64

      NIC: Cavium ThunderX - probably CN8xxxx (cf. https://doc.dpdk.org/guides/nics/thunderx.html)

       

      stanislav@vppagent:~$ grep NUMA=y /boot/config-`uname -r`
      CONFIG_NUMA=y
      CONFIG_OF_NUMA=y
      CONFIG_ACPI_NUMA=y
      stanislav@vppagent:~$ numactl --hardware
      available: 2 nodes (0-1)
      node 0 cpus: 0 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47
      node 0 size: 64395 MB
      node 0 free: 31516 MB
      node 1 cpus: 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95
      node 1 size: 64475 MB
      node 1 free: 45274 MB
      node distances:
      node 0 1
      0: 10 20
      1: 20 10

       

       

      VPP version 18.01-rc0~1623-gc21f24e_arm64

      (used packages are: vpp-api-lua_18.01-rc0~1623-gc21f24e_arm64.deb vpp-dbg_18.01-rc0~1623-gc21f24e_arm64.deb vpp-lib_18.01-rc0~1623-gc21f24e_arm64.deb vpp_18.01-rc0~1623-gc21f24e_arm64.deb
      vpp-api-python_18.01-rc0~1623-gc21f24e_arm64.deb vpp-dev_18.01-rc0~1623-gc21f24e_arm64.deb vpp-plugins_18.01-rc0~1623-gc21f24e_arm64.deb)

      Backtrace:

      (gdb) bt
      #0 0x0000ffff98b15528 in __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:54 
      #1 0x0000ffff98b169e0 in __GI_abort () at abort.c:89 
      #2 0x0000aaaac0b4e8a0 in os_exit (code=code@entry=1) at /opt/vpp-agent/dev/vpp/build-data/../src/vpp/vnet/main.c:355 
      #3 0x0000ffff991d7e4c in unix_signal_handler (signum=<optimized out>, si=<optimized out>, uc=<optimized out>) at /opt/vpp-agent/dev/vpp/build-data/../src/vlib/unix/main.c:157 
      #4 <signal handler called> 
      #5 mheap_next_elt (e=<optimized out>) at /opt/vpp-agent/dev/vpp/build-data/../src/vppinfra/mheap_bootstrap.h:333 
      #6 mheap_put (v=0xffff5892b000, uoffset=18446462601541799932) at /opt/vpp-agent/dev/vpp/build-data/../src/vppinfra/mheap.c:793 
      #7 0x0000ffff99086da4 in adj_glean_add_or_lock (proto=<optimized out>, linkt=<optimized out>, sw_if_index=0, nh_addr=nh_addr@entry=0x0) at /opt/vpp-agent/dev/vpp/build-data/../src/vnet/adj/adj_glean.c:84 
      #8 0x0000ffff99080708 in fib_path_attached_get_adj (link=<optimized out>, path=<optimized out>, path=<optimized out>) at /opt/vpp-agent/dev/vpp/build-data/../src/vnet/fib/fib_path.c:709 
      #9 0x0000ffff99082314 in fib_path_resolve (path_index=32) at /opt/vpp-agent/dev/vpp/build-data/../src/vnet/fib/fib_path.c:1864 
      #10 0x0000ffff9907df4c in fib_path_list_resolve (path_list=path_list@entry=0xffff59b1ec98) at /opt/vpp-agent/dev/vpp/build-data/../src/vnet/fib/fib_path_list.c:558 
      #11 0x0000ffff9907e8d0 in fib_path_list_create (flags=<optimized out>, flags@entry=FIB_PATH_LIST_FLAG_SHARED, rpaths=rpaths@entry=0xffff5978b270) at /opt/vpp-agent/dev/vpp/build-data/../src/vnet/fib/fib_path_list.c:716 
      #12 0x0000ffff9907c8e8 in fib_entry_src_api_path_swap (src=0xffff59803ca8, entry=<optimized out>, pl_flags=FIB_PATH_LIST_FLAG_NONE, rpaths=0xffff5978b270) at /opt/vpp-agent/dev/vpp/build-data/../src/vnet/fib/fib_entry_src_api.c:47 
      #13 0x0000ffff9907ad64 in fib_entry_src_action_path_swap (fib_entry=0xffff59786958, source=source@entry=FIB_SOURCE_API, flags=flags@entry=FIB_ENTRY_FLAG_NONE, rpaths=rpaths@entry=0xffff5978b270) at /opt/vpp-agent/dev/vpp/build-data/../src/vnet/fib/fib_entry_src.c:1643 
      #14 0x0000ffff99078af0 in fib_entry_create (fib_index=fib_index@entry=1, prefix=prefix@entry=0xffff595f6e00, source=source@entry=FIB_SOURCE_API, flags=flags@entry=FIB_ENTRY_FLAG_NONE, paths=paths@entry=0xffff5978b270) at /opt/vpp-agent/dev/vpp/build-data/../src/vnet/fib/fib_entry.c:710 
      #15 0x0000ffff99071b00 in fib_table_entry_path_add2 (fib_index=1, fib_index@entry=203, prefix=prefix@entry=0xffff595f6e00, source=source@entry=FIB_SOURCE_API, flags=flags@entry=FIB_ENTRY_FLAG_NONE, rpath=0xffff5978b270, rpath@entry=0x1000000) at /opt/vpp-agent/dev/vpp/build-data/../src/vnet/fib/fib_table.c:576 
      #16 0x0000ffff98ebc254 in add_del_route_t_handler (is_multipath=<optimized out>, is_add=<optimized out>, is_drop=<optimized out>, is_unreach=<optimized out>, is_prohibit=<optimized out>, is_local=<optimized out>, is_multicast=is_multicast@entry=0 '\000', is_classify=<optimized out>, classify_table_index=0, is_resolve_host=0 '\000', is_resolve_attached=0 '\000', is_interface_rx=is_interface_rx@entry=0 '\000', is_rpf_id=is_rpf_id@entry=0 '\000', is_dvr=<optimized out>, is_source_lookup=0 '\000', is_udp_encap=<optimized out>, fib_index=<optimized out>, prefix=<optimized out>, next_hop_proto=<optimized out>, next_hop=<optimized out>, next_hop_id=<optimized out>, next_hop_sw_if_index=0, next_hop_fib_index=8 '\b', next_hop_weight=0, next_hop_preference=0, next_hop_via_label=0, next_hop_out_label_stack=0x0) at /opt/vpp-agent/dev/vpp/build-data/../src/vnet/ip/ip_api.c:850 
      #17 0x0000ffff98ebc87c in ip4_add_del_route_t_handler (mp=<optimized out>) at /opt/vpp-agent/dev/vpp/build-data/../src/vnet/ip/ip_api.c:1032 
      #18 vl_api_ip_add_del_route_t_handler (mp=0x3ffff80a02cc) at /opt/vpp-agent/dev/vpp/build-data/../src/vnet/ip/ip_api.c:1136 
      #19 0x0000ffff991ffd1c in vl_msg_api_handler_with_vm_node (am=am@entry=0xffff99224008 <api_main>, the_msg=0x3ffff80a02cc, vm=vm@entry=0xffff991f7d00 <vlib_global_main>, node=node@entry=0xffff595ee000) at /opt/vpp-agent/dev/vpp/build-data/../src/vlibapi/api_shared.c:508 
      #20 0x0000ffff9920670c in void_mem_api_handle_msg_i (am=<optimized out>, q=<optimized out>, node=0xffff595ee000, vm=0xffff991f7d00 <vlib_global_main>) at /opt/vpp-agent/dev/vpp/build-data/../src/vlibmemory/memory_api.c:687 
      #21 vl_mem_api_handle_msg_main (vm=vm@entry=0xffff991f7d00 <vlib_global_main>, node=node@entry=0xffff595ee000) at /opt/vpp-agent/dev/vpp/build-data/../src/vlibmemory/memory_api.c:697 
      #22 0x0000ffff9920d58c in vl_api_clnt_process (vm=<optimized out>, node=<optimized out>, f=<optimized out>) at /opt/vpp-agent/dev/vpp/build-data/../src/vlibmemory/vlib_api.c:349 
      #23 0x0000ffff991af920 in vlib_process_bootstrap (_a=<optimized out>) at /opt/vpp-agent/dev/vpp/build-data/../src/vlib/main.c:1231 
      #24 0x0000ffff98c8c130 in clib_calljmp () at /opt/vpp-agent/dev/vpp/build-data/../src/vppinfra/longjmp.S:676 
      Backtrace stopped: previous frame identical to this frame (corrupt stack?)
      

       

       

            Unassigned Unassigned
            stanislav-chlebec Stanislav Chlebec
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

              Created:
              Updated:
              Resolved: