Use this for tracking changes related to performance improvements.  Due to the daily volume of CI/CD workload, efficiencies should be leveraged wherever possible. It would be helpful to record runtimes along with the changes.  

 The profiler currently shows that for the 864 tests run, functions that return a constant value for a given test are being called 170MM times:

0 attempt(s) left.

         2922499709 function calls (2922480416 primitive calls) in 3223.935 seconds

 

   Ordered by: cumulative time

 

   ncalls  tottime  percall  cumtime  percall filename:lineno(function)

        1    0.062    0.062 3223.966 3223.966 run_tests.py:3(<module>)

        1  486.651  486.651 3219.660 3219.660 run_tests.py:303(run_forked)

169489479  215.480    0.000 2080.132    0.000 util.py:81(is_core_present)

169489485  126.281    0.000 1385.812    0.000 util.py:77(get_core_path)

169489485  384.613    0.000 1259.532    0.000 util.py:85(get_core_pattern)

169489502  525.570    0.000  525.570    0.000 {open}

169489801  224.983    0.000  478.903    0.000 genericpath.py:34(isfile)

173987298  160.686    0.000  405.958    0.000 process.py:149(is_alive)

169489490  323.515    0.000  323.515    0.000 {method 'read' of 'file' objects}

169490190  254.042    0.000  254.042    0.000 {posix.stat}

173987638  115.670    0.000  234.892    0.000 forking.py:131(poll)

521965115  187.903    0.000  187.903    0.000 {method 'poll' of '_multiprocessing.Connection' objects}

173987640  119.222    0.000  119.222    0.000 {posix.waitpid}

173991220   28.415    0.000   28.415    0.000 {time.time}

169490910   25.898    0.000   25.898    0.000 {method 'strip' of 'str' objects}

173987986   20.264    0.000   20.264    0.000 {posix.getpid}

174028974/174028057   18.149    0.000   18.150    0.000 {len}

      169    0.003    0.000    9.894    0.059 process.py:139(join)

      169    0.001    0.000    9.891    0.059 forking.py:152(wait)

      168    0.058    0.000    2.244    0.013 run_tests.py:136(_init_)