Skip to content

ctest reports Failed for tests that actually pass #461

Closed
@milancurcic

Description

@milancurcic
  • OpenCoarrays Version: 1.9.2
  • Fortran Compiler: gfortran-7.2.1
  • C compiler used for building lib: gcc-7.2.1
  • Installation method: From source
  • Output of uname -a: x86_64 GNU/Linux
  • MPI library being used: openmpi-2.0.2-2
  • Machine architecture and number of physical cores: Single VCPU cloud instance of E5-2650 v4
  • Version of CMake: 3.9.1

Observed Behavior

ctest reports:

      Start  1: initialize_mpi
 1/47 Test  #1: initialize_mpi ...................   Passed    0.58 sec
      Start  2: register
 2/47 Test  #2: register .........................   Passed    0.60 sec
      Start  3: register_vector
 3/47 Test  #3: register_vector ..................   Passed    0.61 sec
      Start  4: register_alloc_vector
 4/47 Test  #4: register_alloc_vector ............   Passed    0.64 sec
      Start  5: allocate_as_barrier
 5/47 Test  #5: allocate_as_barrier ..............   Passed    1.66 sec
      Start  6: allocate_as_barrier_proc
 6/47 Test  #6: allocate_as_barrier_proc .........   Passed    1.63 sec
      Start  7: register_alloc_comp_1
 7/47 Test  #7: register_alloc_comp_1 ............   Passed    0.64 sec
      Start  8: register_alloc_comp_2
 8/47 Test  #8: register_alloc_comp_2 ............   Passed    0.64 sec
      Start  9: register_alloc_comp_3
 9/47 Test  #9: register_alloc_comp_3 ............   Passed    0.66 sec
      Start 10: async_comp_alloc
10/47 Test #10: async_comp_alloc .................   Passed    0.68 sec
      Start 11: async_comp_alloc_2
11/47 Test #11: async_comp_alloc_2 ...............   Passed    0.67 sec
      Start 12: comp_allocated_1
12/47 Test #12: comp_allocated_1 .................   Passed    0.72 sec
      Start 13: comp_allocated_2
13/47 Test #13: comp_allocated_2 .................   Passed    0.73 sec
      Start 14: get_array
14/47 Test #14: get_array ........................   Passed  661.22 sec
      Start 15: get_self
15/47 Test #15: get_self .........................   Passed    0.76 sec
      Start 16: send_array
16/47 Test #16: send_array .......................   Passed  661.50 sec
      Start 17: get_with_offset_1d
17/47 Test #17: get_with_offset_1d ...............   Passed    0.65 sec
      Start 18: whole_get_array
18/47 Test #18: whole_get_array ..................   Passed    0.74 sec
      Start 19: strided_get
19/47 Test #19: strided_get ......................   Passed    0.63 sec
      Start 20: strided_sendget
20/47 Test #20: strided_sendget ..................   Passed    0.69 sec
      Start 21: co_sum
21/47 Test #21: co_sum ...........................   Passed    0.60 sec
      Start 22: co_broadcast
22/47 Test #22: co_broadcast .....................   Passed    0.73 sec
      Start 23: co_min
23/47 Test #23: co_min ...........................   Passed    0.60 sec
      Start 24: co_max
24/47 Test #24: co_max ...........................   Passed    0.60 sec
      Start 25: syncall
25/47 Test #25: syncall ..........................   Passed    1.62 sec
      Start 26: syncimages
26/47 Test #26: syncimages .......................   Passed    0.68 sec
      Start 27: syncimages2
27/47 Test #27: syncimages2 ......................   Passed    0.59 sec
      Start 28: duplicate_syncimages
28/47 Test #28: duplicate_syncimages .............   Passed    0.57 sec
      Start 29: co_reduce
29/47 Test #29: co_reduce ........................   Passed    0.59 sec
      Start 30: co_reduce_res_im
30/47 Test #30: co_reduce_res_im .................   Passed    0.64 sec
      Start 31: co_reduce_string
31/47 Test #31: co_reduce_string .................   Passed    0.64 sec
      Start 32: syncimages_status
32/47 Test #32: syncimages_status ................   Passed    0.58 sec
      Start 33: sync_ring_abort_np3
33/47 Test #33: sync_ring_abort_np3 ..............***Failed  Required regular expression not found.Regex=[Test passed.
]  0.57 sec
      Start 34: sync_ring_abort_np7
34/47 Test #34: sync_ring_abort_np7 ..............***Failed  Required regular expression not found.Regex=[Test passed.
]  0.56 sec
      Start 35: simpleatomics
35/47 Test #35: simpleatomics ....................   Passed    0.63 sec
      Start 36: hello_multiverse
36/47 Test #36: hello_multiverse .................   Passed    0.62 sec
      Start 37: coarray_burgers_pde
37/47 Test #37: coarray_burgers_pde ..............   Passed   62.80 sec
      Start 38: co_heat
38/47 Test #38: co_heat ..........................   Passed  239.46 sec
      Start 39: asynchronous_hello_world
39/47 Test #39: asynchronous_hello_world .........   Passed    0.77 sec
      Start 40: source-alloc-no-sync
40/47 Test #40: source-alloc-no-sync .............   Passed    0.62 sec
      Start 41: allocatable_p2p_event_post
41/47 Test #41: allocatable_p2p_event_post .......***Failed  Required regular expression not found.Regex=[Test passed.
]  0.54 sec
      Start 42: static_event_post_issue_293
42/47 Test #42: static_event_post_issue_293 ......***Failed  Required regular expression not found.Regex=[Test passed.
]  0.59 sec
      Start 43: co_reduce-factorial
43/47 Test #43: co_reduce-factorial ..............   Passed    0.63 sec
      Start 44: co_reduce-factorial-int8
44/47 Test #44: co_reduce-factorial-int8 .........   Passed    0.62 sec
      Start 45: co_reduce-factorial-int64
45/47 Test #45: co_reduce-factorial-int64 ........   Passed    0.63 sec
      Start 46: image_status_test_1
46/47 Test #46: image_status_test_1 ..............   Passed    0.58 sec
      Start 47: test-installation-scripts.sh
47/47 Test #47: test-installation-scripts.sh .....   Passed    0.35 sec

91% tests passed, 4 tests failed out of 47

Total Test time (real) = 1655.12 sec

The following tests FAILED:
         33 - sync_ring_abort_np3 (Failed)
         34 - sync_ring_abort_np7 (Failed)
         41 - allocatable_p2p_event_post (Failed)
         42 - static_event_post_issue_293 (Failed)
Errors while running CTest

Another potential issue is the run-time of tests 14 and 16 (11 minutes). I am not sure whether this is expected or not. Ideally unit tests should each be short (O(seconds)).

Expected Behavior

ctest should report that all tests succeeded, because tests 33, 34, 41, 42 actually pass when executed directly with cafrun.

Steps to Reproduce

See above.

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions