NVStore tests are unstable with GCC. #7362

ashok-rao · 2018-06-28T10:25:32Z

Description

When running only the "mbed-os-features-nvstore-tests-nvstore-functionality" test, it seems to pass but when running ALL the compiled tests for a platform it fails. Using GCC.

Steps to reproduce:
mbed test --run -t GCC_ARM -m DISCO_L496AG -n mbed-os-features-nvstore-tests-nvstore-functionality

Result:

C:\Ashok\blinky\mbed-os-example-blinky>mbed test --run -t GCC_ARM -m DISCO_L496AG -n  mbed-os-features-nvstore-tests-nvstore-functionality
mbedgt: greentea test automation tool ver. 1.3.2
mbedgt: test specification file 'C:\Ashok\blinky\mbed-os-example-blinky\BUILD\tests\DISCO_L496AG\GCC_ARM\test_spec.json' (specified with --test-spec option)
mbedgt: using 'C:\Ashok\blinky\mbed-os-example-blinky\BUILD\tests\DISCO_L496AG\GCC_ARM\test_spec.json' from current directory!
mbedgt: detecting connected mbed-enabled devices...
[1529599133.02][mbedls.platform_database]Duplicate platform ids found: daplink.8081, ignoring the definitions from C:\Users\ashrao01\AppData\Local\mbedls\mbedls\platforms.json
[1529599133.02][mbedls.lstools_base]Call to deprecated function list_mbeds_ext. Functionality has been moved into 'list_mbeds'. Please use list_mbeds with 'unique_names=True' and 'read_details_txt=True'
mbedgt: detected 1 device
mbedgt: processing target 'DISCO_L496AG' toolchain 'GCC_ARM' compatible platforms... (note: switch set to --parallel 1)
mbedgt: test case filter (specified with -n option)
        test filtered in 'mbed-os-features-nvstore-tests-nvstore-functionality'
mbedgt: running 1 test for platform 'DISCO_L496AG' and toolchain 'GCC_ARM'
mbedgt: mbed-host-test-runner: started
mbedgt: checking for GCOV data...
mbedgt: test on hardware with target id: 08220221773465344870FC2B
mbedgt: test suite 'mbed-os-features-nvstore-tests-nvstore-functionality' ............................ TIMEOUT in 133.01 sec
        test case: 'NVStore: Basic functionality' .................................................... OK in 0.33 sec
        test case: 'NVStore: Multiple thread test' ................................................... ERROR in 0.00 sec
        test case: 'NVStore: Race test' .............................................................. OK in 0.25 sec
mbedgt: all tests finished!
mbedgt: shuffle seed: 0.2056128115
mbedgt: test suite report:
+----------------------+---------------+------------------------------------------------------+---------+--------------------+-------------+
| target               | platform_name | test suite                                           | result  | elapsed_time (sec) | copy_method |
+----------------------+---------------+------------------------------------------------------+---------+--------------------+-------------+
| DISCO_L496AG-GCC_ARM | DISCO_L496AG  | mbed-os-features-nvstore-tests-nvstore-functionality | TIMEOUT | 133.01             | default     |
+----------------------+---------------+------------------------------------------------------+---------+--------------------+-------------+
mbedgt: test suite results: 1 TIMEOUT
mbedgt: test case report:
+----------------------+---------------+------------------------------------------------------+-------------------------------+--------+--------+--------+--------------------+
| target               | platform_name | test suite                                           | test case                     | passed | failed | result | elapsed_time (sec) |
+----------------------+---------------+------------------------------------------------------+-------------------------------+--------+--------+--------+--------------------+
| DISCO_L496AG-GCC_ARM | DISCO_L496AG  | mbed-os-features-nvstore-tests-nvstore-functionality | NVStore: Basic functionality  | 1      | 0      | OK     | 0.33               |
| DISCO_L496AG-GCC_ARM | DISCO_L496AG  | mbed-os-features-nvstore-tests-nvstore-functionality | NVStore: Multiple thread test | 0      | 0      | ERROR  | 0.0                |
| DISCO_L496AG-GCC_ARM | DISCO_L496AG  | mbed-os-features-nvstore-tests-nvstore-functionality | NVStore: Race test            | 1      | 0      | OK     | 0.25               |
+----------------------+---------------+------------------------------------------------------+-------------------------------+--------+--------+--------+--------------------+
mbedgt: test case results: 2 OK / 1 ERROR
mbedgt: completed in 135.49 sec
mbedgt: exited with code 1
[mbed] ERROR: "mbedgt" returned error code 1.
[mbed] ERROR: Command "mbedgt --test-spec C:\Ashok\blinky\mbed-os-example-blinky\BUILD\tests\DISCO_L496AG\GCC_ARM\test_spec.json -n mbed-os-features-nvstore-tests-nvstore-functionality" in "C:\Ashok\blinky\mbed-os-example-blinky"

Issue request type

[ ] Question
[ ] Enhancement
[x] Bug

@dannybenor . Could you please have a look? Do you need any further logs/info etc? Thanks.

The text was updated successfully, but these errors were encountered:

dannybenor · 2018-06-28T10:37:07Z

@davidsaada Can you look at this?

davidsaada · 2018-06-28T10:48:55Z

There's a good chance PR #7127 fixes this issue. I would test this myself, but couldn't find this board in any of our CI sites.

ciarmcom · 2018-06-28T11:51:40Z

ARM Internal Ref: MBOTRIAGE-962

0xc0170 · 2018-06-29T06:52:00Z

There's a good chance PR #7127 fixes this issue. I would test this myself, but couldn't find this board in any of our CI sites.

@ashok-rao Can you run the test with the fix?

ashok-rao · 2018-06-29T09:33:35Z

Can confirm that #7127 fixes the issue. Here are my logs:

Before:

C:\Ashok\blinky\mbed-os-example-blinky>mbed test --run -t GCC_ARM -m DISCO_L496AG -n mbed-os-features-nvstore-tests-nvstore-functionality
mbedgt: greentea test automation tool ver. 1.3.2
mbedgt: test specification file 'C:\Ashok\blinky\mbed-os-example-blinky\BUILD\tests\DISCO_L496AG\GCC_ARM\test_spec.json' (specified with --test-spec option)
mbedgt: using 'C:\Ashok\blinky\mbed-os-example-blinky\BUILD\tests\DISCO_L496AG\GCC_ARM\test_spec.json' from current directory!
mbedgt: detecting connected mbed-enabled devices...
[1530263888.14][mbedls.platform_database]Duplicate platform ids found: daplink.8081, ignoring the definitions from C:\Users\ashrao01\AppData\Local\mbedls\mbedls\platforms.json
[1530263888.14][mbedls.lstools_base]Call to deprecated function list_mbeds_ext. Functionality has been moved into 'list_mbeds'. Please use list_mbeds with 'unique_names=True' and 'read_details_txt=True'
mbedgt: detected 1 device
mbedgt: processing target 'DISCO_L496AG' toolchain 'GCC_ARM' compatible platforms... (note: switch set to --parallel 1)
mbedgt: test case filter (specified with -n option)
        test filtered in 'mbed-os-features-nvstore-tests-nvstore-functionality'
mbedgt: running 1 test for platform 'DISCO_L496AG' and toolchain 'GCC_ARM'
mbedgt: mbed-host-test-runner: started
mbedgt: checking for GCOV data...
mbedgt: test on hardware with target id: 08220221773465344870FC2B
mbedgt: test suite 'mbed-os-features-nvstore-tests-nvstore-functionality' ............................ TIMEOUT in 133.24 sec
        test case: 'NVStore: Basic functionality' .................................................... OK in 0.33 sec
        test case: 'NVStore: Multiple thread test' ................................................... ERROR in 0.00 sec
        test case: 'NVStore: Race test' .............................................................. OK in 0.25 sec
mbedgt: all tests finished!
mbedgt: shuffle seed: 0.4993993807
mbedgt: test suite report:
+----------------------+---------------+------------------------------------------------------+---------+--------------------+-------------+
| target               | platform_name | test suite                                           | result  | elapsed_time (sec) | copy_method |
+----------------------+---------------+------------------------------------------------------+---------+--------------------+-------------+
| DISCO_L496AG-GCC_ARM | DISCO_L496AG  | mbed-os-features-nvstore-tests-nvstore-functionality | TIMEOUT | 133.24             | default     |
+----------------------+---------------+------------------------------------------------------+---------+--------------------+-------------+
mbedgt: test suite results: 1 TIMEOUT
mbedgt: test case report:
+----------------------+---------------+------------------------------------------------------+-------------------------------+--------+--------+--------+--------------------+
| target               | platform_name | test suite                                           | test case                     | passed | failed | result | elapsed_time (sec) |
+----------------------+---------------+------------------------------------------------------+-------------------------------+--------+--------+--------+--------------------+
| DISCO_L496AG-GCC_ARM | DISCO_L496AG  | mbed-os-features-nvstore-tests-nvstore-functionality | NVStore: Basic functionality  | 1      | 0      | OK     | 0.33               |
| DISCO_L496AG-GCC_ARM | DISCO_L496AG  | mbed-os-features-nvstore-tests-nvstore-functionality | NVStore: Multiple thread test | 0      | 0      | ERROR  | 0.0                |
| DISCO_L496AG-GCC_ARM | DISCO_L496AG  | mbed-os-features-nvstore-tests-nvstore-functionality | NVStore: Race test            | 1      | 0      | OK     | 0.25               |
+----------------------+---------------+------------------------------------------------------+-------------------------------+--------+--------+--------+--------------------+
mbedgt: test case results: 2 OK / 1 ERROR
mbedgt: completed in 139.87 sec
mbedgt: exited with code 1
[mbed] ERROR: "mbedgt" returned error code 1.
[mbed] ERROR: Command "mbedgt --test-spec C:\Ashok\blinky\mbed-os-example-blinky\BUILD\tests\DISCO_L496AG\GCC_ARM\test_spec.json -n mbed-os-features-nvstore-tests-nvstore-functionality" in "C:\Ashok\blinky\mbed-os-example-blinky"
---

C:\Ashok\blinky\mbed-os-example-blinky>

After:

C:\Ashok\blinky\mbed-os-example-blinky\mbed-os>git fetch origin pull/7127/head:pr-7127
remote: Counting objects: 8, done.
remote: Total 8 (delta 3), reused 3 (delta 3), pack-reused 5
Unpacking objects: 100% (8/8), done.
From https://github.com/ARMmbed/mbed-os
 * [new ref]             refs/pull/7127/head -> pr-7127

C:\Ashok\blinky\mbed-os-example-blinky\mbed-os>git checkout pr-7127
Checking out files: 100% (1267/1267), done.
Switched to branch 'pr-7127'

C:\Ashok\blinky\mbed-os-example-blinky>mbed test --compile -t GCC_ARM -m DISCO_L496AG -n mbed-os-features-nvstore-tests-nvstore-functionality
<snip>

Build successes:
  * DISCO_L496AG::GCC_ARM::MBED-BUILD
  * DISCO_L496AG::GCC_ARM::MBED-OS-FEATURES-NVSTORE-TESTS-NVSTORE-FUNCTIONALITY

C:\Ashok\blinky\mbed-os-example-blinky>mbed test --run -t GCC_ARM -m DISCO_L496AG -n mbed-os-features-nvstore-tests-nvstore-functionality
mbedgt: greentea test automation tool ver. 1.3.2
mbedgt: test specification file 'C:\Ashok\blinky\mbed-os-example-blinky\BUILD\tests\DISCO_L496AG\GCC_ARM\test_spec.json' (specified with --test-spec option)
mbedgt: using 'C:\Ashok\blinky\mbed-os-example-blinky\BUILD\tests\DISCO_L496AG\GCC_ARM\test_spec.json' from current directory!
mbedgt: detecting connected mbed-enabled devices...
[1530264534.09][mbedls.platform_database]Duplicate platform ids found: daplink.8081, ignoring the definitions from C:\Users\ashrao01\AppData\Local\mbedls\mbedls\platforms.json
[1530264534.10][mbedls.lstools_base]Call to deprecated function list_mbeds_ext. Functionality has been moved into 'list_mbeds'. Please use list_mbeds with 'unique_names=True' and 'read_details_txt=True'
mbedgt: detected 1 device
mbedgt: processing target 'DISCO_L496AG' toolchain 'GCC_ARM' compatible platforms... (note: switch set to --parallel 1)
mbedgt: test case filter (specified with -n option)
        test filtered in 'mbed-os-features-nvstore-tests-nvstore-functionality'
mbedgt: running 1 test for platform 'DISCO_L496AG' and toolchain 'GCC_ARM'
mbedgt: mbed-host-test-runner: started
mbedgt: checking for GCOV data...
mbedgt: test on hardware with target id: 08220221773465344870FC2B
mbedgt: test suite 'mbed-os-features-nvstore-tests-nvstore-functionality' ............................ OK in 21.24 sec
        test case: 'NVStore: Basic functionality' .................................................... OK in 0.37 sec
        test case: 'NVStore: Multiple thread test' ................................................... OK in 6.42 sec
        test case: 'NVStore: Race test' .............................................................. OK in 0.42 sec
mbedgt: test case summary: 3 passes, 0 failures
mbedgt: all tests finished!
mbedgt: shuffle seed: 0.4029266403
mbedgt: test suite report:
+----------------------+---------------+------------------------------------------------------+--------+--------------------+-------------+
| target               | platform_name | test suite                                           | result | elapsed_time (sec) | copy_method |
+----------------------+---------------+------------------------------------------------------+--------+--------------------+-------------+
| DISCO_L496AG-GCC_ARM | DISCO_L496AG  | mbed-os-features-nvstore-tests-nvstore-functionality | OK     | 21.24              | default     |
+----------------------+---------------+------------------------------------------------------+--------+--------------------+-------------+
mbedgt: test suite results: 1 OK
mbedgt: test case report:
+----------------------+---------------+------------------------------------------------------+-------------------------------+--------+--------+--------+--------------------+
| target               | platform_name | test suite                                           | test case                     | passed | failed | result | elapsed_time (sec) |
+----------------------+---------------+------------------------------------------------------+-------------------------------+--------+--------+--------+--------------------+
| DISCO_L496AG-GCC_ARM | DISCO_L496AG  | mbed-os-features-nvstore-tests-nvstore-functionality | NVStore: Basic functionality  | 1      | 0      | OK     | 0.37               |
| DISCO_L496AG-GCC_ARM | DISCO_L496AG  | mbed-os-features-nvstore-tests-nvstore-functionality | NVStore: Multiple thread test | 1      | 0      | OK     | 6.42               |
| DISCO_L496AG-GCC_ARM | DISCO_L496AG  | mbed-os-features-nvstore-tests-nvstore-functionality | NVStore: Race test            | 1      | 0      | OK     | 0.42               |
+----------------------+---------------+------------------------------------------------------+-------------------------------+--------+--------+--------+--------------------+
mbedgt: test case results: 3 OK
mbedgt: completed in 24.20 sec

C:\Ashok\blinky\mbed-os-example-blinky>

Thanks @davidsaada and @0xc0170

davidsaada · 2018-07-11T13:08:25Z

#7127 merged now. Issue can be closed.

ciarmcom added the mirrored label Jun 28, 2018

0xc0170 added the component: filesystem label Jun 28, 2018

0xc0170 closed this as completed Jul 13, 2018

ciarmcom added the closed_in_jira label Jul 13, 2018

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Uh oh!

NVStore tests are unstable with GCC. #7362

NVStore tests are unstable with GCC. #7362

ashok-rao commented Jun 28, 2018

dannybenor commented Jun 28, 2018

Uh oh!

davidsaada commented Jun 28, 2018

Uh oh!

ciarmcom commented Jun 28, 2018

Uh oh!

0xc0170 commented Jun 29, 2018

Uh oh!

ashok-rao commented Jun 29, 2018

Uh oh!

davidsaada commented Jul 11, 2018

Uh oh!

NVStore tests are unstable with GCC. #7362

NVStore tests are unstable with GCC. #7362

Comments

ashok-rao commented Jun 28, 2018

Description

Issue request type

dannybenor commented Jun 28, 2018

Uh oh!

davidsaada commented Jun 28, 2018

Uh oh!

ciarmcom commented Jun 28, 2018

Uh oh!

0xc0170 commented Jun 29, 2018

Uh oh!

ashok-rao commented Jun 29, 2018

Uh oh!

davidsaada commented Jul 11, 2018

Uh oh!