New exporter build tests #2754

sarahmarshy · 2016-09-20T15:19:50Z

Description

Export-build test now exports projects in parallel. It is also capable of testing the export of mbed-os tests. They can be found in the mbed-os/TESTS. The targets and tests are by default those from the latest release, though you can specify previous releases.

Status

READY

Migrations

Running export-build tests

python tools/test/export/build_test.py --release 2 -n MBED_BLINKY (blinky is default for release 2)
python tools/test/export/build_test.py --release 5 -os-tests tests-mbedmicro-rtos-mbed-basic (though 5 is default release, and this basic test is the default test for release 5)

You will need to add 2 environment variables:
Please add UV4.exe and IarBuild.exe as variables UV4 and IARBUILD, respectively.
On Windows:
UV4 is usually found in:
C:\Keil_v5\UV4\UV4.exe

IarBuild is usually found in:
C:\Program Files (x86)\IAR Systems\Embedded Workbench 7.x\common\bin\IarBuild.exe

YES

Related PRs

List related PRs against other branches:
cherry picked changes from #2708

Changes

Parallel export
mbed-os tests added
specified release version (default to 5)
default tests AND targets dependent on specified release version

@bridadan

theotherjimmy

I like most of the changes, but I don't like creating objects that attach no extra meaning to the data they hold.

theotherjimmy · 2016-09-20T15:25:30Z

tools/test/export/build_test.py

+        self.mcu = mcu
+        self.name = name
+        self.id = test_num
+        self.src = src


This class is just a named tuple or something similar, do we need it?

theotherjimmy · 2016-09-20T15:27:32Z

tools/test/export/build_test.py

+                tests.append(TestCase(ide, mcu, TESTS[test]["id"],
+                                      test_num=test))
+            for test in v5_tests:
+                tests.append(TestCase(ide, mcu, test[0], src=[test[1],ROOT]))


Given it's use case, just make it a dict or a named tuple.

bridadan · 2016-09-20T18:56:23Z

/morph export-build

mbed-bot · 2016-09-20T19:00:03Z

Result: ABORTED

Your command has finished executing! Here's what you wrote!

/morph export-build

bridadan · 2016-09-20T19:02:16Z

/morph export-build

mbed-bot · 2016-09-20T19:49:30Z

Result: FAILURE

Your command has finished executing! Here's what you wrote!

/morph export-build

bridadan · 2016-09-20T20:21:14Z

So awesome enough, uVision was all passing (besides the skipped targets)!

IAR has quite a bit of failures, this is due to the IAR issues listed here, right @sarahmarshy ?

sarahmarshy · 2016-09-20T21:37:06Z

/morph export-build

mbed-bot · 2016-09-20T22:57:43Z

Result: FAILURE

Your command has finished executing! Here's what you wrote!

/morph export-build

bridadan · 2016-09-21T14:14:31Z

Running now with the --release 2 flag enabled

/morph export-build

mbed-bot · 2016-09-21T14:18:03Z

Result: ABORTED

Your command has finished executing! Here's what you wrote!

/morph export-build

bridadan · 2016-09-21T14:18:36Z

/morph export-build

mbed-bot · 2016-09-21T15:01:32Z

Result: FAILURE

Your command has finished executing! Here's what you wrote!

/morph export-build

bridadan

uVision is all passing for --release 2. There's a lot of skipped targets but that's probably ok @sarahmarshy ? When is a target skipped?

IAR had failures, in fact it had more failures, but that's only because we weren't testing those platforms before 😄

If @sarahmarshy and @theotherjimmy are happy with this after looking at the results then so am I!

sarahmarshy · 2016-09-21T15:33:24Z

Target is skipped if it doesn't have a progen definition (https://github.com/project-generator/project_generator_definitions) for that particular IDE

bridadan · 2016-09-21T16:42:58Z

@sg- Looks like we're good to merge here.

sg- · 2016-09-22T05:49:16Z

@sarahmarshy looks like it needs a rebase and conflict resolved.

*Changes* - Parallel export - mbed-os tests added - specified release version (default to 5) - default tests AND targets dependent on specified release version

sarahmarshy · 2016-09-22T15:04:28Z

@sg- rebased.

sarahmarshy · 2016-09-22T15:05:27Z

@bridadan the test for uvision5 will be uvision now, with this rebased on Marcelo's changes.

bridadan · 2016-09-22T15:14:21Z

@sarahmarshy Thanks for the heads up, I made the change and I'll go ahead and kick off one more test.

/morph export-build

bridadan · 2016-09-22T16:33:04Z

@sarahmarshy I'm looking at the interim results and IAR looks to be all failing at the moment with these kind of errors:

10:47:01 Error while running C/C++ Compiler

10:47:01 ssl_tls.c 

10:47:01 [Su004]: Illegal combination

10:47:01      --no_static_destruction

10:47:01    may not be used unless at least one of

10:47:01      --ec++

10:47:01      --eec++

10:47:01      --c++

10:47:01    is used

Pretty sure this was introduced with PR #2745 (which coincidentally, we didn't run the export-build test 😞 )

Any idea why this works in the mbed build system but not in IAR?

mbed-bot · 2016-09-22T16:34:52Z

Result: ABORTED

Your command has finished executing! Here's what you wrote!

/morph export-build

bridadan · 2016-09-22T16:36:18Z

@sarahmarshy Also had to kill the exporter test for uvision, looks like it started to hang when the mbed build system started up for another job. The IAR results should still be useful to you

sarahmarshy · 2016-09-22T17:51:13Z

From the command line output of build system I see --c++ --no_rtti --no_exceptions --guard_calls --no_static_destruction, need to look into why that isn't passed to to IAR project flags.

sarahmarshy · 2016-09-22T17:59:00Z

Exporters pick up the flags from here. --c++ manually appended here for the build system. Working on a fix...

sarahmarshy · 2016-09-22T17:59:48Z

@bridadan will be a separate PR though.

bridadan · 2016-09-22T18:09:34Z

@sarahmarshy makes sense to me!

sarahmarshy · 2016-09-22T19:25:06Z

Fix in #2787

sarahmarshy changed the title ~~New build tests.~~ New exporter build tests Sep 20, 2016

theotherjimmy reviewed Sep 20, 2016

View reviewed changes

sarahmarshy force-pushed the release_targets branch from 26fb8a3 to 5cba51a Compare September 20, 2016 17:33

bridadan mentioned this pull request Sep 21, 2016

exporters - Add .bld directories to exported project #2756

Merged

bridadan approved these changes Sep 21, 2016

View reviewed changes

theotherjimmy approved these changes Sep 21, 2016

View reviewed changes

sg- added the ready for merge label Sep 22, 2016

New build tests.

16913b9

*Changes* - Parallel export - mbed-os tests added - specified release version (default to 5) - default tests AND targets dependent on specified release version

sarahmarshy force-pushed the release_targets branch from f055e45 to 16913b9 Compare September 22, 2016 15:04

sarahmarshy mentioned this pull request Sep 22, 2016

[Exporters] [Makefile] Single quotes for escaping commands #2773

Merged

2 tasks

sg- merged commit 667c171 into ARMmbed:master Sep 22, 2016

sg- added release-version: 5.1.5 and removed ready for merge labels Sep 22, 2016

bridadan mentioned this pull request Oct 4, 2016

callback - Add workaround for IAR issue with type information #2898

Merged

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

New exporter build tests #2754

New exporter build tests #2754

sarahmarshy commented Sep 20, 2016 •

edited

Loading

theotherjimmy left a comment

theotherjimmy Sep 20, 2016

theotherjimmy Sep 20, 2016

bridadan commented Sep 20, 2016

mbed-bot commented Sep 20, 2016

bridadan commented Sep 20, 2016

mbed-bot commented Sep 20, 2016

bridadan commented Sep 20, 2016

sarahmarshy commented Sep 20, 2016

mbed-bot commented Sep 20, 2016

bridadan commented Sep 21, 2016

mbed-bot commented Sep 21, 2016

bridadan commented Sep 21, 2016

mbed-bot commented Sep 21, 2016

bridadan left a comment

sarahmarshy commented Sep 21, 2016

bridadan commented Sep 21, 2016

sg- commented Sep 22, 2016

sarahmarshy commented Sep 22, 2016

sarahmarshy commented Sep 22, 2016 •

edited

Loading

bridadan commented Sep 22, 2016

bridadan commented Sep 22, 2016

mbed-bot commented Sep 22, 2016

bridadan commented Sep 22, 2016

sarahmarshy commented Sep 22, 2016 •

edited

Loading

sarahmarshy commented Sep 22, 2016 •

edited

Loading

sarahmarshy commented Sep 22, 2016

bridadan commented Sep 22, 2016

sarahmarshy commented Sep 22, 2016

New exporter build tests #2754

New exporter build tests #2754

Conversation

sarahmarshy commented Sep 20, 2016 • edited Loading

Description

Status

Migrations

Related PRs

theotherjimmy left a comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

Choose a reason for hiding this comment

bridadan commented Sep 20, 2016

mbed-bot commented Sep 20, 2016

bridadan commented Sep 20, 2016

mbed-bot commented Sep 20, 2016

bridadan commented Sep 20, 2016

sarahmarshy commented Sep 20, 2016

mbed-bot commented Sep 20, 2016

bridadan commented Sep 21, 2016

mbed-bot commented Sep 21, 2016

bridadan commented Sep 21, 2016

mbed-bot commented Sep 21, 2016

bridadan left a comment

Choose a reason for hiding this comment

sarahmarshy commented Sep 21, 2016

bridadan commented Sep 21, 2016

sg- commented Sep 22, 2016

sarahmarshy commented Sep 22, 2016

sarahmarshy commented Sep 22, 2016 • edited Loading

bridadan commented Sep 22, 2016

bridadan commented Sep 22, 2016

mbed-bot commented Sep 22, 2016

bridadan commented Sep 22, 2016

sarahmarshy commented Sep 22, 2016 • edited Loading

sarahmarshy commented Sep 22, 2016 • edited Loading

sarahmarshy commented Sep 22, 2016

bridadan commented Sep 22, 2016

sarahmarshy commented Sep 22, 2016

sarahmarshy commented Sep 20, 2016 •

edited

Loading

sarahmarshy commented Sep 22, 2016 •

edited

Loading

sarahmarshy commented Sep 22, 2016 •

edited

Loading

sarahmarshy commented Sep 22, 2016 •

edited

Loading