30 |
30 |
31 <#if !(ant?keys?seq_contains("sf"))> |
31 <#if !(ant?keys?seq_contains("sf"))> |
32 .. _`and the matti website`: http://trmatti1.nmp.nokia.com/help/ |
32 .. _`and the matti website`: http://trmatti1.nmp.nokia.com/help/ |
33 </#if> |
33 </#if> |
34 |
34 |
35 The set up of parameters is very similar (a few less parameters and it mostly uses ATS values). The main difference is that once the drop file has been uploaded to the ATS server it uses MATTI to perform the tests and not ATS, this is achieved by calling the MATTIDrop.py script instead of the ATSE or ATS scripts when creating the drop file (the drop file contains the flash files and the ruby tests to be performed). |
35 The set up of parameters is very similar (a few less parameters and it mostly uses ATS values). The main difference is that once the drop file has been uploaded to the ATS server it uses MATTI to perform the tests (the drop file contains the flash files, the ruby tests/sip profiles, data files, sis files and/or parameters file in xml format). |
36 |
36 |
37 The following parameters are the ones that are not listed in the ATS parameters, all other parameters required are as listed in the ATS section above. |
37 The following parameters are the ones that are not listed in the ATS parameters, all other parameters required are as listed in the ATS section above, which include :hlm-p:`ats.server`, :hlm-p:`ats.email.list`, :hlm-p:`ats.email.format`, :hlm-p:`ats.email.subject`, :hlm-p:`ats.testrun.name`, :hlm-p:`ats.product.name`, :hlm-p:`ats.flashfiles.minlimit`, :hlm-p:`ats.flash.images` and :hlm-p:`ats.upload.enabled`. |
38 |
38 |
39 * [must] - must be set by user |
39 * [must] - must be set by user |
40 * [recommended] - should be set by user but not mandatory |
40 * [recommended] - should be set by user but not mandatory |
41 * [allowed] - should **not** be set by user however, it is possible. |
41 * [allowed] - should **not** be set by user however, it is possible. |
42 |
42 |
43 .. csv-table:: ATS Ant properties |
43 .. csv-table:: ATS Ant properties |
44 :header: "Property name", "Edit status", "Description" |
44 :header: "Property name", "Edit status", "Description" |
45 |
45 |
46 ":hlm-p:`matti.scripts`", "[must]", "The location of the test scrips as ruby test files i.e. .rb files." |
46 ":hlm-p:`matti.enabled`", "[must]", "Enable MATTI testing to occur, if not present the target :hlm-t:`matti-test` will not run." |
47 ":hlm-p:`enabled.matti`", "[must]", "Enable MATTI testing to occur, if not present the target :hlm-t:`matti-test` will not run." |
47 ":hlm-p:`matti.asset.location`", "[must]", "The location of the test asset where ruby test files, sip profiles, hardware data etc are located." |
48 ":hlm-p:`template.file`", "[must]", "Location of the matti template file." |
48 ":hlm-p:`matti.test.profiles`", "[must]", "Test profiles to be executed should be mentioned in this comma separated list e.g., 'bat, fute'." |
49 ":hlm-p:`ats.sis.images.dir`", "[recommended]", "Location of the the SIS installation files needed to flash to the phone (if required and present)." |
49 ":hlm-p:`matti.sierra.enabled`", "[must]", "Mustbe set to 'true' if sierra is engine is to be used. If true .sip files are used otherwise .rb (ruby) files are used to execute tests-" |
50 ":hlm-p:`ats.script.type`", "[must]", "Always set to import, this means the MATTI server will retrieve the tests." |
50 ":hlm-p:`matti.test.timeout`", "[must]", "Separate but similar property to ats.test.timeout for matti tests." |
51 ":hlm-p:`ats.image.type`", "[must]", "Image type whether Engineering English or localised." |
51 ":hlm-p:`matti.parameters`", "[must]", "Matti test parameters can be given through Matti parameters xml file." |
52 ":hlm-p:`ats.flashfiles.minlimit`", "[must]", "Minimum number of flash files required in to add to the drop file." |
52 ":hlm-p:`matti.sis.files`", "[must]", "There are special sis files required to execute with test execution. This is a comma separated list in which several sis files can be deifned in a certain format like '<src file on build area>#<destination to save the file on memory card>#<destination to install the file>' e.g. <x:\dir1\abc.sis#f:\memory1\abc.sis#c:\phonememory\private\abc.sis>" |
53 ":hlm-p:`tsrc.data.dir`", "[recommended]", "Test source code data directory. only required for testing the Ant MATTI code." |
53 ":hlm-p:`matti.sierra.parameters`", "[must]", "Sierra parameters are set using this property. e.g. '--teardown --ordered'" |
54 ":hlm-p:`ta.flag.list`", "[recommended]", "TA flag list." |
54 ":hlm-p:`matti.template.file`", "[allowed]", "Location of the matti template file." |
55 |
55 |
56 |
56 |
57 All you need to do is setup the following parameters: |
57 All you need to do is setup the following parameters: |
58 |
58 |
59 .. code-block:: xml |
59 .. code-block:: xml |
60 |
60 |
61 <property name="enabled.matti" value="true" /> |
61 <property name="matti.enabled" value="true" /> |
62 <property name="matti.scripts" value="${r'$'}{helium.dir}/tests/data/matti" /> |
62 <property name="matti.asset.location" value="\\server\share\matti_testcases, x:\dir\matti_testcases," /> |
63 <property name="template.file" value="${r'$'}{helium.dir}\tools\common\python\lib\ats3\matti\template\matti_demo.xml" /> |
63 <property name="matti.test.profiles" value="bat, fute" /> |
64 <property name="ats.sis.images.dir" location="${r'$'}{build.drive}\output\matti\sis" /> |
64 <property name="matti.sierra.enabled" value="true" /> |
65 <property name="ats.product.name" value="" /> |
65 <property name="matti.test.timeout" value="1200" /> |
66 <property name="ats.test.timeout" value="60" /> |
66 <property name="matti.parameters" value="x:\dir\mattiparameters\matti_parameters.xml" /> |
|
67 <property name="matti.sis.files" value="x:\sisfiles\abc.sis#f:\data\abc.sis#C:\abc.sis, x:\sisfiles\xyz.sis#f:\data\xyz.sis#F:\xyz.sis" /> |
|
68 <property name="matti.sierra.parameters" value="--ordered" /> |
|
69 <property name="matti.template.file" value="x:\dir\templates\matti_template_2.xml" /> |
|
70 |
67 |
71 |
68 <!--ATS testing properties--> |
|
69 <property name="tsrc.data.dir" value="data_rom" /> |
|
70 <property name="ats.ctc.enabled" value="True" /> |
|
71 <property name="ats.flashfiles.minlimit" value="2"/> |
|
72 <property name="ta.flag.list" value="TA_M, TA_MU, TA_MMAPPFW,TA_MM"/> |
|
73 <property name="ats.server" value="12345675:80"/> |
|
74 |
72 |
75 In order to upload and view the test run you need to have a valid user ID and password that matches that in your ``.netrc`` file. To create the account open a web browser window and enter the name of the ats.server with /ATS at the end e.g. http://123456:80/ATS. Click on the link in the top right hand corner to create the account. To view the test run once your account is active you need to click on the 'test runs' tab. |
73 In order to upload and view the test run you need to have a valid user ID and password that matches that in your ``.netrc`` file. To create the account open a web browser window and enter the name of the ats.server with /ATS at the end e.g. http://123456:80/ATS. Click on the link in the top right hand corner to create the account. To view the test run once your account is active you need to click on the 'test runs' tab. |
76 |
74 |
77 To run the tests call the target :hlm-t:`matti-test` (you will need to define the :hlm-p:`build.drive`, :hlm-p:`build.number` and it is best to create the :hlm-p:`core.build.version` on the command line as well if you do not add it to the list of targets run that create the ROM image). e.g. |
75 To run the tests call the target :hlm-t:`matti-test` (you will need to define the :hlm-p:`build.drive`, :hlm-p:`build.number` and it is best to create the :hlm-p:`core.build.version` on the command line as well if you do not add it to the list of targets run that create the ROM image). e.g. |
78 :: |
76 :: |
79 |
77 |
80 hlm -Dbuild.number=001 -Dbuild.drive=z: -Dcore.build.version=001 matti-test |
78 hlm -Dbuild.number=001 -Dbuild.drive=z: -Dcore.build.version=001 matti-test |
81 |
79 |
82 If it displays the message 'Testdrop created!' with the file name then the ``MATTIDrops.py`` script has done what it needs to do. The next thing to check is that the drop file has been uploaded to the ATS server OK. If that is performed successfully then the rest of the testing needs to be performed by the ATS server. There is also a ``test.xml`` file created that contains details needed for debugging any problems that might occur. To determine if the tests have run correctly you need to read the test run details from the server. |
80 If it displays the message 'Matti testdrop created successfully!', script has done what it needs to do. The next thing to check is that the drop file has been uploaded to the ATS server OK. If that is performed successfully then the rest of the testing needs to be performed by the ATS server. There is also a ``test.xml`` file created that contains details needed for debugging any problems that might occur. To determine if the tests have run correctly you need to read the test run details from the server. |