Re-assessed some of the raptor error messages to reflect the inconsequential nature of missing the MS dev tools when not trying to build the tools target.

Changed mergeXML.pl to use a better version of the XML printing algorithm, so it can generate well-formed content if the input includes some rogue &s or <>s.

If any files are in both the list of SDK headers, and the list of RnD headers, then they're only zipped in the binaries_epoc_additional zip, and not the binaries_epoc_sdk zip.

Fixed format checking of summary.csv to deal with new field.

Test: Add MediaMgmt smoke tests (not being built or run ATM)

Test: Remove the media management smoke test for now

Re-instated call to process raptor logs for BRAG purposes.

Remove s60 postfix from sf-s60-create-cenrep for Symbian^3

Fixed format checking of summary file so that it actually checks something!

Updated framework for packaging SDK headers so the contents to zip can be set by a project property (or it can zip everything together if it's not set).

add media mgmt to smoketest build

Fix cenrep export location

SDK file list - Fixed duplicates

Fixed and enabled smoke test for Set Language

Defined new devices for v800017

Disabled smoke test for Set language

Small changes to make the output file more regular, and therefor easier to read and understand.

Added processing of error tags.

Fixed perl scripts for building BC test drops

Fixed Set language smoke test

Changed to package the SDK header files in a different zip to the rest of the epoc32 tree.

Fixed smoketest.xml

Added new smoke test for phone languages

Removed code for building ROMs (now done by Raptor) but added code for publishing ROM building logs.

Fix releaseables are missing. Fix stray call to summarize.pl

Catchup merge

Disabled BC check from running as default on builds. Should be enabled specifically at the command line.

Added new smoke test for Setting wallpaper

Disabled bccheck for normal builds

Catchup merge

Platform Build cenrep generatation - modified 'sf-s60-create-cenrep' to hopefully cope with the different CRML export paths coming from the different platform_paths.hrh. This isn't pretty.

Fix Diamonds links are no longer appearing

Added conditions for BC check results to be published

Changed delays between key presses

Added smoke test to close UI setup dialogs

Increased delay before presskey

Enabled bccheck for normal builds

Update send_xml_to_diamonds.py and update invoking code to match new i/f

Updated IF statements for BC reports

Add new recipe-error categories armcc_modifier_not_allowed, mwccsym2_file_cannot_be_opened

Changed current baseline version for BC check.

Fix freemarker.core.ParseException: Encountered { at line 25, column 15 in linksForDiamonds.xml.ftl

Added Static BC reports for Platform Builds

Add NewGraphicsArchitecture_props.ant.xml

Update PDK baselines for package builds

Merge Tags

Add Raptor Build Summary to the links for Diamonds

Publish HTML files summary of Raptor build

Now creates src-by-layer entries on the fly, so it doesn't create release zips with no content.

Added interpretation of recipe "win32def2lib" failing.

Fix XML-SAX bug #43174 (see http://rt.cpan.org/Public/Bug/Display.html?id=43174)

Improved Raptor parser, now "uh"

Changed versions of the baselines for Static BC test

Disabled Dynamic BC tests

Merge

Added tag PDK_2.0.1 for changeset e13acd883fbe

merged heads - non trivial merge in smoketest. Manual merge of those changes.

Test: Input methods smoke tests added.

Test: Fixed up the app install smoke tests so that both now pass

Added new smoketest

Add call to parse (preprocessed) raptor logs directly for BRAGG.

Updated XSL to include counts of failures at each severity, and also the new effect/causes distinction, for failures that are not package specific.

New script which parses raptor logs directly to produce a BRAG summary. New version of XML structure accommodates causes of failure as well as the effect of the failure, and deals with excessive error messages. New structure also avoids a potential problem (bug?, questionable feature?) that both IE and firefox exhibit. Some simplifications of brag utilities module.

Moved common code to shared module.

Updated the options to pass to getenv, to include -k. This avoids aborts if things are not exactly as the tool expects.

Added tag PDK_3.0.c for changeset 12815724a053

Added new smoketest

Added new smoketest

Bug 881: Now also provides the locations of the two split-build system definitions to the release note generator, so it will work with both single and split builds.

source sync template - enabled getting the mercurial changes if you have sf.spec.sourcesync.archive set

Transplant fix in ats BC Test - 'bld_sis' change that was knocked out with the rest of the transplant (bcdrivers/utilities)

Added call to munge license headers at the top of the postbuild phase, so it should be done within the platorm build.

Switched to using revised Package/FCL analysis script.

Remove meta data from package definition and replace with helium script

Test: Forgot to execute Profile smoke tests

Test: Changes to test drop files to run AppInstall

Test: Tweaked Profile tests and added AppInstall

Add new raptor-analysis recipe-failure category: elf2e32_symbol_missing_from_elf_file

Override Helium defaults for RVCT checks to allow winscw builds without RVCT

Update PDK baselines for package builds

Add CompilerCompatibility properties file for package build

Changed device name for lon-engbuild89

Changed device name for lon-engbuild87

Changed device name for C100725

Changed device name

host name is added for any number of devices

Added smoketest for Notepad

Add recipe-failure category armcc_internal_fault

fix bug with multiple harnesses

export to 'smoketest' instead of 'testframework'

capitals

updated smoketest plan to support both harnesses

Add recipe-failure categories armcc_controlling_expression_is_constant and armcc_generic_warnings_errors

Adding profiles smoke tests

Removed unnecessary dependencies, to untangle the dependency graph a little.

In raptor-analysis create summary.csv file anyway, otherwise some targets following may crash the build

Added smoketest for email

Update to add all components and create zip file for PDT

Add all components to bc test suite build

Fix some build configurations are left as 'noconfig'

Add raptor recipe error category armar_file_does_not_exist

Add raptor error categories unknown_build_config and no_build_configs_given

Merging tag

Added tag PDK_3.0.b for changeset cdfb88270be0

Let sbs targets be taken from sf.spec.sbs.config

Added 3 new smoke tests

Changed dst path for evptests.txt

Add missing components to the BC build script

Added new device for LON-ENGBUILD89

Added new device for LON-ENGBUILD87

catchup merge.

catchup merge

source sync template - Changed the BOM changes targets to limit the listed changes to the branch if the source was synced up using a branch, to make it easier to read.

Added Core Telephony BC tests

Added all of the tests for ASP

If makefile_template copy fails then ignore, as its no longer needed for S^3.

Merge

Add sf-rombuild target to build ROMs. Backout ARM license check suppression.

Change baseline for symbian3 to \\bishare\releases\PDK_3.0.a

Fix only one raptor log gets processed by Dario's Raptor parser

Send to Diamonds only 3 links: brag, build bom, build logs

Change default location of build results/reports to \\v800020\Publish\SF_builds

Make script stop execution after help is displayed if --help

Remove default "test" tag

Catchup merge of tags

Added tag PDK_2.0.0 for changeset 7a343c038e7d

Added tag PDK_3.0.a for changeset 4709730d5226

Added new BC test

Added new BC test

catchup merge.

catchup merge.

sf-run-evalid - minor change to make sure that evalid is run at the root of the build drive, which can stop the MD5s from being generated. (evalid requires dirs to be relative and not absolute)

added a missing testdata file

Added new BC test

Updated throughout to use the "temp_build_files" dir on the build drive rather than the "generated" directory in the fbf source tree.

Moved the generation of the release metadata entry for the MD5 zip outside of the parallel section, so it can't co-incide with the zipping of the binaries. Ensured that any errors generated when merging log files are not just hidden by putting them in the output file (which will render it not well-formed XML).

Replaced <available> check with an <uptodate> check, to greatly help people working on the FBF who want the file automatically regenerated according to the changes they have made.

Restored call to summarise final BRAG status for regular platform builds.

Major packaging change to work around parallel calls - stopped zipping targets from having direct dependency on 'sf-preprocess-package-config', and instead have 'sf-zip-content' call 'sf-preprocess-package-config' if needed. Changed 'sf-prep' to call a target that wipes out the 'generated' directory. It's not perfect but it gets us going again.

Moved invocation of sf-brag-to-diamonds, so it's right at the end of the postbuild (apart from publishing zipped logs). This avoids the possibility of a build abort when parallel threaqds are trying to a) convert a log file into a brag file, and b) merge all brag files ready to determine the brag status. It also makes more sense - don't calculate or send the BRAGG status until the build is on the cusp of completion.

Merge

Add standard C++ tests to the build

Changed timeout

Added new BC test

Added new BC test

Bug 479: RnD package zips contain content not releaseable to public Updated packaging tools to separate binaries and source in RnD repos.

tried changing the directory for pbkaddressselect.rsc

Added new BC test

Merge

Add missing components to build

Add use lib statement to look for Text-CSV in local lib folder

Bug 478: build_*.zip missing from generated release_metadata.xml Added call to zip system to add entries for these zips to the release_metadata.xml

Updated comments in perl scripts

Added new BC test

fixed up the phonebook tests to run faster

Replaced section "Package failures by phase/step/severity" with "Package failures by package/severity" Added internal links from the package/severity breakdown to the peices of the new section.

Merge

Make csvToSysDef.pl work with codelines different than 3k

Updated comments

Move QEMU into adaptation layer when packaged

ATS fix for getting the smoketest to run.

Added lib dir to pick up Text::CSV when it's not included with the installed perl distribution.

Add new BC test

Added lists of error messages themselves, categorised by phase, step, ...

Added tables for eack package with failures, broken down by severity. Added anchor links to new tables from table of packages.

Added understanding of the "ar" failure.

Added post-processing of YARP analysis to feed into BRAG status.

Added copy to copy the XSL so it's available if ever an XML is generated there.

Created a dedicated sf-log-to-brag target so it can take care of the commonality of the task, including the creation of the directory for XML output.

catchup merge.

sf-gen-buildinfo-txt target in platform build - De-CamelCasing buildinfo.txt deletion and creation to fix zip inclusion/exclusion problems.

Fixed generation of rnd excludes file, so there are the necessary new-lines.

Add new BC test

New BC test added

Device name removed

sf-brag-to-diamonds - Only copy over the Brag XML if '${sf.spec.publish.enable}' is true.

ATS target 'sf-build-smoketestpkg' - fix for argument name change in 'ats_specialise_test_drop.pl'. Update command-line help for 'ats_specialise_test_drop.pl'

catchup merge.

Modified sf-check-missing-os-files to deal with 'sf.os.compile.iterate' property. Added new target 'sf-compile-options' for setting the gmake sbs compile option, and added it as a dep for the compile targets.

Allow to copy all the files in the summary directory to the bishare to allow link for BRAG to work in Diamonds.

remove 'test.xml'

added basesvs.xml

sorted out more stuff with the dynamic bc, fewer failures now

some more updates to bc stuff

graphics test plan now only runs fbserv tests

New BC test

Set PDK baseline to PDK_3.0.a_alpha_FCL.120

Merge

Skip sf-compare-to-baseline if sf.spec.publish.enable is false. Update FBF documentation.

Make sure the BRAG xml and xsl files are sent to bishare in an unzipped way to allow access from link in Diamonds.

Make sure the BRAG xml and xsl files are sent to bishare in an unzipped way to allow access from link in Diamonds.

Make sf.spec.job.codeline the publishing category

Merge

Fix layer names for production and test builds

sf-run-analysis - Making 'sf-brag-to-diamonds' depend on 'sf.spec.publish.enable' property

catchup merge

Fixed md5 zipping in case no publish is requested. Added overwriting of variant.cfg if it already exists

catchup merge

sf-check-env - Fixed typo causing build to always halt if 'sf.suppress.buildenv.check' isn't set.

catchup merge

source-spec.ant.xml.ftl - Added change info for the BOM that lists submitted changesets between the baseline ('sf.previous.pdk.tag') and the synced changeset and writes to a changes.txt file in the BOM dir.

Added work-around for the QEMU package whilst it's still in an interim location, but we want to release it in a PDK. (The proper fix would be to move the repository into the right place and update the sources.csv, but time is of the essence!)

merge

fixed up multimedia to match fts

fixed up most of the issues with the dynamic bc test plans

sf-preprocess-package-config - fix for another BRAG step that presumes that "${build.log.dir}/summary" exists.

sf-check-env - Adding mkdir for BRAG output file.

sf-prep - Partial Revert of changeset aa36fa431e3d - 'Added processing of the BuildEnvironmentCheck for BRAG purposes.' as we need 'sf-check-env' to be optional with 'sf.suppress.buildenv.check' variable.

Keepgoing in the event of testpackage submit error.

Adjustsed BRAG to BRAGG, to accommodate the possibility of there being Green builds and Gold builds.

Adjusted capitalisation to make the final output more aesthetically pleasing.

Added processing of the BuildEnvironmentCheck for BRAG purposes.

Parse log generated during proprocessing of zip config, so it gets included in BRAG analysis.

Merge

Upload codeline and sf.spec.diamonds.tag as Diamonds tags

Add link in Diamonds to read the BAG status from _brag.xml.

Sorted out misalignment between capture of diamonds build id and its re-use.

Copy Symbian_OS.HRH to required location

Add codeline specific property files

Merge

Merge

Reviewed build category and tags

Allow codeline-specific property file to be read (if present)

Added target to push a collated and calculated BRAG status to diamonds.

Save the diamonds build ID in a file as soon as it is generated.

catchup merge.

Creation of 'sf-create-public-PDK' for munging licences in text files. Not tested yet as I've got another build running on this machine, so submitting and kicking via Hudson.

Added support for being passed wildcards in an XML file argument.

Added schema setting, so Diamonds should accept the data.

Bug 419 source sync workaround - Added property sf.spec.sourcesync.bug419 to common_props.ant.xml and set to true.

Catchup merge

Bug 419 source sync workaround - Added new variable 'sf.spec.sourcesync.bug419' that can be used during source sync that just performs the sync manually without using Maven.

Merge

Update commands for clone and copy and use of makesis

New XSL rules to generate a diamonds compatible BRAG status, which can be posted into the database.

Added XML escaping, so that the output should be well-formed XML even if the input includes '<'s, '>'s, or '&'s.

Added code to handle the script being given a log file argument which includes wild cards.

Fixed handling or regular expression strings, so the regular expression functiuonality works, not just substring detection! Added special handling if the severity marker is "ignore". Unsuprisingly, it ignores that line.

Adjusted sf-run-analysis-raptor so that when preprocessing the files, STDERR is appended, but STDOUT is not.

Pre-emptive performance fix - avoid having to read the complete log file into memory at the same time before processing it.

Static BC tests enabled

Catchup merge.

Added helium target sf-run-sfl-licence-munging for Public PDK creation.

Added framework script for turning log files into XML BRAG summaries.

Time-outs reduced

Script to merge multiple MXL files together, according to a merge specification string

Adfjusted XML format used, so there's a document-level tag - <buildStatus> which can wrap multiple <phase> tags.

Device NAME removed

Device NAME removed

rmtree check removed

Time-out changed

Device NAME removed

Device NAME removed

Device NAME removed

Device NAME removed

Files names updated

Merge

Skip armcc licence checking

Reordered output, so information is presented in a high-level -> low-level way Added basic breakdown by package. Minor improvements to formatting.

Added package attribute (when failure is package specific). Created more tags up-front, so that if there are 0 critical failures, then it's recorded.

python does not use PATH

update mcl code from RCL_1 branch

merge and switch off static bc check

removed 'NAME' property from test plans

merge

Changed ats_specialise_testdrop and build.test.xml to use the 'HOST' device property to fix the devicem rather than the 'NAME' property

Merge

Add layers for pre and post build Split build layer, into bld-production and bld-test sections

Added really basic failure extraction and BRAG calculation to build.

sf-zip-logs - Fixed zipping regression for running smoketest or BC test alone caused by changeset e73243604097 - 'Bug 384 Platform build should output all PDK releasables into one directory'

catchup merge

sf.spec.bccheck.enable - Added comment into common_props.ant.xml to explain how the value is used.

merge

merge

make STAF security reflect all machines on the network

sf.spec.bccheck.enable - Disabling BC check as default, as it's not required after every build and can be kicked seperately using 'sf-test-bc-check' target on a clean machine.

sf.os.compile.iterate property - changed iterate compile check from <isset> to <istrue> so it can be overridden at the commandline or wherever.

Catchup merge

post-build target 'sf-publish' - Fixed publishing regression caused by changeset e73243604097 - 'Bug 384 Platform build should output all PDK releasables into one directory'

fixed STAF_security

merge

added profiles engine wrapper

added atsinterface device for c100725

Updated mechanism to manage Symbian_OS.hrh file to be inline with latest Nokia drop.

OS Services SVS submitted. nearly all done. Removed unneccesary components from mmsvs build

merge

added sendui component

merge

added 'or die' statements to messaging

extra bits

put in rmtree to cleanup properly

merge

additions to the package definition xml

added or die statements

added back name property

added or die statements

Added setting of properties that are common to all (current) platform builds.

merge

merge

further mods to fts package def file

File required to build 50_systemsw.SIS

Files required to build 50_Symbian_T_MidiClientUtility.SIS

Files required to build 50_Symbian_T_MdaAudioToneUtility.SIS

Files required to build 50_Symbian_AudioRecorderUtility.SIS

Files required to build 50_Symbian_AudioPlayerUtility.SIS

Files required to build 50_Symbian_AudioOutputStream.SIS

Files required to build 50_Symbian_AudioInputStream.SIS

Files required to build 50_Symbian_AudioConvertUtility.SIS

Files required to build 50_Symbian_ImageEncoder.SIS

Files required to build 50_Symbian_ImageDecoder.SIS

Use correct s60 config list for sbs check

Add sbs --check to Platform build analysis.

Used ${line.separator} to make (more) echo tasks more readable.

Used ${line.separator} to make echo tasks more readable.

Add execution of fcls4releasenotes.pl in build system.

Required files to build 50_Symbian_Ecom.SIS

merge

submit the various fixes that were made to make multimedia and graphics svs submit to ats properly

Bug 384 Platform build should output all PDK releasables into one directory Added calls to populate the release_metadata with entries for the binaries and tools zips.

Required files to build 50_Symbian_T_Camera.sis

New tcs file added

Empty tcs file removed from the pkg file

Required GraphicsSVS files

Bug 384 Platform build should output all PDK releasables into one directory Zips of md5s now released into the release directory

Bug 384 Platform build should output all PDK releasables into one directory Zips of logs and BOM should be released into the release directory

Required BaseSVS files

merge

added to the package def and fixed multimedia svs with ats

fixed up the ats errors with graphics svs

New pkg files

New pkg files

Added special handling for utilities package, so it's zipped up with the items from the tools layer, rather than as a misc item.

merge

Generate BuildInfo.txt based upon new sf.spec.sbs.variant property

package definition for bc test apps

merge

added my machine

changed multimedia test drop script

.

.

Added back in removable drive scripts and added die statements

Updated analyse_components.pl arguments to use system_model_s60.xml as well as a source of package/component names (required for split model)

Bug 365 build-info.xml - BOM for config & project in different format to sources Regularised \s into /s in the config and project repo paths

Removed conditional around the creation of the build-info.xml - no reason to not do this just because it won't be published later.

Bug 365 build-info.xml - BOM for config & project in different format to sources Fixed the part of the discrepancy: the local revision numbers being included in the BOM output.

Added target to compare the build to the baseline. Initially populated with tasks to create part of the release notes.

updated package properties sf.spec.baseline.location to point at PDK_2.0.e instead of PDK2.0.d

Added test targets 'sf-test-smoketest' and 'sf-test-bc-check' for the test team. They populate the drive, run the tests and zip the output. Minor fix was needed in the post build for zipping: '${build.drive}/output/logs/releaseables' must exist

Fixed RnD content unpacking to ensure that only i9tems in the epoc32 tree are unpacked.

fixed paths in browser.xml

merge

merge

added messaging bc tests

typo

Fixed the initial population of the epoc32 tree with rnd bins to deal with the fact that the zips are in a slightly different location. (cf the changes made for Bug 350) Simplified the way in which the setting of sf.spec.package.src.enable is handled - no need to use it to change the zipping template, just use it to control which parts of the template we invoke.

Avoided zipping up .hg et al in rnd zips. cf Bug 350

merge

Add http download manager tests

Tool for filtering a system model definition.

Bug 350 RnD binary zips missing all content outside epoc32 tree Removed confusing system of *_includefiles.txt appearing in the root of the build drive Also improved generation of release zips and release_metadata.xml to reduce overheads of copying and tweaking for release

Bug 349 R&D kit zip file naming convention not followed

Merge

Export all required .hrh files

New Landmarks Search BC tests

bctest drop added

BCTest drop added

ATS worker target is made.

catchup merge - tag for PDK2.0.e

Added tag PDK_2.0.e for changeset cc2965329dd1

New Landmarks Database Management BC test

added newsoapclasses to web service tests

Add clock tests

New set added

New set added

ATS target made.

adding browser tests

Added new web service BC tests

Update script header commnets Add system software tests

New BC tests

merge

added send ui dynamic bc tests

Merge

Set Diamonds category to <job name>_<codeline>

Add FBF documents for default config that built PDK 2.0.e

merge

Add DRM test

merge

added bc tests for profiles engine

Add speed dial tests

merge

Sorted the issues with vCard tests and made sure they worked.

added the missing test data for vcard

Added vcard import export tests

changed the ats server machine name

xml named wrongly

Added Pbk UI Utils tests

merge

Add contacts/phonebook tests Add stif winscw udeb platform

Arnaudl: Added build machine v800017.

enabling dynamic bctest

Removed unnecessary target. Moved over-arching targets around to put them together.

Restructure sf-prebuild to ensure that sf-build-all doesnt invoke sf-prep.

Merged

Caught up

removed build id

sorted out the removal

renamed to graphicssvs.xml

Build machine registration files removed.

casing

missing file extension plugin

missing from zip manifest

added missing file system plugin

Removed another removable drive test

Removable drive tests 'removed'!

testfontws.gdr wasn't in there

added 'general' dir to file path

Added base SVS tests

enabling static bctest

Separated download of baselines, syncing of source and "diamondizing" the BOM into completely separate targets.

Moved tasks for generating config and project BOMs into their own target so they can be tested independently, and simplified them slightly also.

Updated the mechanism for the conditional execution of sf-diamods-tag-build

Add SBS retry controlled by sbs.spec.sbs.retry.limit property. Default is 5.

changed test section

catchup merge

bldmefirst fix for symbian^2 symbian^3 builds - getting location of symbian_OS.hrh and variant.cfg from the project config.

Add dependency for sf-prep on sf-prebuild

Default BuildEnv.xml file can now be overridden by one delivered in FBF project. Check can also be skipped by setting sf.suppress.buildenv.check property.

Bug 299 populateziptemplate.pl aborts if it cannot determine the license for a source component Source that cannot be sorted correctly into any other category is treated as "misc"

Changed to avoid warnings during construction of packaging instructions.

Merge

Arnaudl adding work done by Darios on raptor summarise.

Merge.

Add raptor build html summary computation

Brag script 1st draft by Arnaudl and DarioS

Test targets seperated from "build.postbuild.xml" and put into "build.test.xml"

Bug 299 populateziptemplate.pl aborts if it cannot determine the license for a source component Changed so that even if it encounters an error it will still generate the output file before it exits with a failure error code.

catchup merge

catchup merge

renamed 'sf-tag-build' to 'sf-diamonds-tag-build' to stop unneccessary confusion with source tagging...

catchup merge

platform build - first cut of 'bldmefirst' stage to get rid of bldmefirst repo. Should probably add a check to see if it's enabled.

Moved project type specification from common config file to platform/package specific config file.

Changed regular expressions and temp files to be more agnostic about build ID conventions.

Bug 289 Issue in populatezip.pl when doing Platform build in step preprocess-zip-config

Adjusted matching for processing TSV files, so it will not fail even if the dir has not been created.

Truclean should not be performed if the sources.csv line doesn't have a sysdef field

Merge

Set Raptor -j option to 2 for package builds

Added disk space check for all builds. Made the platform build configurable via props and refs in the same way that the package build is.

First drop of script to generate build summary

=Merge

Enable analysis of Raptor warnings. Publish to Diamonds

Merge

Fix packaging source optimization does not work for package builds

Moved all targets specific to the postbuild phase of the build into the postbuild ant file.

Created framework for separating postbuild related activities into a separate file.

Moved comments around to be adjacent to the thing that they're describing.

Added Build environment check feature

platform build temporary patch - overidden sf-build-noprep to not generate the model from the fragments. Needed for split model builds and furhter work on simplifying model.

catchup merge

BOM fix - Changed to reading project location ${sf.project.location} instead of ${sf.config.dir}/../build/config, which isn't always correct.

catchup merge

Smoketest change - Added 'sf-find-ATS-worker-root' to build.xml so that the smoketest goes where the worker is expecting it on a individual basis, rather than it being hardcoded to D:\ATS\...

ATS testing on emulator - Renamed properties for lon-engbuild87, lon-engbuild89, and sym-build02 so they are the same as the machine name. Modified the TEMPDIR for c100726 so that it runs smoketests

sf-list-dir - added new tool 'listdir.py' which can exclude a directory and changed the behaviour of sf-list-dir to stop scanning epoc32/build to speed things up.

sf-postbuild - running analysis in parallel with evalid and post-build zipping.

Merge

Simplify the create-canonical-sysdef-file target as we can depend on there only being a single sysdef in the supplied reference.

Simplified create-canonical-sysdef-file so that it's just a simple copy.

Merge

Un-hardwired an interim location for the system definition. Removed a target that is over-ridden in both the platform and package specific files.

Added output of the package definition incorporated for each package.

Added some diagnostic output when the system definition is built from the sources.csv file.

Commented out clean and tools targets. Changed tool2 target into tools2_rel

Removed commented & obsolete code.

Changed preference for selecting package definition files, so that it takes the one from our tree in preference to the one in the package itself. This means that we can just delete items from our tree when we're happy to switch to using the one in the package (as this will vary from package to package). Added sorting of the attributes when outputting the system definition, to match the de facto standard in the system definition we started with.

Add new raptor error category to raptor parser (tool_didnt_return_version)

Set project name and codeline from subproject only if these properties are not found in project's job_props.ant.xml

Merge

Fix again releaseables dir not existing as erroronmissing dir is not supported

If a package does not have a definition in the sources.csv then it won't get built, so don't try to incorporate it into the system definition.

Avoid build failure if releaseable dir is not present

Made error messages more useful.

Should fail the build if we can't generate the system model.

Fixed paths and drives for executing script.

Added invokation to build.xml and adjusted path to backup locations to match my development environment.

Added tool for collating a build definition from the set of package defintions indicated by the sources.csv Location of tree of package defintions will need to be adjusted...

Change package baseline to PDK 2.0.d

Added 3 raptor error categories, adjusted severity of all categories

Fix regexp to take account of new codeline naming convention

Allow subprojects within a project repo and model file relative to the subproject dir

Generate error and summary file even if build reports no error

Restructured package build targets and sbs calls

Reverted category-property to build.family

Enable build tagging on Diamonds (default: 'test')

Fix to account of log file names for test builds

Added transformation of model file from version 3.0.0 to a version usable by Raptor

change made in smoketest.xml

change made in ats3_specialise_test_drop.pl script.

Add my computer following ATS installation instructions found at: https://sites.google.com/a/symbian.org/build_and_test/Home/ats-automated-test-system/ats-howtos,

changing smoketest.xml

catchup merge

Changed 'publish' to 'sf-publish' to only publish the zips, not all logs. Changed behaviour so that 'sf.spec.package.src.enable'=false stops the source repos from getting packaged, but not the RnD ones (which are extracted again in platform builds)

source syncing ftl - Added 'sf.spec.sourcesync.archive' preference to do 'hg archive' instead of 'hg sync'. If set and the repo sync is s'posed to be synced by tag it still does the slower clone+update behaviour.

platform build - added 'sf.os.compile.iterate' variable to iterate though the main targets rather than all at once to work around raptor problems with single model.

Split sf-run-analysis into bit-sized targets, which can run in parallel to reduce the post-build time on a platform build.

catchup merge

minor fix - creation of 'generated' dir for caching files.

raptor parser.pl - adding XML::SAX perl modules (public domain code - http://www.saxproject.org/faq.html) so we don't have to patch up every single build machine.

merge

Add syslibssvs ats test drop creation script

ats change

Add multimediasvs ats test drop creation script

updating smoketest.xml

updating to add build-id for diamond in build.xml

Zip BOM and releasables changing the top level folder from "output" to "build_info"

updating ATS

updating device reg. file

Making device property file

Making device property file

updating security file for ATS

Caught up

Created Graphics Perl script to create package and finished adding to test XML

Reference to the Font Store API Server

Added graphics test.xml

changing "sf.spec.test.host.name" to "v800005" as ats server.

catchup merge

Yarp.pl - Added manual XML parsing. Memory leaks using XML::Simple cause perl to run out of memory when parsing a large raptor log.

Updating ATS security file.

catchup merge

catchup merge

Yarp - Modified to output failed recipes to STDOUT instead of having to use dump_recipe_at_line.pl, and modified build.xml to save these logs.

Added a new "sf.os.compile.fast" parameter to skip redundant steps when executing the builds in separate config targets.

Make ATS drop path by UNC not mapped drive.

Fixed smoketest perl target.

Move to classicui folder

Fixed usage of 7z in ats_specialise_test_drop.pl

smoketest creation - .pl files not always executable on build machines.

merge

Add keyevent test at end of apploader test suite to remove prompt for location/time settings Remove redundant batch file. Use perl script instead.

Caught up from mercurial_development

Added step to submit Dynamic BC tests to ATS server

reverting change

reverting the change

Fixed FBF management of single build.

Merge to tip

SYM-BUILD02 had wrong tempdir, should have been D

Added my machine to STAF_Security

merge

Passing diamond build-id as parameter for ats_specialise_test_drop.pl to insert build-id tag in test.xml

adding tags to enable diamonds post.

create tag for PDK2.0.d

Make BC testing more robust. Now requires PDT_HOME env var to be set rather than fail silently. Plus Logs zip tidy up.

Add zipfile validation to packaging

Fix packaging issues. Released zips now delivered in zips\release folder.

Merge

Added creation of zips of zips of OSS packages (though these are not yet published in a PDK release). Updated names of zips of zips of SFL packages to avoid clashing with the ideal long term name of the zips of zips of OSS packages.

Added tweak for bldmefirst zip filename

Small speed improvement (fingers crossed) for zipping up binaries.

Small tweak to get the right content with the right filename for doing a PDK release. Corrected some indentation.

Stopped it putting useless information about zips of zips into the release_metadata.xml file.

Create zips of zips for SFL src.

Merge

Raptor error analysis to be published to Diamonds

Added analysis of Raptor errors

BOM and TSVs now zipped up in an alternative zip file. Zip files renamed to fit in with other published build files.

Corrected filenames used for logging output of zip commands.

Zips binaries into three zips rather than one, to make them easier to download.

Simplified the locations of some generated files, so they are created where they need to be rather than created on one place and moved to another. Zipping of binaries now assumes that there's always an rnd exclude file, as it is always created by populateziptemplate.pl, even if there's nothing put into it.

Added sorting and removal of duplicates from TSV files.

Merge

Raptor parser to provide summary csv file so that faults can be readily put into db

Updated preprocess_log to deal with mal-formed <archive> tags - workaround for Bug 170. Also re-jigged to use STDIN and STDOUT rather than filename options on the CLI.

Modularized Raptor parser scripts

generate-layer overridden target from platform/build.xml to common/build.xml

Adding truclean step to the package build

Add sdk version file for 5.0 run

Move runtarget outside if conditional

Fix cenrep to run for both single and split model builds

Use GENERIC interface on ATS server and add machine name to test package to aid origin

merge

Remove redundant files Add missing files for bctestlist suite

Add all tests

Remove extra column

Add branch and changeset support for getting source. BOM sources.csv can now be reused directly.

Find_collisions.pl - modified tool to use 'FC' instead of 'diff' for finding origins. (gcc 'diff' not currently in builds)

catchup merge

Build HG Caching - added new variable 'sf.spec.sourcesync.cachelocation' and changed caching invocation to use it. Defaults to previous location.

cachefiles.pl - stopped cache from being excessively flattened, which could cause problems.

Add delay to give expected processes a chance to start

Add tools baseline to BOM

Merge

Integrate extraction of whatlog info and other minor changes from pkgbuild config

Adding extraction of whatlog information into "deliverables" files

Changed PDK to 2.0.c

Fix log zip structure, fix udeb/urel issue in MD5s and also package MD5s into zip in correct epoc32\relinfo layout

Enable build machine based testing via ATS worker

Tag source matching PDK_2.0.c

Fixed single model genxml pre-processing workaround to enable single system definition builds. Added "tools" and "adaptation" to the list of packages to be prepended by sf where needed.

Tidy up generate-layers and add missing quote

merge diamondize and dynamic bc testing

merge using wildcard on destination removes all of destination not just src files

Add option for dynamic bc testing

Export build-info.xml to BOM folder

Export system model files to BOM folder

Merge commit

Rollback the removal of overriden generate-layers target - required platform build

Adding ATS device registration files

Catchup from platform build

Fix for Error doesn't correctly report the number of failing raptor recipes

Added output stream to failures line in yarp. Made the failure string more robust

Yarp file parser to get number of failures from the correct field

Yarp to print failures

Commented out print line

Moved location of build results to \\v800008\g$

Add missing file pare_yarp_files.pl

Add missing files for yarp publishing to diamonds

Added yarp to diamonds publishing

Initial implementation of publishing to Diamonds

Catchup from platform build config

Changed location of PDK

Changed location of source code to point to v800008.ad-sfpd.intra

Catchup from platform build config

Catchup from default config

Disabled tagging after build by changing default value to false

Changed PDK and filter options to get PDK_candidate_1 binaries

Made smoketest optional

Changing default value of sf.spec.smoketest.enable to false

New version of make_junction.pl

First drop of smoketest support

Setting sf.spec.logs.raptorfilter.enable by default to true, as this will enable the full log and also the scanlog html report in the build results

Reimplemented --check as the previous version didn't work (also most of the arguments are parameterized now)

Doing WHAT with .whatlog. Added check with an exec task (some arguments are not parameterized).

added whatlog and check

Changed default location for logs/results to \\sym-build01\f$\SF_builds

Changed common default for sf.spec.systemdefinition.assemble to false

Changed location of PDK to \\lon-engbuild87\d$\PDK\PDK_candidate_0

Changed --check to CHECK to see if it works

Given a dummy value to the configuration list

Added check stage

Merge

Changed package-common method of baseline retrieval

Changed package-common location of baseline to \\lon-engbuild98\d$\GRACE\PDK_20090401

Overridden gernate-layers, so that sysdef file is not filtered

The prefix "hlm" for element "hlm:argSet" was not bound.

Changes to support clean check and avoid filtering the logs

Download of "emu" and "patch" baseline zips common to all packages

merge in changes

Packaging change - Tools now zipped into 'tools_epoc.zip', which isn't 'emu' but 'tools' for package and platform builds. Should work when we update the metadata.

Added Hg local cache management feature.

Tidy up smoke test ats file Add BC ats files

Remove the "abld import" stuff, add "No rule to make" and "Can't find mmp file" processing

Limit source parallelisation to NUMBER_OF_PROCESSORS

Clear list as we dont want to exclude anything from RnD unpack

Build smoketest as udeb plus ensure that sf-postbuild is run for sf-build-noprep.

Add the missing column heading in PkgComponentAnalysisSummary.csv

Added new helium target: 'sf-build-and-pack' for use if you need to babysit 'sf-prebuild'

Smoketest fix - changed ip address to point to symbuild01, caused by machines moving.

rebuildok.txt - removed 'epoc32/tools/*' for build machines with no vc6 compiler, so all the tools get unzipped in 'sf-unpack-rnd'.

parsewhatlog.pl - put back in the regex 1-liner what got taken out (multiple 'master' repos out of sync)

'WHAT' build removed. parselistdirs.pl fixes for raptor logs.

'sf-unpack-rnd' target: changed to overwrite mode, due to TEF being present earlier in build.

Results Publish - changed network location from \\lon-engbuild87\SF_Build\ to \\v800008\SF_build\

Applied the /accepteula option to all calls to junction so that it will never stall a build waiting for the user to accept the EULA,

Amend STAF machine trust levels to waive intranet component

Committing merges

Adding global STAF security settings file

merged in parsewhatlog.pl defect fix for Raptor 2.7.2 and find_collisions.pl minor arg cleanup.

find_collisions.pl - removed unused command-line argument from script to tidy things up.

parsewhatlog.pl - regex bug fix for raptor 2.7.2

Reorder the PkgComponentAnalysisSummary.csv columns, and change "KO" to "Bad".

Remove files that are not in test package

Merge changes

Add <sf-getenv-tools> target to unpack tools baseline and also <sf-build-smoketestpkg> to create smoketest package to be sent to ATS3 server

Add MD5 creation

Added yarp to the post-build analysis

Fixed typo. $-sign should have been &

Added yarp.pl - (Yet Another Raptor Parser) and dump_recipe_at_line.pl Usage for yarp.pl: perl yarp.pl <compile_log> <output_csv> Usage for dump_recipe_at_line.pl: perl dump_recipe_at_line.pl <compile_log> <line|line_list_file> The idea of dump_recipe_at_line.pl is so you can take a column of line numbers from the CSV created by yarp and see what happened (without having to open the 300MB file) with a single column: ... 226242 ... you get: ... 226242 <recipe name blah blah blah... ... With two columns in the file, you can have some more readable output: ... 226242 m:/sf/mw/classicui/group/bld.inf ... you get: ... m:/sf/mw/classicui/group/bld.inf(226242): <recipe name blah blah blah... ...

Catch up

Add perl script to build test zip Remove unwanted files for smoke test

merge

Comments and code tidying for ats3_testdrop.pl Adding new ATS support script ats_specialise_test_drop.pl

.xml missing from file names Add option to exclude header/library BC static checking

File was rendered obsolete a long time ago

Added analyse_components.pl and related call to build.xml Modified merge_csv.pl to use "7za" instead of "7z"

Remove duplicates from rebuiltok list

catchup merge

adding merge_csv_orphans.pl Untrusted at the moment

Added merge_csv_orphans.pl - Would just change merge_csv.pl but I've been hacking and don't trust it yet.

Merge to default branch

Exclude list of things from RnD unpack that we know we can build

merge - catch up

Add optiona BC checking to build process

Merge of change to merge_csv.pl change. Caused by moving of the Repo: No files changed.

merge_csv.pl - Added an optional post-build rnd zip argument which adds a timestamp field to the CSV. Requires '7z' not '7za'.

Add ats local winscw device Add tool to build ats amoketest package

Remove abld.bat - generated during build

merge - catch up

Add first draft of smoketests

Use 7za not 7z as this is what is available on build machines

Merge to default branch

Move analysis after packaging

Adding license boilerplate to perl scripts.

Add zip tool to support postbuild RnD packaging.

Add postbuild RnD packaging. Add .whatlog to os tools build.

Merge changes to default branch

Unpack actual RnD zips rather than fastcopy. Add build collisions tool to <sf-run-analysis> target.

Added license header

Merge

Added filter to exclude Hg control files from package zips.

Fixed minor bug in ats3_testdrop.pl: Quote marks within quotation needed to be escaped.

Disable hg tagging by default

Fix test property typos

Fix populateziptemplate.pl to work with new repo structure

Added find_collisions.pl Updated the readme.txt for instructions.

parselistdirs.pl - fixed export scanning and added output path for logs. - 'uptodate' export scanning looks in all logs, not just 'clean' ones. - Exported is a new group, and those exports have been removed form other groups. - Logs output path flexiblility improved - The following are now the same: I:\logs\generated>perl parselistdirs.pl ..\ >list_results.log I:\>perl logs\generated\parselistdirs.pl logs\ logs\generated\ >logs\generated\list_results.log

Add ATS test client target <sf-send-testpkg> to default configuration. Default is off.

Merge updates from master

Add build analysis tools to <sf-run-analysis> target. All output generated in <logs>\analysis dir.

Fixed "zip.cfg.xml.ftl.template" to use "oss" and not "epl" in the configuration name.

Merge with previous modifications.

Modified populateziptemplate.pl to use "oss" instead of "epl" keyword.

Exclude .hg repositories from epoc32 merge