<?xml version="1.0" encoding="utf-8"?>

<!-- Copyright (c) 2007-2010 Nokia Corporation and/or its subsidiary(-ies) All rights reserved. -->

<!-- This component and the accompanying materials are made available under the terms of the License 

"Eclipse Public License v1.0" which accompanies this distribution, 

and is available at the URL "http://www.eclipse.org/legal/epl-v10.html". -->

<!-- Initial Contributors:

    Nokia Corporation - initial contribution.

Contributors: 

-->

<!DOCTYPE concept

  PUBLIC "-//OASIS//DTD DITA Concept//EN" "concept.dtd">

<concept id="GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C" xml:lang="en"><title>What

is Network Performance Testing? </title><shortdesc>The Network Performance Test suite (<i>NetPerf</i>) allows tests

to be run that use the Symbian platform Communications Framework.

The purpose of the <i>NetPerf</i> is to measure and report the performance

of the Symbian platform Communications Framework. </shortdesc><prolog><metadata><keywords/></metadata></prolog><conbody>

<p>The tests can be run on mobile devices or hardware reference boards. A

series of tests can be combined into a single script. The script is executed

and the results analysed. Device creators and application developers use the

test results to analyse and optimise network performance on their hardware.

These tests are repeated on the same hardware to show the effects of optimisation

and configuration changes. The tests can be run on different hardware to provide

a benchmark. </p>

<p> <i>NetPerf</i> provides a common basis for collaborative work on network

performance between Symbian and the device creators or application developers. <i>NetPerf</i> is

designed to run on <codeph>H2</codeph> and <codeph>H4</codeph> hardware reference

boards. <i>NetPerf</i> does not run on the emulator. The tests represent the

relative network performance that can be achieved by Symbian platform-based

devices. This gives device creators a benchmark for their own hardware and

adaptations. Device creators can apply the same test program and scripts to

different devices to categorise them. </p>

<p> <i>NetPerf</i> is driven by a <xref href="GUID-4D55E43C-B203-5145-9105-D75660D02E3B.dita">configuration

file</xref>. The configuration file specifies tests in terms of rate, direction

and packet size. This allows the test suite to emulate voice streams. This

fulfils a common device creator request for information on the behaviour of

the network stack when streaming voice packets. It does not emulate the end-to-end

use case completely as there is no voice call control signalling. </p>

<section id="GUID-21250CAF-01ED-483D-8D2E-F2AB3CCA6EE6"><title>NetPerf test suite components</title> <p>The following are

the <i>NetPerf</i> test suite components: </p> <ul>

<li id="GUID-F3837338-DCC6-5AC8-AA92-2C978A6AA062"><p> <xref href="GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C.dita#GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C/GUID-006E5816-65F0-50D4-80BD-CAA1D2408FF2"> UCC</xref>  </p> </li>

<li id="GUID-A23AD4CE-8613-5009-8060-005121060BB6"><p> <xref href="GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C.dita#GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C/GUID-71E8B043-2917-5B77-B055-D0D366095905">TestExecute also known as TEF</xref>  </p> </li>

<li id="GUID-79553BF1-7488-514D-8D63-11A1FF4E505E"><p> <xref href="GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C.dita#GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C/GUID-71B269BB-9A4A-57D4-A558-858A0492D416">TestExecute UCC plug-in</xref>  </p> </li>

<li id="GUID-DCBA552D-78EA-5EDC-9271-1D8D016DF447"><p> <xref href="GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C.dita#GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C/GUID-BDD35AF3-DDE6-5E23-9CD1-20C9EB96B0D1">TestDriver</xref>  </p> </li>

<li id="GUID-4F3460F0-F8BC-5033-943B-B1A987EF5BF3"><p> <xref href="GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C.dita#GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C/GUID-BFB52F4C-E85A-5EAE-8F06-A54E117896D2">NetPerf.pl</xref>  </p> </li>

<li id="GUID-989DD78D-9D50-5293-A5D2-6E1513F86610"><p> <xref href="GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C.dita#GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C/GUID-B10A2F17-A7CD-5770-81C6-D2F60581484B">Delay Meter library</xref>  </p> </li>

<li id="GUID-CB48AD6A-3879-5252-B8F3-F3768DC66E80"><p> <xref href="GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C.dita#GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C/GUID-A9AC1C30-3661-5C2D-9469-29D65459314D"> TestExecute NetPerf plug-in</xref>  </p> </li>

<li id="GUID-41F2CAC9-117C-5B02-94ED-0B5BF20B4675"><p> <xref href="GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C.dita#GUID-D1B54263-1637-5D4E-8FE1-92612AB2851C/GUID-ECB33906-F3C5-5B57-874A-3D2D9B0B3963"> Sampling profiler</xref>  </p> </li>

</ul> <p><b>UCC </b> </p> <p> <i>UCC</i> is a daemon on the <i>Test Controller PC</i> that

performs actions driven by a script on the Device Under Test <i>(DUT)</i>. <i>UCC</i> is

part of the <i>PDT</i>. </p> <p><b>TestExecute also known as TEF </b> </p> <p> <i>TEF</i> is the Symbian

test script engine. <i>TEF</i> is part of the <i>PDT</i>. </p> <p><b>TestExecute UCC plug-in </b> </p> <p>This is a plug-in which allows the <i>DUT</i> to

launch services and make remote procedure calls on remote PCs, in particular

the <i>Test Controller PC</i>. The <i>TestExecute UCC plugin</i> is part of

the <i>PDT</i>. </p> <p><b>TestDriver </b> </p> <p>This is a <i>Test Controller PC</i> tool which

uses <i>STAT</i> to invoke <i>TEF-based</i> tests, and collect the results.

This allows tests to be driven from the <i>Test Controller PC</i>. The <i>TestDriver</i> is

part of the <i>PDT</i>. </p> <p><b>NetPerf.pl </b> </p> <p>This is a <i>Test Controller PC</i> script which: </p> <ul>

<li id="GUID-B79DFB91-2AEB-5C9D-9367-FB7EF1E5E43F"><p>generates the appropriate <i>TEF</i> scripts

from the supplied configuration file </p> </li>

<li id="GUID-E3EAA3C2-AD51-50E4-A745-64BF77161033"><p>invokes <i>TestDriver</i>  </p> </li>

<li id="GUID-548D295D-FD1D-5FCB-AC02-4E3783AFE5EF"><p>post-processes the <i>TEF</i> logs

to create a summary <i>CSV</i> file. </p> </li>

</ul> <p><b>Delay Meter library </b> </p> <p>This is a plug-in layer for the communications

framework that measures delays to the Bearer. </p> <p><b>TestExecute NetPerf plug-in </b> </p> <p>This plug-in performs the following: </p> <ul>

<li id="GUID-2AE9F834-9098-5258-86B8-F937DD59B94A"><p>Sends data packets </p> </li>

<li id="GUID-D9BC6822-08FA-59E1-A250-96BBE0EBFE3D"><p>receives data packets </p> </li>

<li id="GUID-57C4B11F-F890-5E42-9DCE-01E9FFF284A9"><p>collects metrics, these

metrics are known as throughput or jitter </p> </li>

<li id="GUID-194CCCEA-AC69-553A-AA4F-F20665952471"><p>CPU usage meter </p> </li>

</ul> <p>If the <i>Delay Meter</i> library is configured, it collects and

reports delay measurements. </p> <p><b>Sampling profiler </b> </p> <p>An optional component on the <i>DUT</i>,

the <i>Sampling profiler</i> produces a log of the execution time spent in

each function in the system. This allows the users to find any processing

bottlenecks and identify possible optimisations. </p> </section>

<section id="GUID-4E66FF6D-F3FC-4766-BA6F-FF196F715100"><title>NetPerf test mode</title> <p>The <i>NetPerf</i> tests can

be run in two modes: </p> <ul>

<li id="GUID-9229E4A5-3BB9-5508-A8F0-58E895FE0E1B"><p>Fully automatic - tests

are started and controlled by the <i>Test Controller PC</i>. </p> </li>

<li id="GUID-353B71C8-B5F2-54D1-89FB-E0A4CA69BD2C"><p>Semi-automatic - tests

are built on the <i>Test Controller PC</i> and transferred to the <i>DUT</i>.

The <i>DUT</i> runs the tests. Results are copied back to the <i>Test Controller

PC</i> for analysis. </p> </li>

</ul> </section>

<section id="GUID-CD3B9054-17C4-4519-A242-7959D2C2B8E2"><title>Bearer Configuration</title> <p>Bearer configuration is to

set up the communication bearers between the <i>DUT</i>, <i>Test Controller

PC</i> and <i>Network Monitor PC</i>. The <i>NetPerf</i> test suite uses two

separate communication channels: control channel and bearer channel. These

two channels can be merged into one bearer. </p> </section>

</conbody><related-links>

<link href="GUID-B7A40638-BA80-5175-B23D-2F3964C274A0.dita"><linktext>Goals of

the Comms Architecture</linktext></link>

<link href="GUID-72F3CFD2-DDE4-56F1-907A-7C455BEDF674.dita"><linktext>Running 

               the NetPerf Test Suite</linktext></link>

<link href="GUID-5CDD2D09-33B2-501B-A060-784C401CA373.dita"><linktext>Building

a ROM for Development Board</linktext></link>

<link href="GUID-C2125B4A-A945-529C-AA2F-BDD00EADF489.dita"><linktext>Configuring

the Communications Database for the                 DUT</linktext></link>