[[TracNav(WARPLab/TOC)]]

= WARPLab 7: Benchmarks =

In order to get a better understanding of WARPLab performance, we have added [wiki:Reference/Utility/#wl_benchmark wl_benchmark] so that you can perform some basic performance testing on WARPLab setup.  

For the WARPLab 7.3.0 release, we have provided some Ethernet performance benchmarks since one of the biggest bottlenecks is moving data into and out of the node.  


== Ethernet Performance ==

As part of our on-going development to make WARPLab better and faster, we have introduced a new [wiki:WARPLab/Framework/Modules#Transport Transport] (ie, the [source:ResearchApps/PHY/WARPLAB/WARPLab7/M_Code_Reference/classes/wl_transport_eth_udp_mex.m WARPLab MEX UDP Transport]) to boost communication performance between a host and a node.  For more information on how to install and set up the WARPLab MEX UDP Transport, please refer to the [wiki:WARPLab/QuickStart QuickStart Guide].

=== Hardware and Software ===

  * Netgear ProSafe 5-port Gigabit Desktop Switch (GS105)
  * PC Hardware
    * Dell Optiplex 790 
    * Intel Core i7-2600 3.4 GHz
    * 16 GB RAM
    * Window 7 Professional SP1 64-bit
    * Intel 82579LM Gigabit Network Connection
      * Configured to support Jumbo Packets of up to 9014 Bytes
  * PC Software
    * Matlab 7.12.0 (R2011a)
    * Microsoft Visual C++ 2010 Express (compiler for MEX)
    * Microsoft Windows 7 SDK
[[BR]]
=== Procedure ===

  * Download Reference bit stream w/ iMPACT
  * Open MATLAB
    * Set current folder within MATLAB to the M_Code_Reference folder of the appropriate WARPLab release
    * Run the following commands
      * wl_setup
        * NOTE:  This allows us to configure the Transport type and the Ethernet Packet Size
      * nodes = wl_initNodes(1)
      * results = wl_benchmark( nodes, 'write_iq', 10000, 'max' );
      * results = wl_benchmark( nodes, 'read_iq', 10000, 'max' );
[[BR]]
=== Results ===

''' WARP v3 Hardware '''
{{{
------------------------------------------------------------------------------------------------------------------------------------
|  ID |  WLVER |    Serial # |   Transport | Pkt Size (B) | Num Samples | Num Trials | Avg Write IQ per sec |  Avg Read IQ per sec |
------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.3.0 |  W3-a-00027 |  WL Mex UDP |         1464 |       32768 |      10000 |             210.4994 |             232.6682 |
|   0 |  7.3.0 |  W3-a-00027 |    Java UDP |         1464 |       32768 |      10000 |              17.0187 |              16.9429 |
|   0 |  7.1.0 |  W3-a-00027 |    Java UDP |         1464 |       32768 |      10000 |              16.9390 |              16.6640 |
------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.3.0 |  W3-a-00027 |  WL Mex UDP |         8960 |       32768 |      10000 |             445.8885 |             466.6237 |
|   0 |  7.3.0 |  W3-a-00027 |    Java UDP |         8960 |       32768 |      10000 |              82.0430 |              71.2319 |
|   0 |  7.1.0 |  W3-a-00027 |    Java UDP |         8960 |       32768 |      10000 |              73.1989 |              44.6655 |
------------------------------------------------------------------------------------------------------------------------------------
}}}




''' WARP v2 Hardware '''
{{{
------------------------------------------------------------------------------------------------------------------------------------
|  ID |  WLVER |    Serial # |   Transport | Pkt Size (B) | Num Samples | Num Trials | Avg Write IQ per sec |  Avg Read IQ per sec |
------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.3.0 |         N/A |  WL Mex UDP |         1464 |       16384 |      10000 |             128.1127 |             133.0076 |
|   0 |  7.3.0 |         N/A |    Java UDP |         1464 |       16384 |      10000 |              32.9602 |              31.1658 |
|   0 |  7.1.0 |         N/A |    Java UDP |         1464 |       16384 |      10000 |              32.5807 |              22.0276 |
------------------------------------------------------------------------------------------------------------------------------------
}}}