wiki:WARPLab/Benchmarks/WARPLAB_7_5_0

WARPLab 7.5.0: Benchmarks

NOTE: The Ethernet performance benchmarks below were done on a single buffer read_iq:

  • rx_IQ = wl_basebandCmd(node, [RF_RX], 'read_IQ', 0, rx_length);

Hardware and Software

  • Netgear ProSafe 5-port Gigabit Desktop Switch (GS105)
  • PC Hardware
    • Dell Optiplex 790
    • Intel Core i7-2600 3.4 GHz
    • 16 GB RAM
    • Window 7 Professional SP1 64-bit
    • Intel 82579LM Gigabit Network Connection
      • Configured to support Jumbo Ethernet Frames of up to 9014 Bytes
  • PC Software
    • Matlab 7.12.0 (R2011a)
    • Microsoft Visual C++ 2010 Express (compiler for MEX)
    • Microsoft Windows 7 SDK


Procedure

  • Download Reference bit stream w/ iMPACT
  • Open MATLAB
    • Set current folder within MATLAB to the M_Code_Reference folder of the appropriate WARPLab release
    • Run the following commands
      • wl_setup
        • NOTE: This allows us to configure the Transport type and the Ethernet MTU Size
      • nodes = wl_initNodes(1);
      • for i={'read_iq', 'write_iq'}
        • results = wl_benchmark(node, i{1}, 1024, 2^15)
        • results = wl_benchmark(node, i{1}, 1024, 2^16)
        • results = wl_benchmark(node, i{1}, 1024, 2^17)
        • results = wl_benchmark(node, i{1}, 512, 2^18)
        • results = wl_benchmark(node, i{1}, 256, 2^19)
        • results = wl_benchmark(node, i{1}, 128, 2^20)
        • results = wl_benchmark(node, i{1}, 64, 2^21)
        • results = wl_benchmark(node, i{1}, 32, 2^22)
        • results = wl_benchmark(node, i{1}, 16, 2^23)
        • results = wl_benchmark(node, i{1}, 10, 2^24)
        • results = wl_benchmark(node, i{1}, 10, 2^25)

NOTE: The reduction in the number of trials was to keep the total wall time of the experiment reasonable. There is no reason that each benchmark cannot be run more times for a better average.


Results

WARP v3 Hardware

MEX Transport

  • NOTE: All times are in milliseconds
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  ID |  WLVER |    Serial # |   Transport | MTU Size (B) | Num Samples | TX/RX Time (ms) | Num Trials | Avg Write IQ Time (ms) | Avg Transfer Speed (Mbps) | Avg Read  IQ Time (ms) | Avg Transfer Speed (Mbps) |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |        1024 |            0.03 |      10000 |                   0.76 |                     42.88 |                   0.71 |                     46.39 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |        2048 |            0.05 |      10000 |                   0.85 |                     76.75 |                   0.82 |                     79.52 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |        4096 |            0.10 |      10000 |                   0.94 |                    139.93 |                   0.92 |                    143.00 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |        8192 |            0.20 |      10000 |                   1.15 |                    227.58 |                   1.01 |                    260.84 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |       16384 |            0.41 |      10000 |                   1.56 |                    335.32 |                   1.32 |                    398.41 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |       32768 |            0.82 |       1024 |                   2.33 |                    450.57 |                   1.87 |                    562.07 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |       65536 |            1.64 |       1024 |                   3.87 |                    541.84 |                   2.93 |                    714.70 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |      131072 |            3.28 |       1024 |                   6.53 |                    642.16 |                   5.07 |                    827.28 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |      262144 |            6.55 |       1024 |                  11.86 |                    707.13 |                   9.43 |                    889.89 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |      524288 |           13.11 |       1024 |                  23.06 |                    727.53 |                  18.23 |                    920.41 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |     1048576 |           26.21 |       1024 |                  45.35 |                    739.91 |                  35.49 |                    945.34 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |     2097152 |           52.43 |        512 |                  89.57 |                    749.27 |                  69.70 |                    962.83 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |     4194304 |          104.86 |        256 |                 177.82 |                    754.81 |                 138.47 |                    969.30 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |     8388608 |          209.72 |        128 |                 354.25 |                    757.76 |                 275.78 |                    973.37 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |    16777216 |          419.43 |         64 |                 707.88 |                    758.42 |                 550.34 |                    975.52 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |  WL Mex UDP |         8962 |    33554432 |          838.86 |         32 |                1412.10 |                    760.39 |                1099.34 |                    976.72 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Java Transport

  • NOTE: All times are in milliseconds
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  ID |  WLVER |    Serial # |   Transport | MTU Size (B) | Num Samples | TX/RX Time (ms) | Num Trials | Avg Write IQ Time (ms) | Avg Transfer Speed (Mbps) | Avg Read  IQ Time (ms) | Avg Transfer Speed (Mbps) |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |        1024 |            0.03 |       2048 |                   1.78 |                     18.41 |                   1.91 |                     17.11 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |        2048 |            0.05 |       2048 |                   1.92 |                     34.22 |                   2.12 |                     30.88 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |        4096 |            0.10 |       2048 |                   2.68 |                     48.95 |                   2.94 |                     44.55 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |        8192 |            0.20 |       2048 |                   4.20 |                     62.36 |                   4.44 |                     58.98 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |       16384 |            0.41 |       2048 |                   7.16 |                     73.22 |                   7.37 |                     71.17 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |       32768 |            0.82 |       1024 |                  12.77 |                     82.10 |                  12.61 |                     83.18 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |       65536 |            1.64 |       1024 |                  23.81 |                     88.07 |                  23.50 |                     89.25 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |      131072 |            3.28 |       1024 |                  45.83 |                     91.51 |                  46.35 |                     90.50 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |      262144 |            6.55 |        512 |                  90.91 |                     92.27 |                  91.44 |                     91.74 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |      524288 |           13.11 |        256 |                 180.72 |                     92.84 |                 181.50 |                     92.44 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |     1048576 |           26.21 |        128 |                 357.83 |                     93.77 |                 365.80 |                     91.73 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |     2097152 |           52.43 |         64 |                 715.81 |                     93.75 |                 750.04 |                     89.47 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |     4194304 |          104.86 |         32 |                1429.86 |                     93.87 |                1581.24 |                     84.88 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |     8388608 |          209.72 |         16 |                2831.42 |                     94.81 |                3465.45 |                     77.46 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |    16777216 |          419.43 |         10 |                5655.92 |                     94.92 |                8207.76 |                     65.41 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.0 |  W3-a-00006 |    Java UDP |         8962 |    33554432 |          838.86 |         10 |               11487.22 |                     93.47 |               21603.25 |                     49.70 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Last modified 7 years ago Last modified on Apr 13, 2015, 9:54:01 AM

Attachments (1)

Download all attachments as: .zip