wiki:WARPLab/Benchmarks/WARPLAB_7_6_0

WARPLab 7.6.0: Benchmarks

NOTE: The Ethernet performance benchmarks below were done on a single buffer read_iq:

  • rx_IQ = wl_basebandCmd(node, [RF_RX], 'read_IQ', 0, rx_length);

Hardware and Software

  • Netgear ProSafe 5-port Gigabit Desktop Switch (GS105)
  • PC Hardware
    • Dell Optiplex 790
    • Intel Core i7-2600 3.4 GHz
    • 16 GB RAM
    • Window 7 Professional SP1 64-bit
    • Intel 82579LM Gigabit Network Connection
      • Configured to support Jumbo Ethernet Frames of up to 9014 Bytes
  • PC Software
    • Matlab 7.12.0 (R2011a)
    • Microsoft Visual C++ 2010 Express (compiler for MEX)
    • Microsoft Windows 7 SDK


Procedure

  • Download Reference bit stream w/ iMPACT
  • Open MATLAB
    • Set current folder within MATLAB to the M_Code_Reference folder of the appropriate WARPLab release
    • Run the following commands
      • wl_setup
        • NOTE: This allows us to configure the Transport type and the Ethernet MTU Size
      • nodes = wl_initNodes(1);
      • for i={'read_iq', 'write_iq'}
        • results = wl_benchmark(node, i{1}, 1024, 2^15)
        • results = wl_benchmark(node, i{1}, 1024, 2^16)
        • results = wl_benchmark(node, i{1}, 1024, 2^17)
        • results = wl_benchmark(node, i{1}, 512, 2^18)
        • results = wl_benchmark(node, i{1}, 256, 2^19)
        • results = wl_benchmark(node, i{1}, 128, 2^20)
        • results = wl_benchmark(node, i{1}, 64, 2^21)
        • results = wl_benchmark(node, i{1}, 32, 2^22)
        • results = wl_benchmark(node, i{1}, 16, 2^23)
        • results = wl_benchmark(node, i{1}, 10, 2^24)
        • results = wl_benchmark(node, i{1}, 10, 2^25)

NOTE: The reduction in the number of trials was to keep the total wall time of the experiment reasonable. There is no reason that each benchmark cannot be run more times for a better average.


Results

WARP v3 Hardware

MEX Transport

  • NOTE: All times are in milliseconds
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  ID |  WLVER |    Serial # |   Transport | MTU Size (B) | Num Samples | TX/RX Time (ms) | Num Trials | Avg Write IQ Time (ms) | Avg Transfer Speed (Mbps) | Avg Read  IQ Time (ms) | Avg Transfer Speed (Mbps) |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |  WL Mex UDP |         8964 |        1024 |            0.03 |      10000 |                   0.78 |                     41.84 |                   0.73 |                     44.88 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |  WL Mex UDP |         8964 |        2048 |            0.05 |      10000 |                   0.86 |                     76.45 |                   0.85 |                     76.95 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |  WL Mex UDP |         8964 |        4096 |            0.10 |      10000 |                   0.93 |                    140.50 |                   0.94 |                    139.25 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |  WL Mex UDP |         8964 |        8192 |            0.20 |      10000 |                   1.11 |                    235.27 |                   1.02 |                    257.03 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |  WL Mex UDP |         8964 |       16384 |            0.41 |      10000 |                   1.41 |                    372.37 |                   1.35 |                    387.34 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |  WL Mex UDP |         8964 |       32768 |            0.82 |       1024 |                   2.01 |                    522.96 |                   1.90 |                    552.16 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |  WL Mex UDP |         8964 |       65536 |            1.64 |       1024 |                   3.25 |                    645.73 |                   2.98 |                    704.28 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |  WL Mex UDP |         8964 |      131072 |            3.28 |       1024 |                   5.71 |                    735.02 |                   5.09 |                    824.30 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |  WL Mex UDP |         8964 |      262144 |            6.55 |       1024 |                  10.60 |                    791.57 |                   9.44 |                    888.29 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |  WL Mex UDP |         8964 |      524288 |           13.11 |       1024 |                  20.54 |                    816.81 |                  18.21 |                    921.41 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |  WL Mex UDP |         8964 |     1048576 |           26.21 |       1024 |                  40.22 |                    834.24 |                  35.51 |                    944.85 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |  WL Mex UDP |         8964 |     2097152 |           52.43 |        512 |                  79.35 |                    845.73 |                  69.76 |                    962.04 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |  WL Mex UDP |         8964 |     4194304 |          104.86 |        256 |                 157.61 |                    851.59 |                 138.58 |                    968.55 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |  WL Mex UDP |         8964 |     8388608 |          209.72 |        128 |                 314.13 |                    854.54 |                 275.96 |                    972.74 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |  WL Mex UDP |         8964 |    16777216 |          419.43 |         64 |                 627.15 |                    856.06 |                 550.75 |                    974.80 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |  WL Mex UDP |         8964 |    33554432 |          838.86 |         32 |                1253.39 |                    856.67 |                1100.16 |                    975.98 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Java Transport

  • NOTE: All times are in milliseconds
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  ID |  WLVER |    Serial # |   Transport | MTU Size (B) | Num Samples | TX/RX Time (ms) | Num Trials | Avg Write IQ Time (ms) | Avg Transfer Speed (Mbps) | Avg Read  IQ Time (ms) | Avg Transfer Speed (Mbps) |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |    Java UDP |         8964 |        1024 |            0.03 |       2048 |                   2.70 |                     12.16 |                   2.12 |                     15.43 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |    Java UDP |         8964 |        2048 |            0.05 |       2048 |                   2.82 |                     23.25 |                   2.31 |                     28.36 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |    Java UDP |         8964 |        4096 |            0.10 |       2048 |                   2.56 |                     51.29 |                   3.00 |                     43.64 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |    Java UDP |         8964 |        8192 |            0.20 |       2048 |                   3.81 |                     68.89 |                   4.25 |                     61.73 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |    Java UDP |         8964 |       16384 |            0.41 |       2048 |                   6.27 |                     83.60 |                   6.85 |                     76.57 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |    Java UDP |         8964 |       32768 |            0.82 |       1024 |                  10.72 |                     97.81 |                  11.15 |                     94.05 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |    Java UDP |         8964 |       65536 |            1.64 |       1024 |                  19.87 |                    105.55 |                  21.09 |                     99.46 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |    Java UDP |         8964 |      131072 |            3.28 |       1024 |                  38.92 |                    107.76 |                  40.22 |                    104.28 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |    Java UDP |         8964 |      262144 |            6.55 |        512 |                  80.68 |                    103.97 |                  78.62 |                    106.70 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |    Java UDP |         8964 |      524288 |           13.11 |        256 |                 156.87 |                    106.95 |                 155.21 |                    108.09 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |    Java UDP |         8964 |     1048576 |           26.21 |        128 |                 320.70 |                    104.63 |                 307.66 |                    109.06 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |    Java UDP |         8964 |     2097152 |           52.43 |         64 |                 648.39 |                    103.50 |                 613.92 |                    109.31 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |    Java UDP |         8964 |     4194304 |          104.86 |         32 |                1271.12 |                    105.59 |                1225.83 |                    109.49 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |    Java UDP |         8964 |     8388608 |          209.72 |         16 |                2577.85 |                    104.13 |                2445.02 |                    109.79 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |    Java UDP |         8964 |    16777216 |          419.43 |         10 |                5131.71 |                    104.62 |                4891.51 |                    109.76 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.6.0 |  W3-a-00006 |    Java UDP |         8964 |    33554432 |          838.86 |         10 |               10131.97 |                    105.98 |                9781.55 |                    109.77 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Last modified 9 years ago Last modified on Sep 11, 2015, 5:58:52 PM

Attachments (1)

Download all attachments as: .zip