wiki:WARPLab/Benchmarks/WARPLAB_7_5_1

WARPLab 7.5.1: Benchmarks

NOTE: The Ethernet performance benchmarks below were done on a single buffer read_iq:

  • rx_IQ = wl_basebandCmd(node, [RF_RX], 'read_IQ', 0, rx_length);

Hardware and Software

  • Netgear ProSafe 5-port Gigabit Desktop Switch (GS105)
  • PC Hardware
    • Dell Optiplex 790
    • Intel Core i7-2600 3.4 GHz
    • 16 GB RAM
    • Window 7 Professional SP1 64-bit
    • Intel 82579LM Gigabit Network Connection
      • Configured to support Jumbo Ethernet Frames of up to 9014 Bytes
  • PC Software
    • Matlab 7.12.0 (R2011a)
    • Microsoft Visual C++ 2010 Express (compiler for MEX)
    • Microsoft Windows 7 SDK


Procedure

  • Download Reference bit stream w/ iMPACT
  • Open MATLAB
    • Set current folder within MATLAB to the M_Code_Reference folder of the appropriate WARPLab release
    • Run the following commands
      • wl_setup
        • NOTE: This allows us to configure the Transport type and the Ethernet MTU Size
      • nodes = wl_initNodes(1);
      • for i={'read_iq', 'write_iq'}
        • results = wl_benchmark(node, i{1}, 1024, 2^15)
        • results = wl_benchmark(node, i{1}, 1024, 2^16)
        • results = wl_benchmark(node, i{1}, 1024, 2^17)
        • results = wl_benchmark(node, i{1}, 512, 2^18)
        • results = wl_benchmark(node, i{1}, 256, 2^19)
        • results = wl_benchmark(node, i{1}, 128, 2^20)
        • results = wl_benchmark(node, i{1}, 64, 2^21)
        • results = wl_benchmark(node, i{1}, 32, 2^22)
        • results = wl_benchmark(node, i{1}, 16, 2^23)
        • results = wl_benchmark(node, i{1}, 10, 2^24)
        • results = wl_benchmark(node, i{1}, 10, 2^25)

NOTE: The reduction in the number of trials was to keep the total wall time of the experiment reasonable. There is no reason that each benchmark cannot be run more times for a better average.


Results

WARP v3 Hardware

MEX Transport

  • NOTE: All times are in milliseconds
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  ID |  WLVER |    Serial # |   Transport | MTU Size (B) | Num Samples | TX/RX Time (ms) | Num Trials | Avg Write IQ Time (ms) | Avg Transfer Speed (Mbps) | Avg Read  IQ Time (ms) | Avg Transfer Speed (Mbps) |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |  WL Mex UDP |         8966 |        1024 |            0.03 |      10000 |                   0.78 |                     41.93 |                   0.72 |                     45.51 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |  WL Mex UDP |         8966 |        2048 |            0.05 |      10000 |                   0.86 |                     75.97 |                   0.85 |                     77.47 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |  WL Mex UDP |         8966 |        4096 |            0.10 |      10000 |                   0.95 |                    138.43 |                   0.93 |                    141.13 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |  WL Mex UDP |         8966 |        8192 |            0.20 |      10000 |                   1.15 |                    228.08 |                   1.02 |                    257.77 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |  WL Mex UDP |         8966 |       16384 |            0.41 |      10000 |                   1.42 |                    370.40 |                   1.34 |                    391.83 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |  WL Mex UDP |         8966 |       32768 |            0.82 |       1024 |                   2.05 |                    510.39 |                   1.89 |                    555.97 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |  WL Mex UDP |         8966 |       65536 |            1.64 |       1024 |                   3.30 |                    634.87 |                   2.95 |                    711.11 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |  WL Mex UDP |         8966 |      131072 |            3.28 |       1024 |                   5.79 |                    724.56 |                   5.07 |                    827.02 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |  WL Mex UDP |         8966 |      262144 |            6.55 |       1024 |                  10.76 |                    779.76 |                   9.39 |                    893.65 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |  WL Mex UDP |         8966 |      524288 |           13.11 |       1024 |                  20.85 |                    804.55 |                  18.19 |                    922.45 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |  WL Mex UDP |         8966 |     1048576 |           26.21 |       1024 |                  40.83 |                    821.81 |                  35.47 |                    946.03 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |  WL Mex UDP |         8966 |     2097152 |           52.43 |        512 |                  80.67 |                    831.92 |                  69.72 |                    962.58 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |  WL Mex UDP |         8966 |     4194304 |          104.86 |        256 |                 160.29 |                    837.35 |                 138.51 |                    969.01 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |  WL Mex UDP |         8966 |     8388608 |          209.72 |        128 |                 319.43 |                    840.35 |                 275.87 |                    973.04 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |  WL Mex UDP |         8966 |    16777216 |          419.43 |         64 |                 637.86 |                    841.67 |                 550.62 |                    975.03 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |  WL Mex UDP |         8966 |    33554432 |          838.86 |         32 |                1274.90 |                    842.22 |                1100.12 |                    976.02 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Java Transport

  • NOTE: All times are in milliseconds
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|  ID |  WLVER |    Serial # |   Transport | MTU Size (B) | Num Samples | TX/RX Time (ms) | Num Trials | Avg Write IQ Time (ms) | Avg Transfer Speed (Mbps) | Avg Read  IQ Time (ms) | Avg Transfer Speed (Mbps) |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |    Java UDP |         8966 |        1024 |            0.03 |       2048 |                   2.74 |                     11.97 |                   2.14 |                     15.30 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |    Java UDP |         8966 |        2048 |            0.05 |       2048 |                   2.88 |                     22.78 |                   2.35 |                     27.92 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |    Java UDP |         8966 |        4096 |            0.10 |       2048 |                   2.57 |                     50.91 |                   3.01 |                     43.57 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |    Java UDP |         8966 |        8192 |            0.20 |       2048 |                   3.87 |                     67.73 |                   4.35 |                     60.33 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |    Java UDP |         8966 |       16384 |            0.41 |       2048 |                   6.20 |                     84.51 |                   6.97 |                     75.22 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |    Java UDP |         8966 |       32768 |            0.82 |       1024 |                  10.79 |                     97.15 |                  11.46 |                     91.53 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |    Java UDP |         8966 |       65536 |            1.64 |       1024 |                  20.36 |                    103.00 |                  21.45 |                     97.78 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |    Java UDP |         8966 |      131072 |            3.28 |       1024 |                  39.78 |                    105.44 |                  40.69 |                    103.07 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |    Java UDP |         8966 |      262144 |            6.55 |        512 |                  79.21 |                    105.90 |                  79.93 |                    104.94 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |    Java UDP |         8966 |      524288 |           13.11 |        256 |                 158.14 |                    106.09 |                 156.92 |                    106.92 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |    Java UDP |         8966 |     1048576 |           26.21 |        128 |                 316.28 |                    106.09 |                 310.26 |                    108.15 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |    Java UDP |         8966 |     2097152 |           52.43 |         64 |                 640.87 |                    104.71 |                 616.44 |                    108.87 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |    Java UDP |         8966 |     4194304 |          104.86 |         32 |                1259.75 |                    106.54 |                1230.24 |                    109.10 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |    Java UDP |         8966 |     8388608 |          209.72 |         16 |                2570.09 |                    104.45 |                2463.64 |                    108.96 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |    Java UDP |         8966 |    16777216 |          419.43 |         10 |                5173.49 |                    103.77 |                4914.04 |                    109.25 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   0 |  7.5.1 |  W3-a-00006 |    Java UDP |         8966 |    33554432 |          838.86 |         10 |               10166.95 |                    105.61 |                9851.27 |                    109.00 |
------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Last modified 9 years ago Last modified on Apr 13, 2015, 9:52:57 AM

Attachments (1)

Download all attachments as: .zip