[[TracNav(WARPLab/TOC)]] = WARPLab 7.5.1: Benchmarks = ''NOTE: The Ethernet performance benchmarks below were done on a single buffer read_iq:'' * `rx_IQ = wl_basebandCmd(node, [RF_RX], 'read_IQ', 0, rx_length);` == Hardware and Software == * Netgear ProSafe 5-port Gigabit Desktop Switch (GS105) * PC Hardware * Dell Optiplex 790 * Intel Core i7-2600 3.4 GHz * 16 GB RAM * Window 7 Professional SP1 64-bit * Intel 82579LM Gigabit Network Connection * Configured to support Jumbo Ethernet Frames of up to 9014 Bytes * PC Software * Matlab 7.12.0 (R2011a) * Microsoft Visual C++ 2010 Express (compiler for MEX) * Microsoft Windows 7 SDK [[BR]] == Procedure == * Download Reference bit stream w/ iMPACT * Open MATLAB * Set current folder within MATLAB to the M_Code_Reference folder of the appropriate WARPLab release * Run the following commands * wl_setup * NOTE: This allows us to configure the Transport type and the Ethernet MTU Size * `nodes = wl_initNodes(1);` * `for i={'read_iq', 'write_iq'}` * `results = wl_benchmark(node, i{1}, 1024, 2^15)` * `results = wl_benchmark(node, i{1}, 1024, 2^16)` * `results = wl_benchmark(node, i{1}, 1024, 2^17)` * `results = wl_benchmark(node, i{1}, 512, 2^18)` * `results = wl_benchmark(node, i{1}, 256, 2^19)` * `results = wl_benchmark(node, i{1}, 128, 2^20)` * `results = wl_benchmark(node, i{1}, 64, 2^21)` * `results = wl_benchmark(node, i{1}, 32, 2^22)` * `results = wl_benchmark(node, i{1}, 16, 2^23)` * `results = wl_benchmark(node, i{1}, 10, 2^24)` * `results = wl_benchmark(node, i{1}, 10, 2^25)` NOTE: The reduction in the number of trials was to keep the total wall time of the experiment reasonable. There is no reason that each benchmark cannot be run more times for a better average. [[BR]] == Results == ''' WARP v3 Hardware ''' [[Image(WARP_v3_WARPLab_751_Ethernet_Performance.png,width=600)]] === MEX Transport === * ''NOTE: All times are in milliseconds'' {{{ ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | ID | WLVER | Serial # | Transport | MTU Size (B) | Num Samples | TX/RX Time (ms) | Num Trials | Avg Write IQ Time (ms) | Avg Transfer Speed (Mbps) | Avg Read IQ Time (ms) | Avg Transfer Speed (Mbps) | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | WL Mex UDP | 8966 | 1024 | 0.03 | 10000 | 0.78 | 41.93 | 0.72 | 45.51 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | WL Mex UDP | 8966 | 2048 | 0.05 | 10000 | 0.86 | 75.97 | 0.85 | 77.47 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | WL Mex UDP | 8966 | 4096 | 0.10 | 10000 | 0.95 | 138.43 | 0.93 | 141.13 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | WL Mex UDP | 8966 | 8192 | 0.20 | 10000 | 1.15 | 228.08 | 1.02 | 257.77 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | WL Mex UDP | 8966 | 16384 | 0.41 | 10000 | 1.42 | 370.40 | 1.34 | 391.83 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | WL Mex UDP | 8966 | 32768 | 0.82 | 1024 | 2.05 | 510.39 | 1.89 | 555.97 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | WL Mex UDP | 8966 | 65536 | 1.64 | 1024 | 3.30 | 634.87 | 2.95 | 711.11 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | WL Mex UDP | 8966 | 131072 | 3.28 | 1024 | 5.79 | 724.56 | 5.07 | 827.02 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | WL Mex UDP | 8966 | 262144 | 6.55 | 1024 | 10.76 | 779.76 | 9.39 | 893.65 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | WL Mex UDP | 8966 | 524288 | 13.11 | 1024 | 20.85 | 804.55 | 18.19 | 922.45 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | WL Mex UDP | 8966 | 1048576 | 26.21 | 1024 | 40.83 | 821.81 | 35.47 | 946.03 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | WL Mex UDP | 8966 | 2097152 | 52.43 | 512 | 80.67 | 831.92 | 69.72 | 962.58 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | WL Mex UDP | 8966 | 4194304 | 104.86 | 256 | 160.29 | 837.35 | 138.51 | 969.01 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | WL Mex UDP | 8966 | 8388608 | 209.72 | 128 | 319.43 | 840.35 | 275.87 | 973.04 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | WL Mex UDP | 8966 | 16777216 | 419.43 | 64 | 637.86 | 841.67 | 550.62 | 975.03 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | WL Mex UDP | 8966 | 33554432 | 838.86 | 32 | 1274.90 | 842.22 | 1100.12 | 976.02 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ }}} === Java Transport === * ''NOTE: All times are in milliseconds'' {{{ ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | ID | WLVER | Serial # | Transport | MTU Size (B) | Num Samples | TX/RX Time (ms) | Num Trials | Avg Write IQ Time (ms) | Avg Transfer Speed (Mbps) | Avg Read IQ Time (ms) | Avg Transfer Speed (Mbps) | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | Java UDP | 8966 | 1024 | 0.03 | 2048 | 2.74 | 11.97 | 2.14 | 15.30 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | Java UDP | 8966 | 2048 | 0.05 | 2048 | 2.88 | 22.78 | 2.35 | 27.92 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | Java UDP | 8966 | 4096 | 0.10 | 2048 | 2.57 | 50.91 | 3.01 | 43.57 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | Java UDP | 8966 | 8192 | 0.20 | 2048 | 3.87 | 67.73 | 4.35 | 60.33 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | Java UDP | 8966 | 16384 | 0.41 | 2048 | 6.20 | 84.51 | 6.97 | 75.22 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | Java UDP | 8966 | 32768 | 0.82 | 1024 | 10.79 | 97.15 | 11.46 | 91.53 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | Java UDP | 8966 | 65536 | 1.64 | 1024 | 20.36 | 103.00 | 21.45 | 97.78 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | Java UDP | 8966 | 131072 | 3.28 | 1024 | 39.78 | 105.44 | 40.69 | 103.07 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | Java UDP | 8966 | 262144 | 6.55 | 512 | 79.21 | 105.90 | 79.93 | 104.94 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | Java UDP | 8966 | 524288 | 13.11 | 256 | 158.14 | 106.09 | 156.92 | 106.92 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | Java UDP | 8966 | 1048576 | 26.21 | 128 | 316.28 | 106.09 | 310.26 | 108.15 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | Java UDP | 8966 | 2097152 | 52.43 | 64 | 640.87 | 104.71 | 616.44 | 108.87 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | Java UDP | 8966 | 4194304 | 104.86 | 32 | 1259.75 | 106.54 | 1230.24 | 109.10 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | Java UDP | 8966 | 8388608 | 209.72 | 16 | 2570.09 | 104.45 | 2463.64 | 108.96 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | Java UDP | 8966 | 16777216 | 419.43 | 10 | 5173.49 | 103.77 | 4914.04 | 109.25 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.1 | W3-a-00006 | Java UDP | 8966 | 33554432 | 838.86 | 10 | 10166.95 | 105.61 | 9851.27 | 109.00 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ }}}