[[TracNav(WARPLab/TOC)]] = WARPLab 7.5.0: Benchmarks = ''NOTE: The WARPLab 7.5.0 MEX transport has been optimized for a single buffer read_iq:'' * `rx_IQ = wl_basebandCmd(node, [RF_RX], 'read_IQ', 0, rx_length);` ''vs'' * `rx_IQ = wl_basebandCmd(node, [RF_RX_0, RF_RX_1], 'read_IQ', 0, rx_length);` ''Currently, the iteration over the interfaces occurring in M code vs MEX C code. This will be fixed in future releases, but for now, if you do multiple buffer reads in a single Read IQ command, you will see a significant memory and performance penalty.'' == Hardware and Software == * Netgear ProSafe 5-port Gigabit Desktop Switch (GS105) * PC Hardware * Dell Optiplex 790 * Intel Core i7-2600 3.4 GHz * 16 GB RAM * Window 7 Professional SP1 64-bit * Intel 82579LM Gigabit Network Connection * Configured to support Jumbo Packets of up to 9014 Bytes * PC Software * Matlab 7.12.0 (R2011a) * Microsoft Visual C++ 2010 Express (compiler for MEX) * Microsoft Windows 7 SDK [[BR]] == Procedure == * Download Reference bit stream w/ iMPACT * Open MATLAB * Set current folder within MATLAB to the M_Code_Reference folder of the appropriate WARPLab release * Run the following commands * wl_setup * NOTE: This allows us to configure the Transport type and the Ethernet Packet Size * `nodes = wl_initNodes(1);` * `for i={'read_iq', 'write_iq'}` * `results = wl_benchmark(node, i{1}, 1024, 2^15)` * `results = wl_benchmark(node, i{1}, 1024, 2^16)` * `results = wl_benchmark(node, i{1}, 1024, 2^17)` * `results = wl_benchmark(node, i{1}, 512, 2^18)` * `results = wl_benchmark(node, i{1}, 256, 2^19)` * `results = wl_benchmark(node, i{1}, 128, 2^20)` * `results = wl_benchmark(node, i{1}, 64, 2^21)` * `results = wl_benchmark(node, i{1}, 32, 2^22)` * `results = wl_benchmark(node, i{1}, 16, 2^23)` * `results = wl_benchmark(node, i{1}, 10, 2^24)` * `results = wl_benchmark(node, i{1}, 10, 2^25)` NOTE: The reduction in the number of trials was to keep the total wall time of the experiment reasonable. There is no reason that each benchmark cannot be run more times for a better average. [[BR]] == Results == ''' WARP v3 Hardware ''' [[Image(WARP_v3_Ethernet_Performance.png)]] === Java Transport === * ''NOTE: All times are in milliseconds'' {{{ ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | ID | WLVER | Serial # | Transport | Pkt Size (B) | Num Samples | TX/RX Time (ms) | Num Trials | Avg Write IQ Time (ms) | Avg Transfer Speed (Mbps) | Avg Read IQ Time (ms) | Avg Transfer Speed (Mbps) | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.1.0 | W3-a-00006 | Java UDP | 8962 | 32768 | 0.82 | 10000 | 13.66 | 76.75 | 22.39 | 46.83 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.3.0 | W3-a-00006 | Java UDP | 8962 | 32768 | 0.82 | 10000 | 12.19 | 86.02 | 14.04 | 74.69 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | Java UDP | 8962 | 32768 | 0.82 | 1024 | 13.37 | 78.44 | 13.28 | 78.96 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | Java UDP | 8962 | 65536 | 1.64 | 1024 | 25.87 | 81.06 | 25.15 | 83.37 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | Java UDP | 8962 | 131072 | 3.28 | 1024 | 48.68 | 86.17 | 48.46 | 86.56 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | Java UDP | 8962 | 262144 | 6.55 | 512 | 96.66 | 86.79 | 95.46 | 87.88 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | Java UDP | 8962 | 524288 | 13.11 | 256 | 192.56 | 87.13 | 188.75 | 88.89 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | Java UDP | 8962 | 1048576 | 26.21 | 128 | 384.84 | 87.19 | 384.77 | 87.21 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | Java UDP | 8962 | 2097152 | 52.43 | 64 | 775.91 | 86.49 | 789.60 | 84.99 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | Java UDP | 8962 | 4194304 | 104.86 | 32 | 1549.37 | 86.63 | 1668.52 | 80.44 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | Java UDP | 8962 | 8388608 | 209.72 | 16 | 3102.08 | 86.53 | 3686.46 | 72.82 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | Java UDP | 8962 | 16777216 | 419.43 | 10 | 6167.20 | 87.05 | 8693.87 | 61.75 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | Java UDP | 8962 | 33554432 | 838.86 | 10 | 12395.46 | 86.62 | 22799.77 | 47.09 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ }}} === MEX Transport === * ''NOTE: All times are in milliseconds'' {{{ ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | ID | WLVER | Serial # | Transport | Pkt Size (B) | Num Samples | TX/RX Time (ms) | Num Trials | Avg Write IQ Time (ms) | Avg Transfer Speed (Mbps) | Avg Read IQ Time (ms) | Avg Transfer Speed (Mbps) | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.3.0 | W3-a-00006 | WL Mex UDP | 8962 | 32768 | 0.82 | 10000 | 2.24 | 467.55 | 2.14 | 489.29 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | WL Mex UDP | 8962 | 32768 | 0.82 | 1024 | 2.33 | 450.28 | 1.86 | 564.20 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | WL Mex UDP | 8962 | 65536 | 1.64 | 1024 | 3.89 | 539.55 | 2.95 | 710.59 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | WL Mex UDP | 8962 | 131072 | 3.28 | 1024 | 6.38 | 657.33 | 5.05 | 830.45 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | WL Mex UDP | 8962 | 262144 | 6.55 | 1024 | 11.92 | 703.65 | 9.41 | 891.63 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | WL Mex UDP | 8962 | 524288 | 13.11 | 1024 | 23.26 | 721.23 | 18.17 | 923.57 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | WL Mex UDP | 8962 | 1048576 | 26.21 | 1024 | 45.66 | 734.87 | 35.44 | 946.78 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | WL Mex UDP | 8962 | 2097152 | 52.43 | 512 | 89.98 | 745.78 | 69.67 | 963.22 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | WL Mex UDP | 8962 | 4194304 | 104.86 | 256 | 179.23 | 748.88 | 138.51 | 969.03 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | WL Mex UDP | 8962 | 8388608 | 209.72 | 128 | 355.85 | 754.35 | 275.90 | 972.94 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | WL Mex UDP | 8962 | 16777216 | 419.43 | 64 | 711.47 | 754.59 | 550.54 | 975.18 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ | 0 | 7.5.0 | W3-a-00006 | WL Mex UDP | 8962 | 33554432 | 838.86 | 32 | 1429.02 | 751.38 | 1099.62 | 976.47 | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ }}}