17 Feb 2008 ==================================== Benchmark of commercial LP solvers ==================================== H. Mittelmann (mittelmann@asu.edu)

Logfiles of these runs at: http://plato.asu.edu/ftp/lp_logs/

This benchmark was run on a Linux-PC (3.2 GHz P4, 4 GB RDRAM, Linux-2.6).
The MPS-datafiles for all testcases are in one of (see column "s")

 http://miplib.zib.de/ [1]
 http://plato.asu.edu/ftp/lptestset/ [2]
 http://www.sztaki.hu/~meszaros/public_ftp/lptestset/
(NETLIB[3], MISC[4], PROBLEMATIC[5], STOCHLP[6], KENNINGTON[7], INFEAS[8])
NOTE: files in [2-8] need to be expanded with emps in same directory!

B/D/P: barrier/dual/primal simplex

The following codes were tested:

 CPLEX-B/D/P  http://www.cplex.com/ (ILOG-CPLEX-11.0)
 MOSEK-B/D/P  http://www.mosek.com (MOSEK-5.0.0.79)
 LOQO-6.06    http://www.princeton.edu/~rvdb/
 LIPSOL       linprog in Matlab 7.0

Times are user times in secs including input and crossover to a feasible basis for all codes except LOQO and LIPSOL. "$" without crossover.

==================================================================
s problem  CPLEX-B   CPLEX-D/P  MOSEK-B   MOSEK-D/P   LOQO LIPSOL
==================================================================
2 cont1       939    1328/1631    3602   6091/3794       -      -
2 cont11     2021   54191/38371   3431       /76057      -      -
2 cont4      4043    1288/716     7397   6768/5881       -      -
2 cont1_l$    509                 2203 
2 cont11_l$ 12186                 2366
1 dano3mip     15      41/25        14     81/71        85     14
4 dbic1       129     117/25       108   1341/579      156    104
3 dfl001       16      19/43        12     39/80       152     13
2 fome12      153     135/410       54    420/887      485     88
2 fome13       94     644/1324      89    681/2634     963     85
5 gen4         58       2/86       106     10/412       33    233
7 ken-18       11      12/74        17     29/116      274     25
5 l30           f      28/95         3    487/226        3   1691
4 lp22          6      40/79         8    107/308       62      9
4 mod2         10      79/213       15    140/765       61     25
2 neos        106      29/176      141   2651/235      754    321
2 neos1        29     722/17        26     44/9        153     37
2 neos2        22     486/29        24     90/14        92     29
2 neos3       218    3219/12933    392   8464/46      1505    502
4 nsct2        72       1/2         53      6/12       840    131
4 nug15        81    2978/1379      99  15513/6343    1855    118
2 nug20      1109                 1584               26402   3092
2 nug08-3rd  1209    2129/90209   1711   8216/               2004
2 pds-40      144      47/180      129    114/1401   15908    252
2 pds-100     772     154/1775     840   1187/16377          1673
3 qap12        11     202/120       17    610/357      201     17
3 qap15        77    2837/1324     127  25257/6784    1978    145
2 rail4284    240    4778/6322     303   8684/697     4123    534
4 rlfprim       4       1/7          4     20/1         64      7
8 self         64     115/111     8350    542/470       85   3194
2 sgpf5y6      10       3/2         14      7/5       fail     23
2 spal_004$  4530                 5532                   m
4 stat96v1   1103     181/847      142   1449/798   
4 stat96v4      9     236/589       26    522/848 
6 storm-125    19      15/29        51     91/403       35     62
2 storm_1000  323     624/1591     707   6240/        1269    802
1 stp3d       182    1029/11362    180   4921/        2347    218
2 watson_2     50     193/463       50    307/860      313     70
4 world        11     103/328       21    173/1270      44     28
==================================================================
"m": memory exceeded
Problem sizes
problem           rows    columns     nonzeros
===============================================
 cont1           160793      40398       399991
 cont11          160793      80396       439989
 cont4           160793      40398       398399
 cont1_l        1918399     641598      5752001
 cont11_l       1468599     981396      4403001
 dano3mip_lp       3203      13873        79656
 dbic1            43200     183235      1038761                    
 dfl001            6072      12230        41873
 fome12           24285      48920       167492
 fome13           48569      97840       334984
 gen4              1538       4297       110174
 ken-18          105128     154699       512719
 l30               2702      15380        64790
 lp22              2959      13434        78994
 mod2             35665      31728       220116
 neos            479120      36786      1084461
 neos1           131582       1892       468094
 neos2           132569       1560       552596
 neos3           512209       6624      1542816
 nsct2            23004      14981       686396
 nug15             6331      22275       110700
 nug20            15240      72600       304800
 nug08-3rd        19728      20448       139008
 pds-40           66845     212859       605678
 pds-100         156244     505360      1390539
 qap12             3193       8856        44244
 qap15             6331      22275       110700
 rail4284          4284    1092610     12372358
 rlfprim          57422       8052       264483
 self               960       7364      1148845
 sgpf5y6         246078     308634       902275
 spal_004         10203     321696     46167908
 stat96v1          5995     197472       588798
 stat96v2         29089     957432      2852184
 stat96v4          3173      62212       490472
 stormG2-125      66186     157496       529317
 stormG2_1000    528186    1259121      4228817
 stp3d           159488     204880       662128
 watson_2        352014     671861      1843716
 world            35511      32734       220748
===============================================