23 Aug 2008 ==================================== Benchmark of commercial LP solvers ==================================== H. Mittelmann (mittelmann@asu.edu)

Logfiles of these runs at: http://plato.asu.edu/ftp/lp_logs/

This benchmark was run on a Linux-PC (2.67 GHz Intel Core 2).
The MPS-datafiles for all testcases are in one of (see column "s")

 http://miplib.zib.de/ [1]
 http://plato.asu.edu/ftp/lptestset/ [2]
 http://www.sztaki.hu/~meszaros/public_ftp/lptestset/
(NETLIB[3], MISC[4], PROBLEMATIC[5], STOCHLP[6], KENNINGTON[7], INFEAS[8])
NOTE: files in [2-8] need to be expanded with emps in same directory!

B/D/P: barrier/dual/primal simplex

The following codes were tested:

 CPLEX-B/D/P  http://www.cplex.com/ (ILOG-CPLEX-11.1)
 MOSEK-B/D/P  http://www.mosek.com (MOSEK-5.0.0.93)
 LOQO-6.07    http://www.princeton.edu/~rvdb/
 LIPSOL       linprog in Matlab 7.6

Times are user times in secs including input and crossover to a feasible basis for all codes except LOQO and LIPSOL. "$" without crossover. LOQO has no presolver; sigfig=6 was used for it.

==================================================================
s problem  CPLEX-B   CPLEX-D/P  MOSEK-B   MOSEK-D/P   LOQO LIPSOL
==================================================================
2 cont1      1445     948/911     6427   1593/1069      89    766
2 cont11      913   32767/7580     871  36023/4052     183   1047
2 cont4      1754     826/499      256   6167/1766     933    304
2 cont1_l$    289                  914 
2 cont11_l$  7599                  940
1 dano3mip     10      19/9          7     27/22        71      8
4 dbic1        32      47/7         32    303/160       95     30
3 dfl001        9       8/13         7     23/28       112      8
2 fome12      141      48/174       27    191/972      463     30
2 fome13       45     216/339       50    370/1784     786     55
5 gen4         20       1/39      3067      5/124       21     33
7 ken-18        5       5/28         8     12/38        52     13
5 l30          19       9/140        1    613/49         1      3
4 lp22          3      14/35         4     40/125       41      7
4 mod2          6      27/77         7     47/319       49     12
2 neos         67      13/70        77   1369/68       684     86
2 neos1        16     331/8         13     24/3        146     17
2 neos2        12     245/15        11     43/3         81     15
2 neos3       100    1406/         165   7635/21      1490    187
2 ns1687037 >75000  35938/16620    143       /                193
2 ns1688926    89      33/563        8       /
4 nsct2        43       1/1         27      2/3        854     77
4 nug15        44    1541/704       52   6497/2566    1580     55
2 nug20       767        /39000    920       /60453  22856   1037
2 nug08-3rd   751    1392/         820   4402/        6112    754
2 pds-40       82      14/53        66     37/422    15682     77
2 pds-100     461      66/522      439    376/8627            618
3 qap12         5      69/45         8    227/236      176     11
3 qap15        43    1543/599       71   8342/3557    1739     83
2 rail4284    136    2820/2333     148   3691/291     2654    203
4 rlfprim       2       1/3          2      5/1         56      5
8 self         34     111/49      3072    198/240       34   4330
2 sgpf5y6       8       2/1          6      3/3       fail     14
2 spal_004$  2958                 2345                   m
4 stat96v1    314     133/238       33   6205/460      156     90
4 stat96v4      4     146/266        7    194/295       12     16
6 storm-125    11       7/6         27     27/137       21     34
2 storm_1000  205     361/571      348   2926/14521    457    490
1 stp3d        97     315/4579      91   1772/16743   2460    103
2 watson_2     25      74/224       27    116/428      206     43
4 world         6      33/123       10     55/415       46    145
==================================================================
"m": memory exceeded
Problem sizes
problem           rows    columns     nonzeros
===============================================
 cont1           160793      40398       399991
 cont11          160793      80396       439989
 cont4           160793      40398       398399
 cont1_l        1918399     641598      5752001
 cont11_l       1468599     981396      4403001
 dano3mip_lp       3203      13873        79656
 dbic1            43200     183235      1038761                    
 dfl001            6072      12230        41873
 fome12           24285      48920       167492
 fome13           48569      97840       334984
 gen4              1538       4297       110174
 ken-18          105128     154699       512719
 l30               2702      15380        64790
 lp22              2959      13434        78994
 mod2             35665      31728       220116
 neos            479120      36786      1084461
 neos1           131582       1892       468094
 neos2           132569       1560       552596
 neos3           512209       6624      1542816
 ns1687037        50622      43749      1406739           
 ns1688926        32768      16587      1712128
 nsct2            23004      14981       686396
 nug15             6331      22275       110700
 nug20            15240      72600       304800
 nug08-3rd        19728      20448       139008
 pds-40           66845     212859       605678
 pds-100         156244     505360      1390539
 qap12             3193       8856        44244
 qap15             6331      22275       110700
 rail4284          4284    1092610     12372358
 rlfprim          57422       8052       264483
 self               960       7364      1148845
 sgpf5y6         246078     308634       902275
 spal_004         10203     321696     46167908
 stat96v1          5995     197472       588798
 stat96v4          3173      62212       490472
 stormG2-125      66186     157496       529317
 stormG2_1000    528186    1259121      4228817
 stp3d           159488     204880       662128
 watson_2        352014     671861      1843716
 world            35511      32734       220748
===============================================