5 May 2009 ======================================================= Mixed Integer Linear Programming Benchmark (free codes) ======================================================= H. Mittelmann (mittelmann@asu.edu)
Logfiles for these runs at: http://plato.asu.edu/ftp/milpf_logs/
See also this graphical form of the benchmark.
The MPS-datafiles for all testcases are in one of (see column "s")
http://miplib.zib.de/ [1]
http://plato.asu.edu/ftp/fctp/ [2]
http://coral.ie.lehigh.edu/mip-instances/ [3]
http://plato.asu.edu/ftp/milp/ [4]
http://www.ps.uni-sb.de/~walser/acc/acc.html [5]
http://www.ieor.berkeley.edu/~atamturk/data/ (mik.500-*) [6]
The following codes were run in default mode (exc GLPK: --intopt --cuts) on a 2.67 GHz Intel Core 2 (4GB, Linux, 64 bits)
CBC-2.3: https://projects.coin-or.org/Cbc (1, 2, 4 threads) GLPK-4.35: http://www.gnu.org/software/glpk/glpk.html LP_SOLVE-5.5: http://lpsolve.sourceforge.net/ MINTO-3.1: http://coral.ie.lehigh.edu/~minto/ (32 bits; using CPLEX) SCIP-1.1: http://scip.zib.de/ (SCIP+CPLEX available at NEOS) SYMPHONY-5.2.0: https://projects.coin-or.org/SYMPHONY CPLEX-11.2.1: (for comparison purposes, single thread)
Times given are user/elapsed times in seconds. In case the time limit of 2 hrs was
exceeded f(i) indicates that an integer feasible solution was (not) found.
CBC, SYMPHONY use Clp as LP solver.
SCIP uses cLp, Soplex, or Cplex as LP solver, MINTO uses CPLEX.
SCIP uses a mipgap of 0.
===============================================================================
s problem CBC1 CBC2 CBC4 GLPK MINTO SYMPH SCIP_L SCIP_S SCIP_C CPLEX LP_S
-------------------------------------------------------------------------------
1 10teams 13 15 7 78 238 57 34 90 7 1 i
air04 134 106 64 f 99 312 98 164 58 9 i
air05 85 51 42 f 89 264 55 82 27 8 1372
cap6000 18 8 6 f 236 2551 4 7 3 1 4584
mas74 1299 936 478 f i 2030 1549 1267 863 243 f
mas76 327 194 89 f i 450 108 87 73 42 227
misc07 51 29 13 1621 48 140 23 23 24 23 15
mod011 100 52 35 2905 f 416 199 351 86 24 f
mzzv11 f f f i f i 1797 f 421 89 i
mzzv42z 291 325 207 i f i 882 3549 229 32 i
nw04 18 20 19 27 56 481 50 517 54 25 36
pk1 88 53 32 f i 630 129 112 80 96 219
qiu 208 112 90 f 773 370 146 202 81 35 i
-------------------------------------------------------------------------------
2ran10x26 47 25 14 f 43 191 74 76 32 22 f
ran12x21 147 97 43 f 228 1219 155 156 60 57 i
ran13x13 120 77 37 1093 60 255 74 57 36 22 2228
-------------------------------------------------------------------------------
3binkar10_1 889 701 219 2528 38 f 1004 450 310 28 i
lrn 1916 1116 558 i i i 400 f f 104 i
prod1 45 33 17 f 558 398 26 30 20 7 i
prod2 216 125 71 f i 839 146 48 95 77 i
-------------------------------------------------------------------------------
4 bc1 1209 525 379 f 332 f 301 267 221 101 i
bienst1 73 57 28 1795 128 491 40 159 25 28 253
bienst2 1290 572 327 f 1455 3488 419 1466 127 151 3059
dano3_3 80 139 138 93 141 168 286 481 64 45 i
dano3_4 103 203 200 102 225 189 419 570 148 59 i
dano3_5 428 354 409 2074 309 929 819 2523 236 269 i
mark._4_0 247 213 135 f i 460 264 111 150 118 46
mark._5_0 f f f f f f f f f f f
nug08 15 14 14 16 611 5 77 125 52 8 5
qap10 77 53 52 86 f 272 383 1364 199 106 117
seymour1 1317 717 386 f 508 1398 717 1583 502 151 i
swath2 393 171 143 f i 4576 99 302 71 10 2701
swath3 816 474 471 f i f 2817 315 1007 99 f
30_05_100 572 503 400 i 122 f 387 f 219 11 i
30_95_100 574 420 359 i 13 f 341 f 182 31 22
30_95_98 733 641 556 i 57 f 827 f 145 28 i
-------------------------------------------------------------------------------
4 neos1 7 7 7 3025 1 30 5 5 5 2 i
neos2 19 26 12 i 471 354 147 97 30 19 f
neos3 64 369 45 i f f 2465 962 321 52 f
neos4 19 16 14 703 105 226 3 3 3 3 i
neos5 703 480 195 f f 3886 3894 3555 1403 193 3941
neos6 165 614 237 f 50 f 471 f 98 f i
neos7 215 28 57 i 17 f 70 359 14 21 i
neos8 19 20 20 23 7 15 47 48 48 2 i
neos9 f f f i i f f f 74 1215 i
neos10 68 67 58 i 8 129 51 62 52 3 6119
neos11 1123 482 180 i 738 2041 675 1244 241 156 579
neos12 2364 1697 429 f f f 2084 4154 609 96 i
neos13 847 1042 863 f f 2789 3681 2074 289 67 f
neos14 f f f f f f 1632 969 765 133 f
neos17 1452 634 295 f i f f 70 19 61 f
neos20 300 194 71 i 1100 i 18 32 6 21 i
neos21 75 46 32 4116 85 f 74 114 20 42 2795
neos22 237 130 64 7076 198 352 2 2 1 2 i
neos23 1763 1759 253 f f f 18 12 17 14 i
neos648910 73 16 15 f 7 1702 2 2 2 1 581
neos808444 f f f i i i i i 3219 523 i
neos818918 2553 1841 912 f f f 3986 f 3123 6722 f
neos823206 f f f i i 2434 1181 1188 413 5913 i
neos897005 51 53 52 2507 284 90 982 3014 235 139 i
ns1648184 f f f f f f f f f f i
ns1671066 11 10 7 f 612 i 1 189 f 1828 1
ns1688347 i i i i 4293 i i f 2638 1531 i
ns1692855 i i i i f i 4162 f 5998 1674 i
-------------------------------------------------------------------------------
5 acc1 5 5 5 20 9 15 85 202 42 1 i
acc2 9 9 9 18 6 44 95 246 66 1 i
acc3 26 26 26 266 194 2110 212 507 263 34 i
acc4 1258 976 456 214 i 3426 664 1150 1458 51 i
acc5 205 889 268 i i i 558 233 342 25 i
acc6 669 79 64 i 2456 4293 188 172 156 667 i
-------------------------------------------------------------------------------
6m20-75-1 218 179 80 f f 738 8 7 6 2 i
m20-75-2 218 106 122 f f 582 8 7 6 2 i
m20-75-3 560 367 158 f f 2191 24 22 20 7 i
m20-75-4 485 344 239 f f 911 20 14 15 6 i
m20-75-5 258 332 111 f f 801 11 7 7 5 i
-------------------------------------------------------------------------------
Problem Statistics
===============================================================
problem rows col integer binary nonzero
---------------------------------------------------------------
10teams 231 2025 1800 1800 14175
air04 824 8904 8904 8904 81869
air05 427 7195 7195 7195 59316
cap6000 2177 6000 6000 6000 54238
mas74 14 151 150 150 1857
mas76 13 151 150 150 1791
misc07 213 260 259 259 8620
mod011 4482 10958 96 96 37425
mzzv11 9500 10240 10240 9989 134808
mzzv42z 10461 11717 11717 11482 151455
nw04 37 87482 87482 87482 636666
pk1 46 86 55 55 915
qiu 1193 840 48 48 3744
---------------------------------------------------------------
ran10x26 297 520 260 260 1560
ran12x21 286 504 252 252 1512
ran13x13 196 338 169 169 1014
---------------------------------------------------------------
binkar10_1 1027 2298 170 170 6238
lrn 8702 7253 2455 2455 39396
prod1 209 250 149 149 5351
prod2 212 301 200 200 10502
---------------------------------------------------------------
bc1 1914 1751 252 252 276843
bienst1 577 505 28 28 2185
bienst2 577 505 35 35 2072
dano3_3 3203 13873 69 69 79656
dano3_4 3203 13873 92 92 79656
dano3_5 3203 13873 115 115 79656
markshare_4_0 5 34 30 30 127
markshare_5_0 6 45 40 40 208
nug08 913 1632 1632 0 8304
qap10 1821 4150 4150 0 20810
seymour1 4945 1372 451 451 34921
swath2 885 6805 2406 2406 34966
swath3 885 6805 2706 2706 34966
30_05_100 12051 10772 10771 10771 56661
30_95_100 12527 10976 10975 10975 57616
30_95_98 12471 10990 10989 10989 46387
---------------------------------------------------------------
neos1 5021 2112 2112 2112 21600
neos2 1104 2101 1040 1040 7330
neos3 1443 2747 1360 1360 9585
neos4 38578 22884 17172 17172 116040
neos5 64 63 53 53 2079
neos6 1037 8768 8340 8340 252169
neos7 1995 1556 454 424 5472
neos8 46325 23228 23228 23224 313212
neos9 31601 81408 2099 2099 264192
neos10 46794 23489 23489 23484 251230
neos11 2702 1220 900 900 9540
neos13 20853 1827 1815 1815 253854
neos14 553 792 136 136 2318
neos17 487 535 300 300 5416
neos20 2447 1165 967 856 7433
neos21 1086 614 613 613 12504
neos22 5208 3240 454 454 12312
neos23 1569 477 232 232 4285
neos648910 1492 814 748 748 4125
neos808444 18330 19846 19846 19846 120512
neos818918 2450 2750 50 50 9730
neos823206 709 1830 1720 1720 6362
neos897005 11613 44630 44630 44630 181655
ns1648184 806 705 225 225 10233
ns1671066 316 2840 2820 2820 31418
ns1688347 4191 2685 2685 2685 66908
ns1692855 4562 3047 3047 3047 81119
---------------------------------------------------------------
acc1 2287 1620 1620 1620 12979
acc2 2521 1620 1620 1620 15328
acc3 3250 1620 1620 1620 24913
acc5 3053 1339 1339 1339 16135
acc6 3048 1335 1335 1335 16109
---------------------------------------------------------------
m20-75-* 520 446 500 75 28790
---------------------------------------------------------------