MINLP Benchmark (small problems)

This is a sample of benchmarks as they can be done by everyone with the help of the new GAMS Performance Tools.

The following solvers were used:
DICOPT (with CONOPT2/CPLEX as NLP/MIP solvers, part of GAMS)
MINLP (with filterSQP as NLP solver, run with GAMS-AMPL)
SBB (with CONOPT2 as NLP solver, part of GAMS)
The 99 smallest (in the number of nonzeros) cases from MINLPLib were chosen.

Hans D. Mittelmann, Arizona State University
Armin Pruessner, GAMS Development Corporation

November 2002

Performance Results

Results created using the PAVER Server:   http://www.gamsworld.org/performance/paver

Date / Time: 11/08/02 12:23:02


This page is a summary of the performance tests, using the solver square, resource time, and performance profile utilities. The Performance Tools are described in detail in the Performance World webpage at http://www.gamsworld.org/performance.

Trace files used:

Tracefile 1: minlp100_dic_con2_cplex.trc
Tracefile 2: minlp100_minlp.trc
Tracefile 3: minlp100_sbb_con2.trc



For a list of model and solve status codes see the Status Codes Section.


Performance profile summary:

The profile utility compares solver outcomes of any number of given solvers (up to 8) over a model test set. The tool is described in detail at http://www.gamsworld.org/performance/pprofile.htm.


All performance profile plots (compares objective values):

Performance profile (ignoring objective values):

Solver square summary:

The solver square utility compares solver outcomes of two given solvers over a model test set. The tool is described in detail at http://www.gamsworld.org/performance/square.htm.


minlp100_dic_con2_cplex.trc minlp100_minlp.trc minlp100_sbb_con2.trc
minlp100_dic_con2_cplex.trc -- results results
minlp100_minlp.trc -- -- results
minlp100_sbb_con2.trc -- -- --


Resource time summary:

For simple timing information, see the resource time benchmarking tables:

For more detailed timing information, including quality of solution, see the PAVER resource time utility. The resource time utility compares solver resource times of two given solvers over a model test set.

The tool is described in detail at http://www.gamsworld.org/performance/restime.htm.


minlp100_dic_con2_cplex.trc minlp100_minlp.trc minlp100_sbb_con2.trc
minlp100_dic_con2_cplex.trc -- resultsA | resultsB resultsA | resultsB
minlp100_minlp.trc -- -- resultsA | resultsB
minlp100_sbb_con2.trc -- -- --


Editable Data Files:

Excel readable CSV File: exceltrace.csv