This short report summarizes the discussions and recommendations of the working group on “Query Optimizer Benchmarks and Cost Model Verification”. It does not propose an actual benchmark, but provides some guidelines and requirements for what such a benchmark should look like. Designing a benchmark that follows these guidelines is left for the (not so distant?) future.