Shisuko's blog

How to Make Output-Only Problems?
By Shisuko, history, 8 months ago, In English

Perhaps I might be blind, but if this was some sort of flag, I can't find it on Polygon.

Specifically, I want something like this: https://codeforces.com/gym/373765/problem/B where the only allowed "language" is ZIP.

I also have other concerns like how to write the checker/do scoring for it. Does anyone have a guide for how to go about this?

Many thanks in advance.

  • Vote: I like it
  • +27
  • Vote: I do not like it

»
8 months ago, # |
  Vote: I like it 0 Vote: I do not like it

Bump

→ Reply
»
8 months ago, # |
  Vote: I like it +8 Vote: I do not like it

Here's how I prepare output-only problems.

There is indeed no output-only flag on Polygon. Instead, if you add the problem to a Codeforces mashup and click on the "Edit" button on the right, there is an output-only option.

Once a problem is set to output-only, contestants can only submit a ZIP file containing files 01.out, 02.out .. and submissions will be graded as if they were a program that outputs 01.out on test case 1, 02.out on test case 2, etc.

If you want to do partial scoring on a problem, you can use the function quitp(percentage between 0 and 100, message) from testlib in you checker and select the option "Treat points from checker as a percent" next to "Enable points" in the Polygon tests page. Apparently there are also scorer files now, but I couldn't get them to work.

Also, since a lot of output-only problems don't have exact solutions, if you want to use custom outputs on a test in Polygon you can append the model outputs to your inputs in Polygon. Then the model solution just reads the input and the model outputs and prints the outputs again. This is fine for output-only problems as long as you only make the inputs (without outputs appended) public and don't let contestants view the test data. Or maybe there is just a way to specify custom outputs that I failed to find :)

I hope this helps!

→ Reply