Skip to content

Commit bf07dcc

Browse files
update
1 parent f8f2000 commit bf07dcc

1 file changed

Lines changed: 22 additions & 14 deletions

File tree

src/pages/challenge.astro

Lines changed: 22 additions & 14 deletions
Original file line numberDiff line numberDiff line change
@@ -33,6 +33,10 @@ const pageTitle = "MindCube Challenge @ CVPR 2026 CVinW";
3333
<i class="fas fa-flask"></i>
3434
Test Set (Coming Soon)
3535
</a>
36+
<a href="https://eval.ai/web/challenges/challenge-page/2687/overview" target="_blank" class="cta-btn cta-primary">
37+
<i class="fas fa-upload"></i>
38+
Submission Portal
39+
</a>
3640
</div>
3741
</div>
3842
</section>
@@ -69,8 +73,8 @@ const pageTitle = "MindCube Challenge @ CVPR 2026 CVinW";
6973
</li>
7074
<li>
7175
<i class="fas fa-upload"></i>
72-
<strong>Submission Portal:</strong>
73-
<span class="coming-soon-text">Coming Soon</span>
76+
<strong>Submission Portal:</strong>
77+
<a href="https://eval.ai/web/challenges/challenge-page/2687/overview" target="_blank">EvalAI — MindCube Challenge</a>
7478
</li>
7579
</ul>
7680
</div>
@@ -246,21 +250,21 @@ const pageTitle = "MindCube Challenge @ CVPR 2026 CVinW";
246250
<h4>Submission File Format (JSONL)</h4>
247251
<p>Submit a single <code>.jsonl</code> file with one JSON object per line, containing:</p>
248252
<ul class="simple-list">
249-
<li><code>question_id</code> (string)</li>
250-
<li><code>prediction</code> (string or integer — choose one convention and keep it consistent)</li>
253+
<li><code>id</code> (string) — the question ID from the test set</li>
254+
<li><code>answer</code> (string) — the predicted option letter (e.g., <code>"A"</code>, <code>"B"</code>, <code>"C"</code>, <code>"D"</code>)</li>
251255
</ul>
252256

253257
<div class="code-example">
254258
<div class="code-header">
255259
<span>Example submission format</span>
256260
</div>
257-
<pre><code set:html={`{"question_id":"mc_000001","prediction":"B"}
258-
{"question_id":"mc_000002","prediction":"A"}`}></code></pre>
261+
<pre><code set:html={`{"id": "among_group693_q1_5_2", "answer": "C"}
262+
{"id": "around_group012_q3_1_0", "answer": "A"}`}></code></pre>
259263
</div>
260264

261265
<h4>Requirements</h4>
262266
<ul class="simple-list">
263-
<li>Provide exactly one prediction for each <code>question_id</code> in the test set.</li>
267+
<li>Provide exactly one prediction for each <code>id</code> in the test set.</li>
264268
<li><strong>Duplicate IDs:</strong> Keep last / invalid submission</li>
265269
<li><strong>Missing IDs:</strong> Count as incorrect / invalid submission</li>
266270
<li><em>(Recommended)</em> You may gzip the file for size: <code>predictions.jsonl.gz</code></li>
@@ -282,24 +286,28 @@ const pageTitle = "MindCube Challenge @ CVPR 2026 CVinW";
282286
</div>
283287
<div class="step">
284288
<span class="step-number">4</span>
285-
<p>Submit via upload form <span class="coming-soon-text">(coming soon)</span> or email to
286-
<a href="mailto:qinengw@u.northwestern.edu">qinengw@u.northwestern.edu</a>
287-
with subject: <code>MindCube Challenge Submission: TeamName</code></p>
289+
<p>Submit your predictions on
290+
<a href="https://eval.ai/web/challenges/challenge-page/2687/overview" target="_blank">EvalAI</a>.
291+
Questions? Contact <a href="mailto:qinengw@u.northwestern.edu">qinengw@u.northwestern.edu</a>.</p>
288292
</div>
289293
</div>
290294

291295
<div class="deadline-box">
292296
<div class="deadline-item">
293297
<i class="fas fa-repeat"></i>
294-
<strong>Submission Limit:</strong> Up to 3 submissions per team; last submission before the deadline counts
298+
<strong>Submission Limit:</strong> Up to 5 submissions per day, 100 submissions total per team across the challenge
299+
</div>
300+
<div class="deadline-item">
301+
<i class="fas fa-flask"></i>
302+
<strong>Dev Phase Deadline:</strong> May 22, 2026 (AoE)
295303
</div>
296304
<div class="deadline-item">
297305
<i class="fas fa-clock"></i>
298-
<strong>Deadline:</strong> <span class="tbd">TBD</span>
306+
<strong>Test Phase Deadline:</strong> May 25, 2026 (AoE)
299307
</div>
300308
<div class="deadline-item">
301309
<i class="fas fa-trophy"></i>
302-
<strong>Results Announcement:</strong> <span class="tbd">TBD</span>
310+
<strong>Results Announcement:</strong> May 31, 2026
303311
</div>
304312
</div>
305313
</div>
@@ -311,7 +319,7 @@ const pageTitle = "MindCube Challenge @ CVPR 2026 CVinW";
311319
<ul class="rules-list">
312320
<li>
313321
<i class="fas fa-database"></i>
314-
<strong>External data / models / APIs:</strong> <span class="tbd">Allowed or disallowed — TBD; if allowed, require disclosure</span>
322+
<strong>External data / models / APIs:</strong> Open-source models and external data are allowed. <span class="not-allowed">Commercial API-only (closed-source) models are disallowed.</span> Please disclose any external resources used in your method description.
315323
</li>
316324
<li>
317325
<i class="fas fa-user-slash"></i>

0 commit comments

Comments
 (0)