Skip to content

Could you release the original answers from LLMs? #1

Open

Description

@authenticz

I noticed that you only released the score in the dataset. It would be more helpful if you could release the original answers. Thank you!

Activity

  1. linggm3 commented on May 8, 2025

    @linggm3
    Collaborator

    Thanks for the suggestion! 🙌
    We agree that releasing the original answers would be more helpful.
    However, due to the size and complexity of the raw response data, we're currently working on proper organization.
    We plan to release this supplemental material in a future update once we've ensured proper formatting and documentation. 

  2. bofusun commented on Aug 11, 2025

    @bofusun

    Hello,
    Thank you for your work and for considering releasing the original answers, it would greatly benefit the community for detailed analysis and comparison.
    I am also very interested in obtaining the dataset containing the original answers. May I kindly ask if it is possible to access this supplemental data at present?

  3. linggm3 commented on Oct 19, 2025

    @linggm3
    Collaborator

    Hi authenticz and bofusun,
    Thank you for your interest and feedback! We’ve now released the original answers at the following link:
    huggingface_RouterEval_full_data
    Feel free to check it out, and let us know if you have any further questions!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions