Phases & Rules¶
Open Development Phase 🧠¶
During the Open Development Phase, participants will have access to the training data to develop their models. They can submit their models to the validation set, and a live leaderboard will display performance based on these submissions.
The private validation set is primarily intended to help participants verify that their models are functioning correctly on the platform. While it provides performance feedback, it is not advised to solely rely on the validation set for final model selection.
Furthermore, the validation set is small compared to the eventual test set, so leaderboard results during this phase may not accurately reflect final performance. Participants are encouraged to focus on building models that generalize well to unseen data.
Closed Testing Phase 🧪¶
In the Closed Testing Phase, participants will submit their final models or predictions for evaluation on the full test set. The official results will be announced during the EndoVis workshop day at MICCAI 2025 in Daejeon, South Korea.
Following the workshop, the final leaderboard will be published, reflecting performance on the test set and determining the official ranking of all participants.
Participation Rules 📝¶
To ensure fairness and transparency, all participants in the RARE 2025 challenge must adhere to the following rules:
- Adherence to Challenge Rules: All participating teams must comply with the ENDOSCOPIC VISION CHALLENGE RULES. A signed copy of these rules must be submitted to the challenge organizers by each team.
- Team Registration: Participants must register as part of a team, even if the team consists of only one member. Each participant may join only one team.
- Profile Verification: Anonymous participation is not permitted. Verified profiles must accurately display each participant’s real name, affiliation, and country.
- Eligibility: Members of sponsoring or organizing institutions (such as Eindhoven University of Technology, Amsterdam University Medical Centers) are welcome to participate but are not eligible for awards or final rankings.
- Use of External Resources: Utilization of external data or pre-trained models is permissible, provided they are publicly licensed and disclosed in the algorithm description or publication.
- Closed Testing Phase: To participate in the Closed Testing Phase, teams must submit a concise research paper (2–3 pages) detailing their methodology and include a link to the code used for training.
- Code Publication: All participants must publish their code under the MIT license to be eligible for the final leaderboard.
- Disqualification: The organizers reserve the right to disqualify any team for unethical behavior or non-compliance with challenge rules.