News
Oct. 1, 2013
Details about the CASMI 2013 Special Issue and dates are now available! Sept. 24, 2013
The rules and challenge data pages have been updated. Sept. 2, 2013
The CASMI 2013 Challenges have been officially released! August 29, 2013
The challenges for CASMI2013 will be released on Monday, September 2nd! August 29, 2013
The CASMI 2012 poster will be presented in Langenau in November 2013
Oct. 1, 2013
Details about the CASMI 2013 Special Issue and dates are now available! Sept. 24, 2013
The rules and challenge data pages have been updated. Sept. 2, 2013
The CASMI 2013 Challenges have been officially released! August 29, 2013
The challenges for CASMI2013 will be released on Monday, September 2nd! August 29, 2013
The CASMI 2012 poster will be presented in Langenau in November 2013
Evaluation Scipts
In February, we are going to drop the submissions into a folder for
each participant
, and run the evaluation script on all of
them. Participants will get a sneak peak to make sure all is working well.
The script will read the table of correct solutions,
preprocess the submissions (normalising the scores
to sum(score)=1) and calculate the evaluation
measures. Finally, a set of HTML tables and graphics are
produced to give an overview of the results.
Changelog
The following relevant changes have been made to the
script. For full details, please fire up you SVN client and
check the commit history of the
for contest SVN.
6.2. refactored script to handle all categories alike.