Dear participants,
We found a small error in the document with the instructions for the
evaluation phase. Particularly, to generate the output CSV format with
your solutions you can use the following pseudo-code:
String = “”
For node_src in range (19):
For node_dst in range (19):
*If node_src != node_dst:*
String += str(delay[node_src, node_dst])+”;”
# New sample, new line
String +=”\n”
This skips the node pairs where the source and destination match, thus
resulting in 342 src-dst delay values (i.e., 19 sources x 18
destinations = 342 values).
Please find attached a new version of the instruction document fixing
this error.
Also, to help you validate the format of your submission files, I attach
a ZIP file with the expected format when applying a solution to our toy
validation dataset
(https://github.com/knowledgedefinednetworking/RouteNet-challenge/tree/maste…).
Note that in this case the results correspond to a 17-node network, so
we have 17x16=272 src-dst delay values per line. However, with the final
test dataset we should expect 342 values per line.
*I would like to take this opportunity to encourage you to register on
our evaluation platform in advance to avoid potential problems before
the evaluation phase starts **(October 1st)**.*
Best regards,
José Suárez-Varela
Barcelona Neural Networking center
Universitat Politècnica de Catalunya
Dear participants,
We are glad to announce that the final test dataset will be publicly
available at the following link from today (Sep 30^th ) at 12:00 (CEST):
https://challenge.bnn.upc.edu/downloads?download=5:gnnet-data-set-evaluation
Please note that the evaluation phase will open on Oct 1^st at 00:00:00
(CEST), so it will NOT be possible to make submissions before this time.
However, you can start generating the submission files with your
solutions. Remember that you can only make a maximum of 5 submissions
each day, and in total each team can make up to 20 submissions. The
evaluation platform will accept submissions until October 15^th at
23:59:59 (CEST).
In the evaluation platform you will be able to find an anonymized
ranking with the 5 best scores at the moment. This may help assess how
good are your results compared to other teams. Each team will be
considered for its best score, regardless of whether it is the last
submission or not. Also, you will have access to a log with all the
submissions of your team registered in our platform and the scores
obtained.
Please do not hesitate to contact us if you have any problems or need
help during the evaluation process.
Enjoy the challenge!
Challenge website: https://bnn.upc.edu/challenge2020
Best regards,
José Suárez-Varela
Barcelona Neural Networking center
Universitat Politècnica de Catalunya
Dear participants,
As maybe some of you may not have received this information, we would
like to share with you that ITU announced officially the following
awards for the winners of the global round:
- *1st prize**: 5,000 CHF *(approx. $5,510 /4,640 €)
- *2nd prize**: 3,000 CHF* (approx. $3,306 / 2,784€)
- *3rd prize**: 2,000 CHF* (approx. $2,204 / 1,856€)
- *3 Runners up*: *1,000 CHF* (approx. $1,102 / 928€) each.
Note that top-3 solutions of the Graph Neural Networking challenge will
have access to the global round.
Also, the winners of this challenge will receive some amounts directly,
which will be announced shortly.
*Please, remember that the evaluation phase starts on **October 1st**,
and **try to register on our evaluation platform with some time in
advance to avoid potential issues. *Also, we recommend to validate the
output format of your submissions with the instructions we provide in
the attached document.
*We encourage all of you to participate in the evaluation*. Even if you
think your solution may not be among the top ones, you have nothing to
lose and eventually you may be gladly rewarded. Also, keep in mind that
there are three winning positions.
Please do not hesitate to contact us if you have any comments or questions.
Enjoy the challenge!
Challenge website: https://bnn.upc.edu/challenge2020
Best regards,
José Suárez-Varela
Barcelona Neural Networking center
Universitat Politècnica de Catalunya
Dear participants,
Thank you again for taking part in this challenge.
The evaluation process will open soon (Oct 1^st -Oct15^th ), and from
the organizing team of the Barcelona Neural Networking center we would
like to share with you some detailed instructions on how it will be
done. Please, read carefully the attached document and *try to register
on our platform before the start of the evaluation phase (Oct 1st).
Also, we recommend to validate in advance the output format of your
submissions with the example dataset and the script we provide*.
Do not hesitate to contact us if you have any comments or questions
about all this process.
Enjoy the challenge!
Challenge website: https://bnn.upc.edu/challenge2020
Regards,
José Suárez-Varela
Barcelona Neural Networking center
Universitat Politècnica de Catalunya