Ander Gapoh • about 1 year ago
Is it ok for judges to supply their own API keys and their own arangodb instance?
Obviously we wouldn't want to supply the API keys for our LLM since they're tied to our accounts. Would it be acceptable to just put comments in the notebook that ask judges to supply their own API keys and arangodb instance should they want to test the app themselves?
Or are we supposed to deploy the app and maintain it for the duration of the evaluation phase?
Comments are closed.

3 comments
Private user • about 1 year ago
Saya tak mengerti juga karna baru
Gurneesh Budhiraja • about 1 year ago
I do not think they would test each app. At max, they would go through the demo and the jupyter notebook to have an idea what was done. And as long as your code is clean and properly commented they would be able to get an idea what each block is doing.
Corey Sommers Manager • about 1 year ago
Thanks for the question! For the hackathon, we want to keep things as accessible as possible for judges and participants. You’re not required to deploy and maintain the app during the evaluation phase. If API keys are tied to personal accounts, it's fine to include comments in the notebook instructing judges to supply their own if they want to test things further.
That said, a well-documented Jupyter notebook and a clear demo should be sufficient for evaluation. Just make sure the judges can easily understand what was done and how the project works without needing to set up too much on their own. Hope that helps!
The key is that your video include a detailed overview of the notebook and also live results being run. The video is what is being judged, not accessing code or logging in to / using participant infrastructure.