| ... | @@ -47,6 +47,16 @@ questionnaire phase |
... | @@ -47,6 +47,16 @@ questionnaire phase |
|
|
- [ ] Training instance with local environment can be saved without selected sandbox definition
|
|
- [ ] Training instance with local environment can be saved without selected sandbox definition
|
|
|
- [ ] Deleting training run with assigned sandbox deletes the training run and assigned sandbox
|
|
- [ ] Deleting training run with assigned sandbox deletes the training run and assigned sandbox
|
|
|
|
|
|
|
|
|
##### Training Agenda - Training Instance - Cheating Detection
|
|
|
|
|
|
|
|
- [ ] test navigators and URL mappings of cheating detections overview, cheating detection create, detection events overview and detection event detail
|
|
|
|
- [ ] cheating detection creation correctly assigns all specified attributes to DTO
|
|
|
|
- [ ] cheating detection deletion from table action correctly refreshes the table data
|
|
|
|
- [ ] cheating detection rerun from table action correctly refreshes the table data
|
|
|
|
- [ ] detection events are correctly assigned to a cheating detection they belong to by it's id in the detection event table
|
|
|
|
- [ ] detection events are correctly distinguished based on their type in detection event detail
|
|
|
|
- [ ] detection events and cheating detections can in no way be accessed by Trainees
|
|
|
|
|
|
|
##### Training Agenda - Run
|
|
##### Training Agenda - Run
|
|
|
- [ ] Spice console preload is done when run is started and consoles' URLs are stored in Local Storage
|
|
- [ ] Spice console preload is done when run is started and consoles' URLs are stored in Local Storage
|
|
|
- [ ] connecting through Guacamole console
|
|
- [ ] connecting through Guacamole console
|
| ... | @@ -109,6 +119,18 @@ questionnaire phase |
... | @@ -109,6 +119,18 @@ questionnaire phase |
|
|
## Testing Java backend
|
|
## Testing Java backend
|
|
|
- [ ] boolean checkbox whether commands are required in particular level
|
|
- [ ] boolean checkbox whether commands are required in particular level
|
|
|
|
|
|
|
|
|
##### Training - Cheating Detection
|
|
|
|
- [ ] `createAndExecuteCheatingDetection` rest waypoint correctly creates and executes a cheating detection on training instance
|
|
|
|
- [ ] `rerunCheatingDetection` rest waypoint correctly executes the existing cheating detection from scratch
|
|
|
|
- [ ] `deleteDetectionEvents` rest waypoint correctly deletes a cheating detection and all its associated detection events
|
|
|
|
- [ ] `findAllDetectionEventsOfCheatingDetection` rest waypoint finds all and only detection events of specified cheating detection by id
|
|
|
|
- [ ] `findAllCheatingDetectionsOfInstance` rest waypoint finds all and only cheating detections of specified training instance by id
|
|
|
|
- [ ] test execution of detection method of type `answerSimilarity`, correctness of generated detection events (no incorrectly detected events, no missing occured events)
|
|
|
|
- [ ] test execution of detection method of type `locationSimilarity`, correctness of generated detection events (no incorrectly detected events, no missing occured events)
|
|
|
|
- [ ] test execution of detection method of type `timeProximity`, correctness of generated detection events (no incorrectly detected events, no missing occured events)
|
|
|
|
- [ ] test execution of detection method of type `minimalSolveTime`, correctness of generated detection events (no incorrectly detected events, no missing occured events)
|
|
|
|
- [ ] test execution of detection method of type `noCommands`, correctness of generated detection events (no incorrectly detected events, no missing occured events)
|
|
|
|
|
|
|
## Testing Python backend
|
|
## Testing Python backend
|
|
|
- [ ] check if it is possible to create a sandbox (if the cloud project has enough resources to allocate number of sandboxes)
|
|
- [ ] check if it is possible to create a sandbox (if the cloud project has enough resources to allocate number of sandboxes)
|
|
|
- [ ] test all states of sandbox allocation unit (whether sandbox is in allocation or cleanup stage, fail or success)
|
|
- [ ] test all states of sandbox allocation unit (whether sandbox is in allocation or cleanup stage, fail or success)
|
| ... | | ... | |