|
|
|
This serves as a template for every KYPO release testing. Create an issue named **Testing Realease `YY.MM`**. Copy below content and fill needed information as release date, links to issues, etc. Feel free to contribute and extend this tests with other test cases.
|
|
|
|
|
|
|
|
## Testing Angular frontend
|
|
|
|
- [ ] preferred pagination is stored for session
|
|
|
|
- [ ] thoughtful testing of [linear training](https://gitlab.ics.muni.cz/groups/muni-kypo-crp/-/wikis/Testing-KYPO-instance/Linear-Training)
|
|
|
|
- [ ] thoughtful testing of [adaptive training](https://gitlab.ics.muni.cz/groups/muni-kypo-crp/-/wikis/Testing-KYPO-instance/Adaptive-Training)
|
|
|
|
- [ ] thoughtful testing of [sandbox interactions](https://gitlab.ics.muni.cz/groups/muni-kypo-crp/-/wikis/Testing-KYPO-instance/Sandbox-Interactions)
|
|
|
|
##### Training Agenda - Definition
|
|
|
|
- [ ] Detail pages for adaptive/linear training definition
|
|
|
|
- [ ] Save strategy unification in adaptive/linear training definition edit (Level/Phase edit)
|
|
|
|
- [ ] Variant Answers
|
|
|
|
- [ ] Reference Solution
|
|
|
|
- [ ] Stepper bar added to preview of linear TD
|
|
|
|
- [ ] Show stepper bar option for preview of linear TD
|
|
|
|
- [ ] Question stepper added to assessment level/adaptive questionnaire phase/general questionnaire phase
|
|
|
|
##### Training Agenda - Instance
|
|
|
|
- [ ] Detail page for adaptive/linear instance (detail for training run in instance detail)
|
|
|
|
- [ ] Save strategy unification in adaptive/linear training instance edit (Pool edit)
|
|
|
|
- [ ] Selecting from more than 10 pools
|
|
|
|
- [ ] Create training instance with assigned pool and save it. Edit it again and save - check whether pool is still assigned. [Detailed description](https://gitlab.ics.muni.cz/muni-kypo-crp/kypo-crp-issues/-/issues/300).
|
|
|
|
##### Training Agenda - Run
|
|
|
|
- [ ] Spice console preload
|
|
|
|
- [ ] connecting through Guacamole console
|
|
|
|
- [ ] connecting through SSH config
|
|
|
|
- [ ] adaptive/linear training run (hints), solution, answer field, get ssh config
|
|
|
|
- [ ] topology legend, open console replaced generate console URL
|
|
|
|
- [ ] initial expansion of a small topology (up to 12 nodes)
|
|
|
|
##### Sandbox Agenda - Definition
|
|
|
|
- [ ] title of sandbox definition redirects to gitlab repository for sandbox definition
|
|
|
|
##### Sandbox Agenda - Pool
|
|
|
|
- [ ] clicking on pool title redirects to pool detail
|
|
|
|
- [ ] clicking on sandbox title redirects to sandbox detail with Allocation Request Stages, stage details are present for all stages
|
|
|
|
- [ ] display topology action preloads VM consoles for spice and has refactored topology
|
|
|
|
- [ ] allocate all, delete failed and delete all functionality
|
|
|
|
- [ ] polling of stages status
|
|
|
|
- [ ] get ssh config
|
|
|
|
- [ ] lock/unlock sandbox
|
|
|
|
- [ ] filtering in resource page
|
|
|
|
#### User and Group Agenda - User
|
|
|
|
- [ ] detail page for user, expandable role info
|
|
|
|
#### User and Group Agenda - Group
|
|
|
|
- [ ] detail page for group, expandable role info, filtering of users, filtering of role types
|
|
|
|
|
|
|
|
#### Visualizations
|
|
|
|
- [ ] instructor view - proper functionality of hurdling - progress visualization in ongoing training
|
|
|
|
- [ ] trainee view - proper functionality of adaptive transition visualization after adaptive training (Check Show results of adaptive run as well from training run table).
|
|
|
|
- [ ] trainee view - proper functionality of redesigned overview visualization after linear training - without reference solution
|
|
|
|
- [ ] trainee view - proper functionality of redesigned overview visualization after linear training and command analysis components - with reference solution
|
|
|
|
- [ ] instructor view - proper functionality of redesigned overview visualization after linear training in dashboard - without reference solution
|
|
|
|
- [ ] instructor view - proper functionality of redesigned overview visualization after linear training in dashboard and command analysis components - with reference solution
|
|
|
|
## Testing Java backend
|
|
|
|
- TBS
|
|
|
|
|
|
|
|
## Testing Python backend
|
|
|
|
- [ ] state to sandbox allocation unit (whether sandbox is in allocation or cleanup stage, fail or success)
|
|
|
|
- [ ] APG integration
|
|
|
|
- [ ] Cleanup stage changes (mainly check that cleanup stage is not depending on correct user git repo)
|
|
|
|
- [ ] create an endpoint to retrieve the IP address of MAN outer interface (used for Guacamole access)
|
|
|
|
- [ ] add hardware usage attribute for pools (check correct values for resource utilization)
|
|
|
|
- [ ] add the owner_specified.openstack parameters for images
|
|
|
|
- [ ] support for JWT token (check if Microsoft user has all permissions in sandbox agenda)
|
|
|
|
- [ ] create an endpoint to delete multiple sandboxes
|
|
|
|
- [ ] check if it is possible to create sandbox (if cloud project has enough resources to allocate number of sandboxes)
|
|
|
|
- [ ] optimize sandbox topology (build various sandboxes, check sandbox access to nodes)
|
|
|
|
- [ ] update topology visualization data (check topology visualization)
|
|
|
|
- [ ] create an endpoint to retrieve spice consoles to all accessible nodes of sandbox
|
|
|
|
- [ ] optimize pool operations (some data for pools are cached thus listing pools and pool detail should be nearly instant)
|
|
|
|
- [ ] add created_by field for sandbox resources (definition, pool, sandbox)
|
|
|
|
- [ ] `nmap` shouldn't discover hosts in private address ranges outside the topology definition. [Detailed description](https://gitlab.ics.muni.cz/muni-kypo-crp/kypo-crp-issues/-/issues/206).
|
|
|
|
|
|
|
|
**Bugs/issues found during testing of frontend should be reported in this issue** (link appropriate issue here)
|
|
|
|
|
|
|
|
**Bugs/issues regarding sandbox agenda (python backend) should be reported in this issue** (link appropriate issue here)
|
|
|
|
|
|
|
|
##### Deployed instance URL:
|
|
|
|
https://`<instance URL>` |
|
|
|
\ No newline at end of file |
