discriminator should be frozen in the combined model
In the training phase, when the encoder is adapted to "cheat" the discriminator, the discriminator itself must be fixed. But we let the discriminator also change in the stage, which breaks the general AAE idea.
The .trainable
parameter of all discriminator layers must be set to False
before compiling combined
.