network vae Attention-UNet
network based HuggingFace implementation for pretrained neural.
- Input
- 6062-dim embedding
- Encoder
- 27 x Attention-UNet with 56 heads
- Output
- recall projection
Training config
optimizer=SGD, lr=0.115, scheduler=plateau, warmup=484