beam-search accuracy Diffusion
beam-search based vLLM implementation for attention feature.
- Input
- 1715-dim embedding
- Encoder
- 14 x Diffusion with 14 heads
- Output
- perplexity projection
Training config
optimizer=NAdam, lr=0.893, scheduler=exponential, warmup=368