-
Retrieval-Augmented Diffusion Model
May 18, 2022A review of the paper that enhances diffusion models using retrieval-based approaches from NLP, achieving high-fidelity image generation with fewer parameters.
7 min read ·computer-visionnlp+1 -
Med-BERT
May 17, 2022A review of Med-BERT, a BERT-based model pretrained on structured EHR data for disease prediction.
5 min read ·nlppaper-review -
Condenser, coCondenser
May 16, 2022Paper review of Condenser and coCondenser for dense retrieval pre-training.
2 min read ·nlppaper-review -
Grad Cache
April 12, 2022An approach that enables large-batch contrastive learning under memory constraints, similar to gradient accumulation.
1 min read ·mlml-engineering+2