2022
Med-BERT
May 17, 2022A review of Med-BERT, a BERT-based model pretrained on structured EHR data for disease prediction.
5 min read·nlppaper-reviewCondenser, coCondenser
May 16, 2022Paper review of Condenser and coCondenser for dense retrieval pre-training.
2 min read·nlppaper-reviewGrad Cache
April 12, 2022An approach that enables large-batch contrastive learning under memory constraints, similar to gradient accumulation.
1 min read·mlml-engineering+2NVTabular
April 12, 2022Introduction to NVTabular, NVIDIA's GPU-accelerated library for tabular data feature engineering and preprocessing.
1 min read·mlmlopsAirflow and Kubernetes
April 8, 2022Comparison of two approaches for running Airflow on Kubernetes: deploying Airflow components as pods vs. using KubernetesExecutor with KubernetesPodOperator.
2 min read·mlopsSplit VRAM of GPU on Kubernetes
April 8, 2022Exploring options for splitting GPU VRAM across pods in Kubernetes, including replicas, extended resources, and GPU virtualization.
1 min read·mlops