Greetings World!
I am a machine learning engineer at DSO National Laboratories. I trained large language models at scale, including finetuning (10-20B models) and pretraining (1-3B models on 1T tokens, work-in-progress).
I graduated from National University of Singapore Computer Science. I was also part of the Turing Research Programme.
Previously, I researched on semi-supervised text classification at DSO under Hai Leong and Prof Wee Sun. I also researched on Bayesian Optimisation at NUS under A/P Bryan Low.
News
310522
: I’ve graduated!
160122
: I’ve submitted a short paper for review at NAACL 2022 🥳! I owe much to my supervisors Dr Chieu and Prof Wee Sun.
170521
: I’ve published my automatic github issue labeller in the market place. 😄