Hi, I am Lexin, an MPhil graduate in Advanced Computer Science at the University of Cambridge, generously funded by Open Philanthropy. This fall, I will be joining the Language Technology Lab (LTL) at Cambridge to pursue my PhD in AI Evaluation under the wonderful supervision of Prof. Anna Korhonen and Prof. Jose Hernandez-Orallo. Prior to this, I have been engaged in research and consultancy roles on AI Evaluation at Meta AI, OpenAI, the Krueger AI Safety Lab, VRAIN, and the European Commission JRC.
I spend my day thinking about (i) creating robust evaluation methods that provide meaningful descriptions of AI’s capabilities and risks, and (ii) finding ways to shape the predictability and reliability of AI positively; I have a special interest in general-purpose systems like large language models.
Recent Highlights
An LLM Feature-based Framework for Dialogue Constructiveness Assessment preprint at Arxiv.
Participated in the Red Team of LLaMA-3, focusing on adversarial testing.
Started my MPhil studies in Advanced Computer Science at Cambridge.
Predictable Artificial Intelligence preprint at Arxiv.
Participated in the Red Team of GPT-4, focusing on capability assessment, reliability evaluation, and adversarial testing.
Co-organising a workshop on “Predictable AI” on March 8th, 2023.
One paper published at JMIR public health and surveillance: “Subphenotyping of Mexican Patients With COVID-19 at Preadmission To Anticipate Severity Stratification: Age-Sex Unbiased Meta-Clustering Technique” with N Romero-García, J Martínez-Miranda, JA Conejero, JM García-Gómez, C Sáez. The paper was awarded 1st prize for the research publication with the highest annual impact factor at ITACA Institute - UPV in 2022.
Two paper accepted by IJCAI-2022 EBeM Workshop: “Reject Before You Run: Small Assessors Anticipate Big Language Models” with F Martínez-Plumed, J Hernández-Orallo, C Ferri, W Schellaert, and “A Framework for Categorising AI Evaluation Instruments” with AG Cohn, J Hernández-Orallo, JS Mboli, Y Moros-Daval, Z Xiang.
Awards
Open Philanthropy Long-term Future Scholarship.
1st prize for the research publication with the highest annual impact factor, Institute of Information and Communication Technologies (ITACA) at UPV, 2022.
National Undergraduate Research Collaboration Fellowship, Ministry of Education - Government of Spain, 2022
Artificial Intelligence and the Future of Skills Research Collaboration Fellowship, OECD & VRAIN, 2022
Excellence Scholar Award with the best annual course record, UPV, 2019-2023
Santander Bank Studies Progress Scholarship, 2021
In the Media
Don’t take this too seriously: