Research Interests

I’m interested in designing RL environments in which agents can genuinely learn. Designing a non-hackable environment is a lot like sculpting a work of art. As agents become more capable, the environments they require grow increasingly complex, and the distinction between a well-designed environment and a poorly designed one becomes ever more consequential. I am convinced that environments will become the most crucial component of post-training.

Previously, I worked on post-training LLMs for efficiency (reducing token and tool usage), safety (abstention), and general capability (math and question answering). Back then, I mainly designed rewards that shaped model behavior, along with tasks that probed how well those rewards worked.

šŸ’¬ If you have any feedbacks about me, enter it here.

Misc

At the end of my PhD, I started to explore more non-tech stuff to understand myself better, such as expressing more of my opinions and being more brave to show my imperfections in public, you can find my other social medias such as ēŸ„ä¹Ž, å°ēŗ¢ä¹¦, bilibili, 小宇宙.

šŸ“« Contact

Email: jinyansu6[@]gmail.com

Education

Cornell
Ph.D. in Computer Science
2023 – 2026
Stanford
Visiting Student in Computer Science
2025
UESTC
B.S. in Information and Computing Sciences
2018 – 2022

Experience

Microsoft
Copilot Tuning
May 2026 – Aug 2026
Meta
FAIR Alignment
Dec 2025 – May 2026
Adobe
Adobe Research
May 2025 – Aug 2025