I'm Zhiyuan Song, and you can also call me Allen. I'm an M.S.E. student in Computer and Information Science (AI Track) at the University of Pennsylvania, where I work as a Deep Learning Researcher advised by Prof. Jiatao Gu on multimodal foundation models and LLM reasoning. I'm also an AI Engineer Intern at Millennium Management in New York.

My primary research interests lie in building intelligent, real-time interactive systems. My current focus spans LLM post-training, Omni & multi-model systems, real-time interaction models, agent harnesses, continual learning, and long-horizon tasks. I am also passionate about robust AI infrastructure and optimizing distributed training pipelines.

Outside research, I build AI products and the infrastructure behind them. ThunderTalk is an open-source, on-device voice toolkit for macOS, and Wemute is a local-first file converter. I am also building agent systems that carry real work: digital employees, a research and data-analysis pipeline, and a shared skill and memory layer for coding agents. At Millennium, an internal AI tool I built grew from my team to about 190 colleagues.

I completed my undergraduate studies at the University of Virginia, where I double majored in Computer Science and Applied Statistics and graduated with High Distinction, and was fortunate to conduct research advised by Prof. Madhav Marathe, Prof. S.S. Ravi, and Prof. N. Rich Nguyen.

I'm always glad to talk with founders and researchers about early-stage ideas. Here is how I got here and what I would bring to a founding team. Feel free to reach out.

Education

  • University of Pennsylvania

    Master of Science in Engineering (M.S.E.), Computer and Information Science (AI Track).

    2025.8 - 2027.5
  • University of Virginia

    Bachelor of Arts with High Distinction, Computer Science & Applied Statistics.

    Honors: Dean's List; UVA Grad App Fund Scholarship; NSF Fund.

    2021.8 - 2024.12

Experience

  • Millennium Management

    AI Engineer Intern — Cloud & AI/ML Infrastructure

    Jun 2026 - PresentNew York, NY
  • University of Pennsylvania

    Deep Learning Researcher with Prof. Jiatao Gu — LLM post-training (SFT → RL) on 4×B200

    Aug 2025 - PresentPhiladelphia, PA
  • Entropinia

    Founder — my own brand and studio; built Legal Manus, a RAG legal assistant

    Jun 2024 - PresentChina

News

Selected Publications

Learning When to Think While Listening in Large Audio-Language Models

Z. Song, W. Zhao, Y. Xiao, S. Yu, C. Zhu, J. Gu

ICLR 2027Under reviewInternational Conference on Learning Representations

Learning When to Think While Listening in Large Audio-Language Models teaser figure

SL4HOI: Supervised Learning for Predicting Health Opportunity Index across States

Z. Song, Z. Mei, L. Li, N. Nguyen

KDD-UC 2024KDD Undergraduate Consortium, Barcelona

SL4HOI: Supervised Learning for Predicting Health Opportunity Index across States teaser figure