Supervising Sound Localization Using In-the-wild Ego-motion
Learn spatial sound sources in the wild using ego-motion signals derived from visual cues with limited perspectives.
Anna Min | 闵安娜
Hi! I received B.E. at Tsinghua University, where I study computer science and statistics.
Email: anna.min1754@gmail.com (if you prefer an edu email, annamin@csail.mit.edu)
Recent Updates
- Feb. 2025: One paper got accepted to CVPR 2025. See you in Nashville TN. Feel free to reach out!
- Sep. 2024: I gave a talk at MIT ML Tea Time titled "Multi-sensory Perception from Top to Down." [link]
- Feb. 2024: The feature for multi-modal generation based on the algorithm and demo that I designed gained over 246k views on Twitter during my internship at Pika Labs .
Research
I study intelligent agents through multimodal perception, generative models, and world modeling. My previous work explores how different modalities, including vision, audio, and language, interact and emerge in intelligent systems.
Selected Publications
A Unit-based System and Dataset for Expressive Direct Speech-to-Speech Translation
Propose a dataset and pipeline with aligned bilingual audio tracks sharing similar emotions without using text as an intermediate for lesser-spoken languages and dialects.
Submissions
Physically-Grounded Video to Spatial Audio Generation
Generate spatial audio from video by grounding sound generation in physical interactions and visual scene understanding.
Unified Spatial Audio Understanding And Generation
A unified framework for spatial audio perception and generation, connecting multimodal understanding with controllable audio synthesis.
See, Infer, Intervene: Proactive World Modeling for Goal-Oriented Social Intelligence
Develop proactive world models that enable agents to infer social dynamics and intervene toward goal-oriented intelligence.
Projects
Pika 1.5
Core contributor to Pika 1.5, a generative video model enabling text-to-video creation and video editing.
Other Works
Quantifying Geometrical Associations Across Multi-modal Perception: An Information-theoretic Perspective
Study geometric relationships across multimodal representations from an information-theoretic perspective.
When End-to-End is Overkill: Rethinking Cascaded Speech-to-Text Translation
Revisit cascaded speech translation systems and analyze when end-to-end approaches are unnecessary.
Selected Awards
- 2023, Tsinghua University Academic Excellence Award (2/103)
- 2022-2024, Tsinghua University Research Excellence Award (2/103)
- 2022, Spark Innovative Talent Cultivation Program (top 1%, 50/3900 undergraduates in Tsinghua for research performance)
- 2021, Meritorious Winner of Mathematical Contest in Modeling (top 0.18%, ranked 89th/49424)
Service
- Reviewer: ICASSP 2025, CVPR 2025, NeurIPS 2024
- Support underrepresented students: Volunteered with the Program Buddy Group at Tsinghua University, working with underrepresented students interested in coding, 2022
Misc: Art Creation
In the past I designed and developed video games (eg: A Player vs AI Strategy Game ). My Chinese name is pronounced as Ān Nà, which is similar to Anna.