AI for Health
My primary focus is medical multimodal understanding and generation, evidence-grounded reasoning, and the evaluation and improvement of medical models and agents.
Explore related workunified models and agents for health
My research focuses on unified multimodal models and agents for health, spanning medical image understanding and generation, evidence-grounded reasoning, and evaluation. My broader work explores multimodal reasoning and agentic methods in general and scientific settings.
I am currently exploring agent–model collaboration and iterative improvement through feedback.
I am excited to explore research collaborations and research internship opportunities across AI, from healthcare and science to new directions. If you have an idea, a project, or an opportunity in mind, I would love to connect!
Feel free to reach out via Email or WeChat. I would be very happy to chat!
I completed an MRes (Distinction) at Imperial College London (Sep 2023 – Oct 2024), with a research project on chest X-ray image analysis for lung diagnosis, supervised by Dr. Matthieu Komorowski and Dr. Guang Yang.
My earlier studies include a Bachelor of Science (Honours) in Data Science with University Medal from The University of Sydney, a concurrent Diploma in Computing, and a Bachelor of Science in Mathematics and Statistics from The University of Melbourne (First-Class Honours).
I have also benefited from the research guidance of Mingming Gong at the University of Melbourne and Junjun He at the General Medical AI (GMAI) group, Shanghai AI Laboratory.
My research focuses on unified multimodal models and agents for health, spanning medical image understanding and generation, evidence-grounded reasoning, and evaluation. My broader work explores multimodal reasoning and agentic methods in general and scientific settings. I am currently exploring agent–model collaboration and iterative improvement through feedback.
Research directionsUnified Models · Agents
Primary focusAI for Health
Broader applicationsGeneral AI · AI for Science
My primary focus is medical multimodal understanding and generation, evidence-grounded reasoning, and the evaluation and improvement of medical models and agents.
Explore related workBroader work on visual reasoning and agentic retrieval, including visual alignment in SIVA-RL.
Explore related workCollaborative work on scientific multimodal foundation models and scientist-aligned evaluation, including Intern-S1 and SGI-Bench.
Explore related workSelected work on medical multimodal understanding and generation, model evaluation, and improvement, alongside a scientific-model collaboration.
Unified medical image understanding and generation through observation, knowledge, and analysis.
Publication detailsTurning image-quality evaluation failures into targeted data collection and model improvement.
Publication detailsEvaluating medical multimodal models under image degradation, including robustness and confidence calibration.
Publication detailsGenerating high-resolution retinal images from fine-grained descriptions of anatomy and pathology.
Publication detailsScientific collaboration
Contributing to a scientific multimodal foundation model for general reasoning and specialist scientific tasks.
Publication detailsExplore the research history through papers, publication venues, and original resources. Browse by application domain or research direction.
Summary: 6× MICCAI, 1× ICML, 1× ECCV, 1× NeurIPS, 1× ICLR, 1× EMNLP Main, 1× EMNLP Findings, 1× IJCAI, 1× WACV, 1× ISBI, 1× PRL, 1× OJEMB
Published & accepted · MICCAI: 1 Spotlight (Best Paper Nominee) · MICCAI: 1 Oral · EMNLP Main: 1 Oral
All publications · Newest first
A shared visual tokenizer for heterogeneous 2D medical images and 3D volumes. Slice differential regularization preserves anatomical continuity, while multi-expert representation alignment brings complementary clinical semantics into a unified token space. The tokenizer supports classification, retrieval, segmentation, synthesis, visual question answering, and medical report generation.
A benchmark examining medical multimodal models under image quality degradations. It combines modality-specific corruption severity, fine-grained capability assessment, and confidence calibration to study robustness beyond performance on clean images.
A data engine for improving medical image quality assessment through an evaluate–explore–evolve loop. Model failure prototypes guide retrieval and human-in-the-loop annotation, followed by fine-tuning and renewed evaluation.
A multimodal reinforcement learning framework that assigns visual alignment supervision according to the observed effect of image interventions. PatchSwap interventions and a frozen audit policy route samples toward sensitivity or invariance objectives for visually grounded reasoning.
A unified medical model for multimodal understanding and generation within one set of weights. Progressive training connects image interpretation with interleaved visual and textual outputs, including cross-modal synthesis and image enhancement.
A continual medical segmentation framework that replays jointly generated image-mask pairs to reduce forgetting across changing modalities and tasks. Bayesian Joint Diffusion preserves image-mask correspondence, while shared task-aware prompts coordinate the generator and segmentor.
Radiology report generation that integrates anatomical region features and detected pathologies into report decoding. Regional prompts connect localized image evidence with the resulting report.
A benchmark for evaluating deep evidence integration in medical guideline development. MedProbe-Eval combines task-adaptive quality rubrics with atomic-claim evidence verification to assess language models and deep research agents against expert guideline references.
A benchmark for integrating multimodal and multi-image evidence in rare-disease cases. Four tracks evaluate diagnosis, treatment planning, cross-image evidence alignment, and examination suggestions using evidence-grounded case questions.
A survey and organized catalog of open-access medical imaging datasets for foundation model development. It maps available data resources and the challenges of assembling heterogeneous medical imaging collections.
Implicit Vector Quantization regularizes visual representations to counter low-rank collapse in concept bottleneck models. Magnet Attention aggregates patch features into interpretable concept prototypes, supporting many-to-many relationships between visual features and concepts.
A framework for tracing the historical development of scientific ideas from literature. It combines proposed evolutionary links with citation-grounded verification to support scientific reasoning and assessment.
Medical image grounding trained with rewards for spatial accuracy and semantic consistency. A Chain-of-Box representation brings referring regions into the model's intermediate reasoning.
Caption-guided retinal image synthesis with fine-grained descriptions of anatomy and pathology. A captioned fundus photograph dataset supports semantic control beyond disease labels and the study of synthetic data for downstream tasks.
Cross-sequence MRI translation formulated as evidential regression. The framework combines uncertainty estimation, multi-source fusion, and distribution calibration to address shifts between medical centers.
Text-guided generation of ophthalmic surgical videos from natural language instructions. A curated video-instruction dataset and progressive tuning adapt a video generation model to ophthalmic workflows.
A data-centered survey of scientific language models, training corpora, and evaluation. It examines the transition from static assessments toward scientific workflows and discusses agents that generate, test, and revise scientific knowledge.
Unpaired translation between chest X-rays with and without lung opacities. Adaptive activation masks and cross-domain alignment focus modifications on opacity regions, with evaluation of lung segmentation and lesion classification.
MedITok learns a shared token space for medical image reconstruction, synthesis, and interpretation. Its two-stage alignment approach uses unpaired images for structural representation and image-text pairs for clinical semantics.
An investigation of latent diffusion representations for lung disease classification in chest X-rays. The study connects image generation representations with diagnostic classification.
CT airway segmentation with parallel supervised and unsupervised learning. Dynamic masking and multi-order response targets address sparse annotations and airway texture variation.
A cyclic vision-language module explains radiology report generators through counterfactual chest X-ray manipulation. Comparing original and manipulated images identifies visual features associated with changes in generated reports.
Medical image generation conditioned on clinical descriptions and segmentation masks. The work uses vision-language representations to investigate how clinical attributes relate to patterns in generated chest CT images.
More on my Google Scholar profile ↗.
Methods and tools for medical multimodal models, agents, data synthesis, and evaluation, with broader general and scientific applications.
Academic achievements and recognitions throughout my research journey.
Awarded University Medal in Bachelor of Science (Honours) for achieving the highest academic distinction (WAM 89.5) in Data Science Honours program. The honour thesis on night-to-day image translation was subsequently accepted at the Australasian Database Conference.
Received merit-based scholarship from University of Melbourne in recognition of academic excellence in Mathematics and Statistics (Overall WAM: 86.8/First Class Honours).
Placed on Dean's Honours List for First Year Bachelor of Science students for exceptional academic performance among the entire cohort.
Research, open-source releases, and personal milestones.
Research training across the University of Melbourne, the University of Sydney, and Imperial College London — a path through data science, mathematics, and medical imaging.
TMI
ICLR 2026, ICLR 2027, ICML 2026, KDD 2027, ISBI 2026, MICCAI 2026, ECCV 2026
I am grateful to my supervisors and mentors, Guang Yang, Matthieu Komorowski, and Mingming Gong, and to my research leaders at Shanghai AI Laboratory, Junjun He and Yirong Chen, for their guidance and support. I also thank my senior collaborators Ming Hu, Ziyan Huang, Jin Ye, and Yuanfeng Ji for their advice and close collaboration.
I also thank Jiyao Liu, Cheng Tang, Wei Li, Lihao Liu, Sheng Zhang, Xiaodan Xing, Yingying Fang, Jinjie Wei, and my other collaborators for their ideas, discussions, and contributions to our research.
I am excited to explore research collaborations and research internship opportunities across AI, from healthcare and science to new directions. If you have an idea, a project, or an opportunity in mind, I would love to connect!
Have something in mind? Reach out by email or WeChat. I would be very happy to chat!