Woosung (Reiss) Koh
  • Main
  • Experience
  • News
  • News
  • Experience
  • Projects
    • Pandas
    • PyTorch
    • scikit-learn
  • Blog
    • 🎉 Easily create your own simple yet highly customizable blog
    • 🧠 Sharpen your thinking with a second brain
    • 📈 Communicate your results effectively with the best data visualizations
    • 👩🏼‍🏫 Teach academic courses
    • ✅ Manage your projects
  • Publications
    • Continually Post-training Small Models via Synthetic Self-distillation
    • Language Models Can Control Their Own Attention
    • mSFT: Addressing Dataset Mixtures Overfiting Heterogeneously in Multi-task SFT
    • A Taxonomy of Heterogeneous Statistical Interdependencies for Graph-based Financial Time Series Prediction
    • Generative Visual Code Mobile World Models
    • Predicting LLM Reasoning Performance with Small Proxy Model
    • AdaSTaR: Adaptive Data Sampling for Training Self-Taught Reasoners
    • C$^2$: Scalable Auto-Feedback for LLM-based Chart Generation
    • FlickerFusion: Intra-trajectory Domain Generalizing Multi-Agent RL
    • Encoding Temporal Statistical-space Priors via Augmented Representation
    • Curriculum Learning and Imitation Learning for Model-free Control on Financial Time-series
    • Network-based exploratory data analysis and explainable three-stage deep clustering for financial customer profiling
  • Recent & Upcoming Talks
    • Example Talk
  • Teaching
    • Learn JavaScript
    • Learn Python

Continually Post-training Small Models via Synthetic Self-distillation

Sep 1, 2026·
[P2] Woosung Koh, Hyunsoo Lee, Kyungjae Lee, Haeju Park, Dahyun Lee, Dasol Hwang, Moontae Lee
· 0 min read
PDF
Type
Conference paper
Publication
Pre-print
Last updated on Sep 12, 2026
Continual Learning Self-Distillation Fine-Tuning Small Language Model
Language Models Can Control Their Own Attention May 22, 2026 →

© 2026 Reiss Koh

Published with Hugo Blox Builder — the free, open source website builder that empowers creators.