Link Search Menu Expand Document

Full Publications

Preprints, Conference Papers, and Journal Papers.

Selected Publications on Theory and Algorithms for Deep Learning with Foundation Models.

2024

  • Dual Operating Modes of In-Context Learning
    Ziqian Lin and Kangwook Lee
    ICML 2024 | Summary | Github
  • Can Mamba Learn How To Learn? A Comparative Study on In-Context Learning Tasks
    Jongho Park, Jaeseung Park, Zheyang Xiong, Nayoung Lee, Jaewoong Cho, Samet Oymak, Kangwook Lee, Dimitris Papailiopoulos
    ICML 2024 | Summary | Github
  • Memorization Capacity for Additive Fine-Tuning
    Jy-yong Sohn, Dohyun Kwon, Seoyeon An, Kangwook Lee
    UAI 2024 | Summary | Github
  • The Expressive Power of Low-Rank Adaptation
    Yuchen Zeng and Kangwook Lee
    ICLR 2024 | Summary | Github
  • Image Clustering Conditioned on Text Criteria
    Sehyun Kwon, Jaeseung Park, Minkyu Kim, Jaewoong Cho, Ernest K. Ryu, and Kangwook Lee
    ICLR 2024 | Summary | Github
  • Teaching Arithmetic to Small Transformers
    Nayoung Lee, Kartik Sreenivasan, Jason Lee, Kangwook Lee, and Dimitris Papailiopoulos
    ICLR 2024 | Summary | Github
  • Looped Transformers are Better at Learning Learning Algorithms
    Liu Yang, Kangwook Lee, Robert D Nowak, and Dimitris Papailiopoulos
    ICLR 2024 | Summary | Github

2023

2022