# Lee Lab @ UW Madison

Research focus: Theory and algorithms for *deep learning with foundation models*.

## Selected Work

Link | Topic/Type | TLDR | Summary | Github |
---|---|---|---|---|

[Arxiv’24] | LLM/Theory | Dual Operating Modes of In-Context Learning | Summary | Github |

Arxiv’24 | LLM/Algorithm | Can MLLMs Perform Text-to-Image In-Context Learning? | Summary | Github |

ICLR’24 | PEFT/Theory | The Expressive Power of Low-Rank Adaptation (LoRA) | Summary | Github |

ICLR’24 | LLM/Algorithm | Image Clustering Conditioned on Text Criteria | Summary | Github |

ICLR’24 | LLM/Algorithm | Teaching Arithmetic to a Small Transformer | Summary | Github |

ICLR’24 | LLM/Algorithm | A Looped-Transformer Architecture for Efficient Meta-learning | Summary | Github |

NeurIPS’23 | Diffusion/Algorithm | Reinforcement learning for improved text-to-image alignment | Summary | Github |

ICML’23 | LLM/Theory | Looped Transformers as Programmable Computers | Summary | Github |

ICML’23 | Diffusion/Algorithm | Reinforcement learning for faster DDPM sampling | Summary | Github |

NeurIPS’22 | LLM/Algorithm | LIFT: Language-Interfaced Fine-Tuning for Non-Language Machine Learning Tasks | Summary | Github |

NeurIPS’22 | Diffusion/Theory | Score-based Generative Modeling Secretly Minimizes the Wasserstein Distance | Summary | Github |

## Selected Talks on Deep Learning with Foundation Models

- (Feb. 2024) Foundations of Data Science - Virtual Talk Series @ UCSD/NSF TRIPODS Institute on Emerging CORE Methods in Data Science (EnCORE)

Title:*Theoretical Exploration of Foundation Model Adaptation Methods* - (Dec. 2023) CSP Seminar @ University of Michigan

Title:*Towards a Theoretical Understanding of Parameter-Efficient Fine-Tuning (and Beyond)* - (Nov. 2023) Efficient ML workshop @ Google Research New York

Title: The Expressive Power of Low-Rank Adaptation (LoRA) - (Oct. 2023) Trust Perspectives in Machine Learning, Law, and Public Policy at the Institute for Data, Econometrics, Algorithms, and Learning (IDEAL) @ Northwestern University
- (Oct. 2023) Distinguished Lectures in Microbiology @ University of Wisconsin-Madison
- (May 2023) KSEA Distinguished Guest Series
- (Feb. 2023) Information Theory and Applications Workshop
- (Feb. 2023) The Coordinated Science Laboratory Student Conference @ UIUC
- (Jan. 2023) Information Theory and Data Science Workshop @ National University of Singapore
- (Jan. 2023) Systems, Information, Learning and Optimization (SILO) Seminar @ University of Wisconsin-Madison

## News

- (Feb. 2024) One paper is accepted to
**[TMLR]** - (Jan. 2024) Four papers are accepted to
**[ICLR’24]** - (Sep. 2023) One paper is accepted to
**[NeurIPS’23]** - (May 2023) One paper is accepted to
**[ACL’23 (Findings)]** - (Apr. 2023) Three papers are accepted to
**[ICML’23]**