Foundational Theories and Frontier Technologies of Generative AI and Foundation Models
Foundation Models and Scaling Laws
Large Language Models (LLMs) and Large Multimodal Models (LMMs)
Representation Learning and Self-supervised Learning
Diffusion Models and Generative Architectures
Parameter-efficient Fine-tuning (PEFT) and Model Adaptation
Foundation Model Theory and Emerging Capabilities
Transformer Architecture Improvements and Novel Neural Network Structures
Instruction Following and Capability Elicitation of Foundation Models