AI Glossary
The definitive dictionary for AI, Machine Learning, and Governance terminology. From Flash Attention to RAG — look up any term.
K
K-Means
A clustering algorithm that partitions data into K groups by iteratively assigning each data point to the nearest cluster center and then recalculating the centers. K must be specified in advance.
Knowledge Base
A structured or semi-structured collection of information used by AI systems to retrieve factual data. In the context of RAG, it typically refers to the document collection that the system can search.
Knowledge Cutoff
The date after which a language model has no training data. The model cannot reliably answer questions about events that occurred after its knowledge cutoff.
Knowledge Distillation
A model compression technique where a smaller 'student' model is trained to mimic the behavior of a larger 'teacher' model. The student learns not just correct answers but the teacher's nuanced probability distributions.
Knowledge Graph
A structured representation of real-world entities and the relationships between them, stored as a network of nodes (entities) and edges (relationships). Knowledge graphs capture factual information in a machine-readable format.
KV Cache
Key-Value Cache — a mechanism that stores previously computed attention key and value vectors during autoregressive generation, avoiding redundant computation for tokens already processed.