Last Updated on 2024-10-13 by Clay What is KL Divergence? In machine learning, we often encounter the term KL Divergence (also known as Kullback-Leibler Divergence). KL Divergence is a metric used to evaluate the difference between two probability distributions P and Q. KL Divergence has many different names across various fields, such as relative entropy, … Continue reading [Machine Learning] Note Of Kullback-Leibler Divergence