Binary Cross Entropy: How is it related to basic probability?

This video covers one of the most popular loss functions in machine learning, known as binary cross-entropy and explains how it is related to basic probability theorems.