2 posts

Profound of Cross-Entropy

Today I'm going to discuss cross-entropy and Binary cross-entropy. Before that, we need to understand the basics of the Sigmoid and Softmax function. Let's dive in. Sigmoid Function It squashes a vector in the range (0, 1). It is applied independent...

Apr 5, 20215 min read

Mar 22, 2021
Mar 22, 20215 min read
Deep Dive into Entropy, Cross-Entropy, KL-divergence
In the machine learning field, we heard the term cross-entropy a lot, but what the heck is this, and what this function does. So today we're going to discuss what is entropy, cross-entropy, KL-divergence? Entropy from Physics Perspective The idea o...
5 min read

Shakib Khan's

Latest articles

Profound of Cross-Entropy

Deep Dive into Entropy, Cross-Entropy, KL-divergence