Shakib Khan's

Shakib Khan's
2 posts
Profound of Cross-Entropy
Today I'm going to discuss cross-entropy and Binary cross-entropy. Before that, we need to understand the basics of the Sigmoid and Softmax function. Let's dive in. Sigmoid Function It squashes a vector in the range (0, 1). It is applied independent...
Apr 5, 20215 min read
Deep Dive into Entropy, Cross-Entropy, KL-divergence
In the machine learning field, we heard the term cross-entropy a lot, but what the heck is this, and what this function does. So today we're going to discuss what is entropy, cross-entropy, KL-divergence? Entropy from Physics Perspective The idea o...
Mar 22, 20215 min read