copy and paste this google map to your website or blog!
Press copy button and paste into your blog or website.
(Please switch to 'HTML' mode when posting into your blog. Examples: WordPress Example, Blogger Example)
intuition - What is perplexity? - Cross Validated I came across term perplexity which refers to the log-averaged inverse probability on unseen data Wikipedia article on perplexity does not give an intuitive meaning for the same This perplexity
clustering - Why does larger perplexity tend to produce clearer . . . Why does larger perplexity tend to produce clearer clusters in t-SNE? By reading the original paper, I learned that the perplexity in t-SNE is $2$ to the power of Shannon entropy of the conditional distribution induced by a data point
Codebook Perplexity in VQ-VAE - Cross Validated For example, lower perplexity indicates a better language model in general cases The questions are (1) What exactly are we measuring when we calculate the codebook perplexity in VQ models? (2) Why would we want to have large codebook perplexity? What is the ideal perplexity for VQ models? Sorry if my questions are unclear