Deep Learning Job Interview Questions Book: Information Theory

Information Theory

INDUCTIVE inference is the problem of reasoning under conditions of incomplete information, or uncertainty. According to Shanonn’s theory ([Cover]), information and uncertainty are two sides of the same coin: the more uncertainty there is, the more information we gain by removing the uncertainty. Entropy plays central roles in many scientific realms ranging from physics and statistics to data science and economics. A basic problem in information theory is encoding large quantities of information ([Cover]).

Read More
shlomo kashani
Deep Learning Job Interview Questions Book: Logistic Regression

Logistic Regression

Multivariable methods, such as Logistic regression are routinely utilized in statistical analyses across a wide range of domains. Particularly, Logistic regression is the most frequently used method for modeling binary response data and binary classification. When the response variable is binary, it characteristically takes the form of 1/0, with 1 normally indicating a success and 0 a failure.

Read More
shlomo kashani