Category Archives: Inference

Regularization, continuity, and the mystery of generalization in Deep Learning

A light and short note on a dense subset of a large space... There's increasing interest in the very happy problem of why Deep Learning methods generalize so well in real-world usage. After all, Successful networks have ridiculous amounts of parameters. By all rights, they should be overfitting training data and doing awfully with new […]

Statistics, Simians, the Scottish, and Sizing up Soothsayers


Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 91

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 92

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 91

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 92

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 91

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 92

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 91

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 92

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 91

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 92

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 91

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 92

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 91

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 92

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 91

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 92

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 91

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 92

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 91

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 92

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 91

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 92

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 91

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 92

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 91

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 92

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 91

Warning: preg_replace(): The /e modifier is no longer supported, use preg_replace_callback instead in /home/rinesi/webapps/blog_php72/wp-content/plugins/latex/latex.php on line 92

A predictive model can be a parametrized mathematical formula, or a complex deep learning network, but it can also be a talkative cab driver or a slides-wielding consultant. From a mathematical point of view, they are all trying to do the same thing, to predict what's going to happen, so they can all be evaluated […]

Deep Learning as the apotheosis of Test-Driven Development

Even if you aren't interested in data science, Deep Learning is an interesting programming paradigm; you can see it as "doing test-driven development with a ludicrously large number of tests, an IDE that writes most of the code, and a forgiving client." No wonder everybody's pouring so much money and brains into it! Here's a […]