Posts

Apr 14, 2026
Context Free Grammar Parsing
From binary tree generation to parsing of context free grammars.
Apr 13, 2026
More Functional Binary Tree Generation
Functional programming improvements to binary tree generation.
Apr 11, 2026
From Binary Trees to Grammar Derivations
From binary tree generator to parse derivation generator.
Apr 11, 2026
Generating Binary Trees
How would you generate all possible binary trees from a sequence of inputs?
Apr 8, 2026
Why Rust?
After decades of software development, I've recently settled on the use of Rust. Here's why.
Apr 6, 2026
What is a Monad (in Rust)?
Transcription of the video What is a Monad? - Computerphile but modified for Rust
Dec 24, 2022
Exploding and Vanishing Gradients
Dec 17, 2022
Long Short-Term Memory (LSTM)
Dec 16, 2022
Recurrent Neural Networks
Sep 13, 2018
Cloud AI Service Survey
A comparison of artificial intelligence capabilities provided by cloud service providers.
Sep 4, 2018
Another Activation Function
The rectified linear function avoids two problems of the logistic/sigmoid activation function.
Sep 4, 2018
Pooling Layers
Pooling layers "downsample" their inputs to highlight or summarize the features in a region.
Jul 21, 2018
Convolutional Layers
Convolutional layers map the occurrence of a local feature across the entire input.
Jul 4, 2018
Neural Networks
An introduction to neural networks and associated terminology.
Jul 3, 2018
A Multilayer Perceptron in Julia
A Julia program that uses a multi-layer perceptron to classify images from the MNIST dataset.
Jul 2, 2018
A Multilayer Perceptron in Python
A Python program that uses a multi-layer perceptron to classify images from the MNIST dataset.
Jul 1, 2018
Multi-Layer Perceptrons
Multi-layer perceptrons approach the multivariate logistic regression problem by learning the appropriate features at the same time as their coefficients.
Jul 1, 2018
Simple Computer Vision in Julia
A Julia program that uses stochastic mini-batch gradient descent to classify 28-pixel square images from the MNIST dataset.
Jun 29, 2018
Simple Computer Vision in Python
A Python program that uses stochastic mini-batch gradient descent to classify 28-pixel square images from the MNIST dataset.
Jun 28, 2018
Mini-Batch Gradient Descent in Python and Julia
Jun 28, 2018
Stochastic and Mini-Batch Gradient Descent
The cost function for stochastic gradient descent (SGD) considers the cost of a single example, randomly-chosen. Mini-batch gradient descent considers a fraction of the examples.
Jun 28, 2018
Multiclass Logistic Regression in Julia—with TensorFlow
A Julia program that finds polynomial logistic models for three classes using TensorFlow.
Jun 26, 2018
Multiclass Logistic Regression in Python—with TensorFlow
A Python program that finds polynomial logistic models for three classes using TensorFlow.
Jun 26, 2018
Automatic Differentiation with TensorFlow
TensorFlow is a fast, efficient open source library that can automatically generate partial derivative functions from the definition of a complex cost function.
Jun 23, 2018
Scikit-learn for Logistic Regression
Scikit-learn is a popular open-source library with a fast, efficient implementation of logistic regression.
Jun 23, 2018
Overfitting and Regularization
Regularization reduces the complexity of the model to help it generalize.
Jun 22, 2018
Feature Scaling Caution
Scaling inputs and features can help speed convergence with gradient descent.
Jun 22, 2018
Multiclass Logistic Regression in Julia
A Julia program that finds polynomial logistic models for three classes. Interactive visualization of the results.
Jun 14, 2018
Multiclass Logistic Regression in Python
A Python program that finds polynomial logistic models for three classes. Interactive visualization of the results.
Jun 12, 2018
Logistic Regression with Multiple Classes
The logistic model can be extended to classify its input into one of several classes.
Jun 11, 2018
Interactive Minimization of the Logistic Regression Cost Function
Adjust \(\theta_0\) and \(\theta_1\) to minimize the cost function.
Jun 10, 2018
Visualization of Improved Cost Function for Logistic Regression
The new cost function has a convex shape suitable for gradient descent.
Jun 9, 2018
A Better Cost Function for Logistic Regression
A cost function for logistic regression that works with gradient descent.
Jun 8, 2018
Visualization of Cost Function for Logistic Regression
There is a problem with using gradient descent to minimize the cost function.
Jun 7, 2018
Almost Entirely Nonlinear Regression
Logistic regression can be used for classification because it learns a nonlinear relationship between input and output.
Jun 6, 2018
Interactive Minimization of the Cost Function
Adjust \(\theta_0\), \(\theta_1\) and \(\theta_2\) to minimize the cost function.
Jun 6, 2018
Even Less Linear Regression
Learning a polynomial relationship between multiple inputs and an output.
Jun 4, 2018
Multivariate Gradient Descent in Julia
Jun 4, 2018
Multivariate Gradient Descent in Python
Jun 4, 2018
Not Completely Linear Regression
Learning a linear relationship from multiple inputs to one output.
Jun 3, 2018
Learning Rate Caution
Your choice of learning rate affects the success of gradient descent.
Jun 3, 2018
Gradient Descent in Python
Jun 3, 2018
Gradient Descent in Julia
Jun 3, 2018
Gradient Descent
A standard, iterative method for minimizing the cost function.
Jun 1, 2018
Visualization of the Cost Function
An interactive visualization of the cost function for linear regression.
Jun 1, 2018
Interactive Minimization of Cost Function
Adjust \(\theta_0\) and \(\theta_1\) to minimize the cost function.
Jun 1, 2018
Simple Linear Regression
Simple linear regression is one of the simplest forms of supervised machine learning.
May 31, 2018
Introduction to Machine Learning
An introduction to a series of posts on machine learning.
Jul 25, 2016
What Would Google Bot?
Predictions about Google's chatbot and the business model that might support it.
Jul 23, 2016
A Survey of Bot APIs
A survey of Bot APIs and potential business models around them.
Jul 9, 2016
Facebook M and Wit.ai
Business considerations of Facebook M, its acquisition of Wit.ai and some of Wit.ai's competitors.
Jul 9, 2016
Brainstorming a Chatbot Business Model
Chatbot value proposition, business model, and opportunity for competitive advantage.