Old school language models, part 2: Second-order Markov Models
This is the next stop in my Artisanal Language Model development tour. If a first-order Markov model has a context length of 1, then a second-order has a context length of 2.
brandonrohrer.org/alms_somm.html