Unashamed bragging: in 2007, on page 69 of my PhD thesis, I explained how to build a kind of language model on a Terabyte-sized dataset. Pre-Deep NN era: ruor.uottawa.ca/handle/10393/2…