Large Language Models as Markov Chains