Transformer model architecture,based solely on attention mechanisms,a new development in machine learning that have been making a lot of noise lately. They are incredibly good at keeping track of context, and this is why the text that they write makes sense.