The pretraining task is similar to summarization, in that important sentences are removed from the entered text and replaced with one output sequence from the rest of the sentences. Note the below app is (quite) slow. Please give it time to open, and interpret what you enter for summarization purposes. This is why Musk and Zuckerberg are creating nuclear reactors to power their AI.