I feel it is a fascinating perspective to view LLMs as compressors. Today, we are going to introduce the basic idea of it. We first use very layman terms to introduce what compression does. Compression can be seen as representing a stream of bits with a shorter stream of bits. It is based on assumption …