a/website
1
3
Fork 1
Code Issues Pull requests Projects Releases Wiki Activity

Add commas so it's a bunch of 1s and not 111111111
All checks were successful
ci/woodpecker/push/woodpecker Pipeline was successful
Details

Browse source
This commit is contained in:
Anthony Wang 2024-06-14 16:01:41 -05:00
parent 0e4c762c89
commit 3626b03b5b
2 changed files with 1 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

BIN
static/src/gzip-classification.pdf
View file

Binary file not shown.

2
static/src/gzip-classification.tex
View file

@ -191,7 +191,7 @@ class ZipModel:
\frametitle{Compression using LLMs}
\begin{itemize}
\item Idea: LLM generates list of candidate tokens, store the index of the token that the text uses
\item Very predictable text (i.e. digits of $\pi$) turn into 11111111111111111
\item Very predictable text (i.e. digits of $\pi$) turn into 1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1,1
\item Then run that through gzip
\item Amazing compression ratio, but slow
\end{itemize}