I created utilized a wikipedia scraper via getting featured articles from a toolforge.org and then downloaded some articles using wikitext.eluni.co
I then added the training support for it by reading all the wikipedia text files and loading them into an array
I will now run some training on them to hopefully achieve better compression results!
Comments 0
No comments yet. Be the first!
Sign in to join the conversation.