Fork of FreeToken with DeepSeek-V4.1, vision and speculative decoding (2x3090 numbers inside)
I've been running FreeToken on my 2x3090 box for a while and ended up maintaining a fork of it. Posting it in case it's useful to anyone else here. Quick context if you haven't used it: FreeToken is a