Recent searches
Search options
Someone used DeepSeek to write an optimization for DeepSeek that approximately doubled its performance: https://simonwillison.net/2025/Jan/27/llamacpp-pr/
For all the goofiness that accreted around the subject, this is literally what was meant by the technological singularity.
simonwillison.netggml : x2 speed for WASM by optimizing SIMDPR by Xuan-Son Nguyen for `llama.cpp`: > This PR provides a big jump in speed for WASM by leveraging SIMD instructions for `qX_K_q8_K` and `qX_0_q8_0` dot product functions. > > …
@tek have you tried it? It's still a pull request.
@tek It's not real if you haven't run and at least tried a view prompts. 
Sorry not sorry.