SpecExec An inference framework that uses parallel speculative decoding and memory offloading to run large language models on consumer GPUs.
Visit productCosigns Received
Be the first Cosign
Put your name behind SpecExec.
Add it to your Products I use list and share why you use it.