UMbreLLa An inference toolkit that combines memory offloading, quantization, and speculative decoding to run personal language-model agents on consumer GPUs.
Visit productCosigns Received
Be the first Cosign
Put your name behind UMbreLLa.
Add it to your Products I use list and share why you use it.