Neural Magic makes open-source AI cheaper to run, pairing model compression with optimized inference across cloud, data center, and edge.
Products & media
Who is Neural Magic?
A CPU inference runtime for executing sparsified neural networks and language models with accelerator-like performance.
A repository and software interface for discovering and downloading pre-sparsified machine-learning models and optimization recipes.
An open-source library for pruning, quantizing, and otherwise compressing neural networks through reusable optimization recipes.
A graphical application for analyzing neural networks and applying performance-oriented sparsification workflows.
An open-source toolkit for applying quantization, sparsity, and compression algorithms to large language models.
Team
Current Affiliates
1 person
Company history
All fundraising announcements are based on public sources. Please contact Cosign if you believe there are any discrepancies, or claim the profile to edit.
Data current as of November 12, 2024
Leads
Participating Firms
Angels
Acquired by Red Hat