A very nice model for optimising tasks not only for cost, but speed too 🔥
Meet Prism, a specialized 8B model trained to route coding tasks to the right model in real time.
Prism chooses fast cost-efficient models for the easy stuff and bigger, smarter models for the hard stuff. We're seeing upwards 45% lower inference costs.
Now live on Charm Hyper.