FuseFSS: Efficient Secure LLM Inference with Function Secret Sharing
Making AI chatbots faster while keeping user questions completely private
A new system called FuseFSS speeds up private AI queries by 24–50% while keeping prompts hidden from the servers hosting the model. The key innovation replaces dozens of custom security protocols with a single streamlined compiler that handles all the mathematical operations needed to run AI models securely.
As AI assistants handle sensitive queries—medical questions, legal advice, confidential business data—users need privacy guarantees. FuseFSS makes this possible without sacrificing speed, meaning companies can offer genuinely private AI services without the performance penalty that currently deters adoption. It also reduces the storage overhead for security setup by 20–24%, lowering infrastructure costs.