map
Speeding up Firefox Local AI Runtime
Last year we rolled out the Firefox AI Runtime, the engine that quietly powers features such as PDF.js generated alt text and, more recently, our smart tab grouping. The system worked, but not quite at the speed we wanted. This post explains how we accelerated inference by replacing the default onnxruntime‑web that powers Transformers.js with […]
The post Speeding up Firefox Local AI Runtime appeared first on The Mozilla Blog.
Last year we rolled out the Firefox AI Runtime, the engine that quietly powers features such as PDF.js generated alt text and, more recently, our smart tab grouping. The system worked, but not quite at the speed we wanted. This post explains how we accelerated inference by replacing the default onnxruntime‑web that powers Transformers.js with […]
The post Speeding up Firefox Local AI Runtime appeared first on The Mozilla Blog.
Speeding up Firefox Local AI Runtime
Last year we rolled out the Firefox AI Runtime, the engine that quietly powers features such as PDF.js generated alt text and, more recently, our smart tab grouping. The system worked, but not quite at the speed we wanted. This post explains how we accelerated inference by replacing the default onnxruntime‑web that powers Transformers.js with […]
The post Speeding up Firefox Local AI Runtime appeared first on The Mozilla Blog.
