Snapdragon 8 Elite Gen 5 (SM8850) 1×HTP
31.8tok/s
TPS / Decode speed
127 ms
TTFT
150tok/s
Prefill speed
LiquidAI LFM2.5-2.6B hybrid dense decoder for on-device text generation.
LFM2.5-2.6B is LiquidAI's 30-layer hybrid decoder (22 double-gated short-conv mixers + 8 GQA attention layers, dense SwiGLU FFN). The hexagon package is a host VISA client (lfm2_5_2_6b) talking to refft-hexagon on the board. Modeling is built from refft.hexagon.ops.
LFM2.5-2.6B on Hexagon HTP via refft-hexagon cli --model (single-file RFTB).
curl -fsSL https://raw.githubusercontent.com/refinefuture-ai/refft.cpp/main/refft-hexagon/install.sh | sh~/.local/share/refft-hexagon/bin/refft-hexagon cli --model ./LFM2.5-2.6B-w4.refft --backend hexagon --prompt "Who are you?" --max_new_tokens 128