가입 후 초대 링크를 공유하면 동영상 재생 및 초대 보상을 받을 수 있습니다.

atomic.chat
@atomic_chat_hq
The simplest way to run open models on any hardware. Powered by TurboQuant. Team: @gladkos @skinbagwbones @AlexFromAtomic @danyurkin @quantizedden
가입 March 2026
68 팔로잉 중    18.9K 팬
Run LFM2.5-VL-3B on 16GB Mac with DSpark ⚡️ @liquidai's new DSpark drafter delivers up to 3.13x faster decoding on M5 chips with MLX-VLM in its vision benchmarks while keeping identical outputs under greedy decoding Run AI models locally ->
더 보기
Today, we release an experimental DSpark draft model for LFM2.5-VL-3B, bringing speculative decoding to our vision-language models. A lightweight drafter proposes multiple tokens ahead, and the target model verifies them together in a single pass. This accelerates generation without changing output quality. Across six vision-language task categories at batch size 1 and temperature 0: > MLX on M5 Max: up to 3.13x faster decoding and 2.62x end to end > llama.cpp on M3 Ultra: up to 2.14x faster decoding and 1.77x end to end > SGLang on H100: up to 2.66x faster decoding and 2.27x end to end All evaluations were collected using Pipette, the benchmarking infrastructure behind Liquid AI's public device-performance data. 🧵
더 보기