Daisuke Majima (MLBoy)
@JackdeS11
400+ open models on Hugging Face, converted to LiteRT, Core AI and ExecuTorch and measured on phones. 163 of them in litert-community. rockyshikoku@gmail.com
12 Following 1.2K Followers
GLiNER2.5-Decide (DeBERTa-v3-large, 340M) converted to LiteRT: fp16 weights, answers identical to the official fp32 model on 361/361 test requests, 66–70 ms per request on a Galaxy S26 GPU at 128 tokens, 175 ms at 256. Card, Python and Android sample:
Show more
