Md Ismail Šojal 🕷️
@0x0SojalSec
Cyber_Security_Re-searcher || Ai Re-searcher || AI-Sec|| Malware Analysis II iOS || Pwn || 0SINT || Project AI-StrikeSec || 0ldAccounts Suspended @0xSojalSec ||
加入 October 2021
6K 正在关注 55.7K 粉丝
free Kaggle dual T4s GPUs Running Meta’s Muse Glimmer 30B Q6_K_XL.
- 130,000 token context
- 26.5 GB VRAM
- Prefill: 265 t/s
- Decode: 9 t/s
- Cost: $0
Aggressive 16:1 GQA. Unquantized KV cache for 130k tokens is only 2 GB.
显示更多
