Run #LLMs# on @NVIDIARobotics #Jetson# without x86 ONNX export. 🚀 #TensorRT-Model-Connect# on reComputer Classic J5012 (#AGXOrin# 64GB, #JP7#.2). @huggingface checkpoint → trtmc build → .bundle on device trtmc run for text gen Tested: #Qwen3-4B# FP16 (~41GB container peak, 64GB recommended) No ONNX hop. Edge LLM/agent ready. Would you use on-device TRTMC for prototyping, or keep ONNX export for production? 👇 Full guide: Get your own one: #NVIDIA# #Jetson# #TensorRT# #TRTMC# #AGXOrin# #EdgeAI# #LLM# #PhysicalAI# #SeeedStudio#

Audio8 TTS Preview 0.1B — now on Hugging Face as ONNX INT8 ~100M params · 11 languages · zero-shot voice cloning Runs on CPU only (~0.4 GB RAM) — no PyTorch, no CUDA 44.1 kHz · OpenAI-compatible API · Apache 2.0 Try it 👇 #TTS# #VoiceCloning# #ONNX# #OpenSource#

this TTS model generates speech 167x faster than you can hear it. Supertonic is an on-device TTS engine that runs via ONNX for cross-platform inference. - no GPU - 31 languages - captures every emotion - beats ElevenLabs on speed - runs even on a Raspberry Pi 100% open-source.

We just released TensorRT Model Connect in Public Preview. You can take a supported @huggingface model to end-to-end TensorRT inference in just two commands. No intermediate ONNX export, and the resulting bundle can run through native C++ APIs. We also built the entire project with @OpenAIDevs Codex agents, with humans directing and reviewing the work. That includes model implementations, performance tuning, tests, integrations, and docs. It’s open source, so go try it out, dig into the implementations, or contribute support for a new model:

Hy-MT2 keeps gaining momentum. Since its open-source release in May: → 700K+ downloads 🌟 → Hy-MT2-1.8B reached #1# on the Hugging Face trending, with 30B-A3B reaching #4# 🥇 → 70+ verified product and project integrations 💻 → Broader Hy-MT ecosystem support across Apple MLX-LM, Microsoft ONNX Runtime, NVIDIA NeMo, LLaMA-Factory, and more 👯 → Real-world adoption, including real-time multilingual translation of livestream comments on Bilibili 📺 And now, Hy-MT2-30B-A3B is officially available in GGUF format—addressing one of the community’s most-requested deployment needs and making local inference easier. Ready to run Hy-MT2-30B-A3B locally? Try the new GGUF release: Explore Hy-MT2: HuggingFace： Modelscope： Github： #TencentHy# #HyMT2# #OpenSource#