Run #LLMs# on @NVIDIARobotics #Jetson# without x86 ONNX export. ๐
#TensorRT-Model-Connect# on reComputer Classic J5012 (#AGXOrin# 64GB, #JP7#.2).
@huggingface checkpoint โ trtmc build โ .bundle on device
trtmc run for text gen
Tested: #Qwen3-4B# FP16 (~41GB container peak, 64GB recommended)
No ONNX hop. Edge LLM/agent ready.
Would you use on-device TRTMC for prototyping, or keep ONNX export for production? ๐
Full guide:
Get your own one:
#NVIDIA# #Jetson# #TensorRT# #TRTMC# #AGXOrin# #EdgeAI# #LLM# #PhysicalAI# #SeeedStudio#
๋ ๋ณด๊ธฐ
