To my friends in the local AI space, I have some good news.
After advocating on here for better hardware support for sm120 (i.e. RTX 6000 Pro Blackwell cards) and sm121 (DGX Spark),
@nvidiaai reached out to setup a call.
That call happened yesterday.
I spoke with a large group of people from various teams about the problems we've experienced with new model and inference engine support.
How much that degrades our UX and what can be done to improve it.
The company seems very receptive and eager to improve support. We spent about 45 minutes talking about the next steps and I walked away feeling more confident than ever that
@NVIDIA will be giving us first class support moving forward.
Obviously there will be some time from this being an initiative to becoming a reality, but it is now in the works.
I want to thank the team at Nvidia for their time and attention. Never in my wildest dreams did I expect a few social media posts to galvanize this kind of attention and interest.
I also want to thank all the people in the community that I reached out to for feedback and those that supported my posts on this matter. You were heard. We are making progress.
All of this to say, this is what happens when we come together as a community. We can make great things happen.
I appreciate you all! I love the local AI community and all that we're building together.
Onto the next!