Nvidia’s AI assistant on Windows now has plugins for Spotify, Twitch, and more

Nvidia is updating its G-Assist AI assistant on Windows to take it beyond optimizing game and system settings. G-Assist originally launched last month as a chatbot primarily focused on improving PC gaming, but it’s now getting plugin support so you can extend the AI assistant to control Spotify, check if a streamer is live on Twitch, and look at stock or weather updates.

The new ChatGPT-based G-Assist plugin builder lets developers and enthusiasts create custom functionality for Nvidia’s AI assistant. G-Assist will be able to connect to external tools and use APIs to expand the capabilities of what Nvidia offers right now.

Nvidia has published sample plugins on GitHub that can be compiled and used by G-Assist:

• Spotify — hands-free music and volume control
• Google Gemini — allows G-Assist to invoke Gemini for cloud-based complex conversations
• Twitch —  you can use this plugin to checks if a streamer is live with voice commands like, “Hey, Twitch, is [streamer] live?” 
• Peripheral Controls — change RGB lighting or fan speed on Logitech G, Corsair, MSI and Nanoleaf devices
• Stock Checker —  provides real-time stock prices
• Weather Updates — provides current weather conditions in any city

These plugins all run locally using a small language model on Nvidia’s RTX GPUs, and developers will also be able to share their own custom plugins through GitHub. G-Assist uses a local small language model that requires nearly 10GB of space for the assistant functions and voice capabilities. The AI assistant works on a variety of RTX 30-, 40-, and 50-series desktop GPUs, but you’ll need a card with at least 12GB of VRAM.

If you’re interested in trying out G-Assist or building a plugin, the app is available as an optional part of Nvidia’s main app for Windows.