X

NVIDIA's new RTX chatbot gives you local AI-powered search

Featured image for NVIDIA's new RTX chatbot gives you local AI-powered search

NVIDIA today has announced its Chat with RTX chatbot, giving you the power of an AI chatbot that can process and deliver contextually relevant answers to your queries. The best part, it’s all done locally on your PC with no connection to the internet. So your data stays on the PC. If you’re worried about privacy and personal data safety, this should give you some peace of mind. Since all search queries are done locally on your PC, you won’t have to worry about your information being uploaded to a server and putting it at risk.

You can use the chatbot to do a search based on local files you have stored. For example, say you have a menu file for a restaurant you’ve been meaning to try. But you can’t remember the name or what file format it’s in. You just know you have it stored somewhere on your PC. With this tool, you can ask what the restaurant is, and then it’ll do a search for contextually relevant files. You will need to point the chatbot to the folders you want it to look in. So it doesn’t just scan everything. NVIDIA says it processes user queries in “just seconds” too. So you shouldn’t be waiting around all day for it to find what you’re looking for.

The NVIDIA RTX chatbot can also search YouTube videos for information

NVIDIA Chat with RTX Video URL Query

In addition to having it search local files and directories, it can search YouTube videos for specific information. This function does technically require the internet. Since you’ll need to have internet to access YouTube and get the video link. This could be useful if you’re looking for a specific piece of information in a really long video. Say you want to know what PC games were announced during Summer Games Fest. But you don’t feel like watching the entire hours-long video. You can simply copy and paste the YouTube URL into the chatbot tool and it’ll search for the details for you.

Then spit back out the answers with the reference file. In this case, the video you linked. If you’d like to try out this chatbot for yourself, there are a few caveats. First of all, this is a tech demo. It’s not a fully-fledged piece of software yet. Meaning, NVIDIA is still working on it and probably plans to do a full rollout in the future.

It also requires the use of an RTX 30-series GPU such as the RTX 3060, or higher like the RTX 4070 Ti Super that NVIDIA just recently announced as part of its 40-series lineup. That will limit some users who were hoping to check it out. But maybe there’s hope for it coming to the RTX 20-series cards at some point. Lastly, you need Windows 10 or Windows 11. It’s not compatible with Mac or Linux, and NVIDIA says it has no news to share on additional platform support. But it is listening to user feedback from those who want access via non-Windows platforms.

If you meet the requirements, you can download the chatbot here.

  翻译: