Nvidia’s new AI chatbot runs on your PC

AI chatbots seem to be all the rage right now. Several companies including OpenAI, Google, Meta, Samsung, Microsoft and Apple have already forayed into the scene, or are planning to. Now there’s yet another new entrant in this space – Nvidia. The company has just released a new chatbot called Chat with RTX, which runs locally on your PC. Here’s what you need to know about it.

Chat with RTX: What it is and what it can do for you

Nvidia recently released a free demo of a chatbot that runs locally on your PC, called Chat with RTX. It is however a little different from most AI chatbots that run locally on devices.

What’s different is, that you can give the chatbot access to your personal files on your PC, and have it create summaries for them. You can even ask it questions based on them, or even random ones just like other chatbots, and it will find and generate answers for you. The chatbot supports several file formats, including Excel sheets, PDFs, Word documents, and more.

ALSO READ: To Grok or to not Grok: Everything we know about Elon Musk’s xAI chatbot

That’s not all, though. Chat with RTX also supports integration for YouTube videos and playlists. This allows you to add a video URL into the dataset and in essence, ask the chatbot contextual information based on the clip itself.

Say you have a particular restaurant in mind, where a content creator you follow made a video previously. The chatbot can summarise all of the information they provided about the place in the video or even their experience. This will also prove to be particularly useful when watching tutorials summaries, and other educational content.

The chatbot is of help, especially to journalists or lawyers, who may need to create summaries of and analyse confidential documents. Now they will be able to do so without actually sharing them with a third party on the cloud, wherein they can be misused on the other end.

ALSO READ: You may soon be able to have conversations with YouTube about the videos you’re watching

Chat with RTX then, is perhaps the first local digital assistant which is contextually aware of the information you provide to it, and can process, analyse, and provide answers to your queries based on it.

Chat with RTX: What you need to run it

It is worth noting that there are a few limitations to the chatbot currently. First off, the version released right now is a demo product and hence has quite a few bugs.

Secondly, there are certain hardware requirements your desktop or laptop will also have to meet, to be able to access the chatbot. It works only with Windows PCs with an Nvidia GeForce RTX 30 series GPU, or higher, with at least 8GB of VRAM. Bear in mind, you’ll also need approximately 40GB of free space on your PC to install the app, and it will take up around 3GB of your RAM.