NVIDIA just released a free new chatbot that runs locally on Windows PCs. You need a GeForce RTX 30 Series GPU or higher and at least 8GB of VRAM to use the bot.

• NVIDIA released a demo version of a chatbot that runs locally on your PC, giving it access to your files and documents.

• The chatbot, called Chat with RTX, can answer queries and create summaries based on personal data fed into it.

• It supports various file formats and can integrate YouTube videos for contextual queries, making it useful for data research and analysis.

  • BertramDitore@lemmy.worldEnglish
    2·
    9 months ago

    They say it works without an internet connection, and if that’s true this could be pretty awesome. I’m always skeptical about interacting with chatbots that run in the cloud, but if I can put this behind a firewall so I know there’s no telemetry, I’m on board.