How to Run a ChatGPT Alternative on Your Local PC

You can't run ChatGPT on a single GPU, but you can run some far less complex text generation large language models on your own PC. We tested oogabooga's text generation webui on several cards to see how fast it is and what sort of results you can expect.

https://www.tomshardware.com/news/running-your-own-chatbot-on-a-single-gpu

Created 2y | Mar 18, 2023, 9:20:22 PM


Login to add comment

Other posts in this group

 AMD RX 9000 series will focus on desktop GPUs first — RDNA 4 mobility offerings to follow later

AMD's strategy for RDNA 4 will prioritize the desktop market first.

Jan 27, 2025, 6:50:06 PM | tomshardware.com
 Offloading Lossless Scaling Frame-Gen to secondary GPU eliminates overhead

Should you have the appropriate hardware configuration, a YouTuber finds a logical method for getting a Lossless Scaling Frame Gen without performance loss in any game.

Jan 27, 2025, 6:50:06 PM | tomshardware.com
 DLSS Swapper now updates FSR, XeSS, and DLSS, too — Supports all major upscaling/frame gen technologies

You can update upscaling and frame-gen DLLs across DLSS, FSR, and XeSS through DLSS Swapper.

Jan 27, 2025, 6:50:06 PM | tomshardware.com
 Intel quietly slashes prices of Xeon 6 CPUs by up to $5,340

Intel significantly cut pricing for its newest Xeon 6 models. The flagship 128-core Xeon 6980P model is now available for $12,460, but it is still more expensive than AMD

Jan 27, 2025, 6:50:05 PM | tomshardware.com
 Facebook flags Linux topics as 'cybersecurity threats' — posts and users being blocked

Facebook is banning posts which mention various Linux related topics, sites, or groups.

Jan 27, 2025, 6:50:04 PM | tomshardware.com
 Be Quiet Light Base 900 DX Case Review: Innovative design with lots of space

Configurable in three layouts, Be Quiet’s Light Base 900 DX stands apart from the competition. We paired it with Intel’s i7-14700K and Radeon’s RX 7900 GRE to test its th

Jan 27, 2025, 6:50:04 PM | tomshardware.com