How to Run a ChatGPT Alternative on Your Local PC

You can't run ChatGPT on a single GPU, but you can run some far less complex text generation large language models on your own PC. We tested oogabooga's text generation webui on several cards to see how fast it is and what sort of results you can expect.

https://www.tomshardware.com/news/running-your-own-chatbot-on-a-single-gpu

Établi 2y | 18 mars 2023 à 21:20:22


Connectez-vous pour ajouter un commentaire

Autres messages de ce groupe

 AMD RX 9000 series will focus on desktop GPUs first — RDNA 4 mobility offerings to follow later

AMD's strategy for RDNA 4 will prioritize the desktop market first.

27 janv. 2025 à 18:50:06 | tomshardware.com
 Offloading Lossless Scaling Frame-Gen to secondary GPU eliminates overhead

Should you have the appropriate hardware configuration, a YouTuber finds a logical method for getting a Lossless Scaling Frame Gen without performance loss in any game.

27 janv. 2025 à 18:50:06 | tomshardware.com
 DLSS Swapper now updates FSR, XeSS, and DLSS, too — Supports all major upscaling/frame gen technologies

You can update upscaling and frame-gen DLLs across DLSS, FSR, and XeSS through DLSS Swapper.

27 janv. 2025 à 18:50:06 | tomshardware.com
 Intel quietly slashes prices of Xeon 6 CPUs by up to $5,340

Intel significantly cut pricing for its newest Xeon 6 models. The flagship 128-core Xeon 6980P model is now available for $12,460, but it is still more expensive than AMD

27 janv. 2025 à 18:50:05 | tomshardware.com
 Facebook flags Linux topics as 'cybersecurity threats' — posts and users being blocked

Facebook is banning posts which mention various Linux related topics, sites, or groups.

27 janv. 2025 à 18:50:04 | tomshardware.com
 Be Quiet Light Base 900 DX Case Review: Innovative design with lots of space

Configurable in three layouts, Be Quiet’s Light Base 900 DX stands apart from the competition. We paired it with Intel’s i7-14700K and Radeon’s RX 7900 GRE to test its th

27 janv. 2025 à 18:50:04 | tomshardware.com