Offline Notepad View raw

Shared snapshot

6f0d9bc6

#6f0d9bc6 #אגי Translator #Welcome to Local_LLM_Notepad By Runzhouye #Click here to view the Github by Runzhouye Make Sure to press CTRL+S to save and CTRL+D to download an offline readable copy on your end and be sure to bookmark the page to access and read it offline so you can share with friends & family! #Press CTRL+A to copy & paste this entire clean slate then click here to paste it into Https://app.blackbox.ai/chat/ #No #API #GPU #Internet #Installation #Admin Rights #Cloud Computing #required. #Drop the single bundled .exe onto a USB stick You can walk up to any computer, and start chatting, brainstorming, or drafting documents. #Why you’ll love it: #🔌 Portable: Drop the one‑file EXE and your .gguf model onto a flash drive; run on any Windows PC without admin rights. #🪶 Clean UI: Two‑pane layout: type prompts below, watch token‑streamed answers above—no extra chrome. #🔍 Source‑word under‑lining: Every word or number you wrote in your prompt is automatically bold‑underlined in the model’s reply. #Ctrl+left click on them to view them in a separate window. #Handy for fact‑checking summaries, tables, or data extractions. #💾 Save/Load chats: One‑click JSON export keeps conversations with the model portable alongside the EXE. #⚡ Llama.cpp inside CPU‑only by default for max compatibility. #🎹 Hot‑keys: #Ctrl + S to send #Ctrl + Z to stop #Ctrl + F to find #Ctrl + X to clear chat history #Ctrl + Mouse‑Wheel zoom, etc.

#Quick Start Step #1 Download Local LLM_Notepad-portable.exe from the Releases page. #Step # 2 Copy the EXE and a compatible GGUF model (e.g. gemma-3-1b-it-Q4_K_M.gguf) onto your own private USB. #Double‑click the EXE on any Windows computer. First launch caches the model into RAM; subsequent prompts stream instantly. Need another model? #Use FileSelect Model… and point to a different GGUF. Download links: ~45 MB, contains everything needed to run LLM on Windows computer, and fits on a 1gb USB. ##1 Click here to Download Local_LLM_Notepad_V1.0.1.Exe Diretly to your device ##2 Click here to Download Gemma-3-1B-it-GGUF model to chat with A.I #(Optional) Building Your Own Portable EXE #1-Clone $ git clone https://github.com/runzhouye/Local_LLM_Notepad.git $ cd Local_LLM_Notepad #2-Create env & install deps $ python -m venv .venv && ..venv\Scripts\activate $ pip install -r requirements.txt #3-Bundle everything $ pyinstaller --onefile --noconsole --additional-hooks-dir=. main.py #4-Grab dist/Local_LLM_Notepad.exe (≈45 MB)

#https://huggingface.co/models?library=gguf #A-Z-LLM-Offline #A #B #C #D #E #F #G #H #I #J #K #L #M #N #O #P #Q #R #S #T #U #V #W #X #Y #Z #0-9

#https://huggingface.co/antirez/deepseek-v4-gguf/tree/main

#DeepSeek-V4-Flash-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8-chat-v2-imatrix.gguf #86.7 GB #DeepSeek-V4-Flash-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8-chat-v2.gguf #86.7 GB #DeepSeek-V4-Flash-Layers37-42Q4KExperts-OtherExpertLayersIQ2XXSGateUp-Q2KDown-AProjQ8-SExpQ8-OutQ8-chat-v2-imatrix-fixed.gguf #97.6 GB #DeepSeek-V4-Flash-MTP-Q4K-Q8_0-F32.gguf #3.81 GB #DeepSeek-V4-Flash-Q4KExperts-F16HC-F16Compressor-F16Indexer-Q8Attn-Q8Shared-Q8Out-chat-v2-imatrix.gguf #165 GB #DeepSeek-V4-Flash-Q4KExperts-F16HC-F16Compressor-F16Indexer-Q8Attn-Q8Shared-Q8Out-chat-v2.gguf #165 GB #DeepSeek-V4-Pro-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8-Instruct-imatrix.gguf #465 GB #DeepSeek-V4-Pro-IQ2XXS-w2Q2K-AProjQ8-SExpQ8-OutQ8-Instruct.gguf #465 GB #DeepSeek-V4-Pro-Q4K-Layers-31-output.gguf #442 GB #DeepSeek-V4-Pro-Q4K-Layers00-30.g #458 GB