Added Accelerate 4bit options, made DeepSpeed disable for windows systems, added pip install accelerate if 8bit is used.

raised version to 1.5.1 due to fixes in pre_loading
fixed pre_slayer slider crashing on changes
2026-01-02 12:00:33 +00:00 · 2023-05-25 18:36:34 +02:00 · 2023-05-23 18:33:34 +02:00 · 2023-05-22 07:45:06 +02:00 · 2023-05-20 13:12:16 +02:00 · 2023-05-20 13:10:10 +02:00
3 changed files with 352 additions and 131 deletions
--- a/.github/workflows/package.yml
+++ b/.github/workflows/package.yml
@@ -34,5 +34,5 @@ jobs:
      - name: Upload artifacts
        uses: actions/upload-artifact@v3
        with:
-          name: ${{ matrix.os }}-binary-v1.4
+          name: ${{ matrix.os }}-binary-v1.5.1
          path: dist
--- a/README.md
+++ b/README.md
@@ -12,7 +12,7 @@ WebUI StartGUI is a Python graphical user interface (GUI) written with PyQT5, th
 - Select the operating mode (chat, cai-chat, notebook)
 - Choose between CPU, GPU or Autodevice
 - Set CPU RAM/GPU VRAM (Only for Nvidia Right now, will automatically detect if multiple GPU's are Present)
- Adjust pre-layer value
+- Adjust pre-layer value (for each Nvidia GPU found or 1 if none)
 - Choose to run with 8bit, 16bit, trust_remote_code, Quant_attn, Autotune and no-cache flags
 - Enable authentication and choose an authentication file
 - Choose extensions for the WebUI
--- a/StartUI.py
+++ b/StartUI.py
Author	SHA1	Message	Date
Pakobbix	58772e86f6	Added Accelerate 4bit options, made DeepSpeed disable for windows systems, added pip install accelerate if 8bit is used.	2023-05-25 18:36:34 +02:00
Pakobbix	c8ed510030	raised version to 1.5.1 due to fixes in pre_loading All checks were successful Package Release / package (ubuntu-latest) (push) Has been cancelled Details Package Release / package (windows-latest) (push) Has been cancelled Details	2023-05-23 18:33:34 +02:00
Pakobbix	39b2f0c54d	fixed pre_slayer slider crashing on changes	2023-05-22 07:45:06 +02:00
Pakobbix	ef7e4ed673	Updated package.yml and readme for 1.5 All checks were successful Package Release / package (ubuntu-latest) (push) Has been cancelled Details Package Release / package (windows-latest) (push) Has been cancelled Details	2023-05-20 13:12:16 +02:00
Pakobbix	5aac959224	Added pre_slayer sliders for all GPU's found. (atm based on nvidia_gpu boolean, will change it next week whe I'm @ home)	2023-05-20 13:10:10 +02:00
Pakobbix	39ac8a094a	Added autogptq and triton checkbox.	2023-05-20 11:59:50 +02:00