removed the webuiGUI.py necessity, disable accelerate for windows (incompatible), remove some useless code (still learning)

added save and load for accelerate.
Added Accelerate 4bit options, made DeepSpeed disable for windows systems, added pip install accelerate if 8bit is used.
2026-01-02 12:00:33 +00:00 · 2023-05-25 19:55:33 +02:00 · 2023-05-25 18:44:08 +02:00 · 2023-05-25 18:36:34 +02:00 · 2023-05-23 18:33:34 +02:00 · 2023-05-22 07:45:06 +02:00
3 changed files with 370 additions and 142 deletions
--- a/.github/workflows/package.yml
+++ b/.github/workflows/package.yml
@@ -34,5 +34,5 @@ jobs:
      - name: Upload artifacts
        uses: actions/upload-artifact@v3
        with:
-          name: ${{ matrix.os }}-binary-v1.4
+          name: ${{ matrix.os }}-binary-v1.5.1
          path: dist
--- a/README.md
+++ b/README.md
@@ -12,7 +12,7 @@ WebUI StartGUI is a Python graphical user interface (GUI) written with PyQT5, th
 - Select the operating mode (chat, cai-chat, notebook)
 - Choose between CPU, GPU or Autodevice
 - Set CPU RAM/GPU VRAM (Only for Nvidia Right now, will automatically detect if multiple GPU's are Present)
- Adjust pre-layer value
+- Adjust pre-layer value (for each Nvidia GPU found or 1 if none)
 - Choose to run with 8bit, 16bit, trust_remote_code, Quant_attn, Autotune and no-cache flags
 - Enable authentication and choose an authentication file
 - Choose extensions for the WebUI
--- a/StartUI.py
+++ b/StartUI.py
Author	SHA1	Message	Date
Pakobbix	d1de11ecf4	removed the webuiGUI.py necessity, disable accelerate for windows (incompatible), remove some useless code (still learning)	2023-05-25 19:55:33 +02:00
Pakobbix	b063f23e71	added save and load for accelerate.	2023-05-25 18:44:08 +02:00
Pakobbix	58772e86f6	Added Accelerate 4bit options, made DeepSpeed disable for windows systems, added pip install accelerate if 8bit is used.	2023-05-25 18:36:34 +02:00
Pakobbix	c8ed510030	raised version to 1.5.1 due to fixes in pre_loading All checks were successful Package Release / package (ubuntu-latest) (push) Has been cancelled Details Package Release / package (windows-latest) (push) Has been cancelled Details	2023-05-23 18:33:34 +02:00
Pakobbix	39b2f0c54d	fixed pre_slayer slider crashing on changes	2023-05-22 07:45:06 +02:00
Pakobbix	ef7e4ed673	Updated package.yml and readme for 1.5 All checks were successful Package Release / package (ubuntu-latest) (push) Has been cancelled Details Package Release / package (windows-latest) (push) Has been cancelled Details	2023-05-20 13:12:16 +02:00
Pakobbix	5aac959224	Added pre_slayer sliders for all GPU's found. (atm based on nvidia_gpu boolean, will change it next week whe I'm @ home)	2023-05-20 13:10:10 +02:00
Pakobbix	39ac8a094a	Added autogptq and triton checkbox.	2023-05-20 11:59:50 +02:00