52 Commits

Author SHA1 Message Date
Pakobbix d1de11ecf4 removed the webuiGUI.py necessity, disable accelerate for windows (incompatible), remove some useless code (still learning) 2023-05-25 19:55:33 +02:00
Pakobbix b063f23e71 added save and load for accelerate. 2023-05-25 18:44:08 +02:00
Pakobbix 58772e86f6 Added Accelerate 4bit options, made DeepSpeed disable for windows systems, added pip install accelerate if 8bit is used. 2023-05-25 18:36:34 +02:00
Pakobbix c8ed510030 raised version to 1.5.1 due to fixes in pre_loading
Package Release / package (ubuntu-latest) (push) Has been cancelled
Package Release / package (windows-latest) (push) Has been cancelled
2023-05-23 18:33:34 +02:00
Pakobbix 39b2f0c54d fixed pre_slayer slider crashing on changes 2023-05-22 07:45:06 +02:00
Pakobbix ef7e4ed673 Updated package.yml and readme for 1.5
Package Release / package (ubuntu-latest) (push) Has been cancelled
Package Release / package (windows-latest) (push) Has been cancelled
2023-05-20 13:12:16 +02:00
Pakobbix 5aac959224 Added pre_slayer sliders for all GPU's found. (atm based on nvidia_gpu boolean, will change it next week whe I'm @ home) 2023-05-20 13:10:10 +02:00
Pakobbix 39ac8a094a Added autogptq and triton checkbox. 2023-05-20 11:59:50 +02:00
Pakobbix 2e0acc1b3d fixed nvidia_less save & load + deepspeed nvme offload save & load
Package Release / package (ubuntu-latest) (push) Has been cancelled
Package Release / package (windows-latest) (push) Has been cancelled
2023-05-17 01:20:17 +02:00
Pakobbix 2d6298c59b Update README.md Screenshots 2023-05-17 00:55:34 +02:00
Pakobbix f585e62ada to late to fix this now. 2023-05-17 00:52:39 +02:00
Pakobbix 486b31b39e fixed the ubuntu-latest are build on windows and windows-latest build on ubuntu 2023-05-17 00:41:33 +02:00
Pakobbix 9fa0424a6c fixed the ubuntu-latest are build on windows and windows-latest build on ubuntu 2023-05-17 00:38:30 +02:00
Pakobbix 334b1dde6c Auto build on changes to package.yml test 2023-05-17 00:27:14 +02:00
Pakobbix 31f2fe2cbc package.yml for v1.4 2023-05-17 00:20:30 +02:00
Pakobbix 6cdbea0cfd Updated Readme.md for v1.4 2023-05-17 00:19:45 +02:00
Pakobbix bf68fcfec5 Added: Almost all Options, Toolbar for advanced Options, finished no nvidia mode, made layout compact because of the additional options 2023-05-17 00:13:16 +02:00
Pakobbix 87a4c9fd2b Added Character Selector 2023-05-16 14:14:08 +02:00
Pakobbix 8217fb468d Added the possibility to use the UI without NVIDIA GPU's 2023-05-16 14:13:25 +02:00
Pakobbix ecc3131530 forgot again to uncomment the start, sry 2023-05-16 10:14:40 +02:00
Pakobbix 2df42114e9 Added an report bug menu (create new github issue) 2023-05-15 22:27:10 +02:00
Pakobbix 99d1d92e14 changed to v3 (node 16) 2023-05-15 22:04:35 +02:00
Pakobbix 8f4c651caa switched to self-hosted runner for future projects 2023-05-15 21:54:07 +02:00
Pakobbix 81cd746a46 Merge remote-tracking branch 'origin/main' 2023-05-15 21:15:53 +02:00
Pakobbix df82faee5a switched to qdarkstyle cause of ToolTips not readable in dark mode 2023-05-15 21:15:45 +02:00
Pakobbix e3780dafd5 Update README.md for v1.3
added screenshots and new features of v1.3
2023-05-15 19:04:13 +02:00
Pakobbix a062bbc7fa added requests. Thought it's a built in module. 2023-05-15 18:11:18 +02:00
Pakobbix 91e4e1f280 changed to manual run. Also my fix the node warnings. 2023-05-15 18:07:53 +02:00
Pakobbix 26c0cf03ca Stupid me, forgot to uncomment run_cmd again. 2023-05-15 17:06:43 +02:00
Pakobbix 36b9d3e9b4 fixed Update Button Font-Color 2023-05-15 17:00:15 +02:00
Pakobbix 8ca048e94d Added Dark OS detection + Dark Theme 2023-05-15 16:52:16 +02:00
Pakobbix 44227e2627 Added the possibility to choose none Model (start webui without loading up a model) 2023-05-15 13:57:33 +02:00
Pakobbix 3a2affa702 Raised Version to 1.3 2023-05-15 13:44:34 +02:00
Pakobbix 5c77703b38 Added Menu with some information. 2023-05-15 13:43:59 +02:00
Pakobbix 17e02d982b Added Update Notifier. 2023-05-15 13:43:11 +02:00
Pakobbix 8922d59b95 Fixed Linux Terminal output. 2023-05-14 12:24:15 +02:00
Pakobbix b878c717a3 raised version to 1.2 2023-05-14 13:26:21 +02:00
Pakobbix 9693d79bcc added lora selection. hide extension list if use extensions is not checked. 2023-05-14 13:25:52 +02:00
Pakobbix 22486fe6f7 Added model_type selection and made preperations for MPT 2023-05-14 12:40:28 +02:00
Pakobbix 9813fd193c Merge remote-tracking branch 'origin/main' 2023-05-14 11:03:09 +02:00
Pakobbix f3c85d0e0e added disk & disk-cache-dir option. Refactored load & save functions 2023-05-14 11:03:00 +02:00
Pakobbix ace921679e Added v1.1 screenshots 2023-05-13 23:22:44 +02:00
Pakobbix ad10789e60 removed the tag stuff, cause it isn't working as I hoped. (Still learning github actions) 2023-05-13 23:11:26 +02:00
Pakobbix 1120fa185a Updated Readme cause of recent changes. 2023-05-13 23:09:53 +02:00
Pakobbix d0326f479a Merge branch 'main' of https://github.com/Pakobbix/StartUI-oobabooga-webui 2023-05-13 23:03:36 +02:00
Pakobbix 0fd41f2714 added psutil as requirements 2023-05-13 23:02:52 +02:00
Pakobbix 0c3e925856 Added a lot. Read Release notes. 2023-05-13 23:02:42 +02:00
Pakobbix c15bac5579 Added Tag Counting for the release files
Added the webuiGUI.py to the Packages.
2023-05-13 22:53:11 +02:00
Pakobbix cb0eedcb49 Update README.md 2023-05-13 16:38:56 +02:00
Pakobbix bd55f9dd18 Update README.md
reuploaded images
2023-05-13 16:24:07 +02:00
Pakobbix 33d2fdcf8b Update README.md
Added an Disclaimer to the Readme.
2023-05-13 16:22:10 +02:00
Pakobbix ef260d7b10 Update README.md
Added Release URL
2023-05-13 16:14:03 +02:00
4 changed files with 1822 additions and 232 deletions
+13 -11
View File
@@ -1,23 +1,24 @@
name: Package Release name: Package Release
on: on:
push: push:
branches: paths:
- main - .github/workflows/**
workflow_dispatch:
jobs: jobs:
package: package:
runs-on: ${{ matrix.os }} runs-on: self-hosted
strategy: strategy:
matrix: matrix:
os: [windows-latest, ubuntu-latest, macos-latest] os: [windows-latest, ubuntu-latest]
steps: steps:
- name: Set up Python - name: Set up Python
uses: actions/setup-python@v2 uses: actions/setup-python@v3
with: with:
python-version: 3.x python-version: 3.x
- name: Checkout repository - name: Checkout repository
uses: actions/checkout@v2 uses: actions/checkout@v3
- name: Install dependencies - name: Install dependencies
run: | run: |
@@ -26,11 +27,12 @@ jobs:
pip install pyinstaller pip install pyinstaller
- name: Build and package - name: Build and package
run: pyinstaller --noconfirm --onefile --windowed StartUI.py run: |
pyinstaller --noconfirm --onefile --windowed StartUI.py
cp webuiGUI.py dist/ # Copy webuiGUI.py to the dist directory
- name: Upload artifacts - name: Upload artifacts
uses: actions/upload-artifact@v2 uses: actions/upload-artifact@v3
with: with:
name: ${{ matrix.os }}-binary name: ${{ matrix.os }}-binary-v1.5.1
path: dist # Assuming the packaged files are created in a 'dist' directory path: dist
+40 -6
View File
@@ -1,25 +1,35 @@
# WebUI StartGUI # WebUI StartGUI
## Disclaimer
As someone who isn't a professional programmer, I enjoy experimenting and finding ways to simplify my workflow. This GUI was created to make it easier for me to adjust parameters and save them for future use, without constantly modifying the webui.py or managing multiple scripts. While I'm glad to share this script with others, please understand that my expertise in maintaining it might be limited. Nonetheless, I hope it proves helpful to you, and I appreciate your understanding.
## Description ## Description
WebUI StartGUI is a Python graphical user interface (GUI) written with PyQT5, that allows users to configure settings and start the oobabooga web user interface (WebUI). It provides a convenient way to adjust various parameters and launch the WebUI with the desired settings. WebUI StartGUI is a Python graphical user interface (GUI) written with PyQT5, that allows users to configure settings and start the oobabooga web user interface (WebUI). It provides a convenient way to adjust various parameters and launch the WebUI with the desired settings.
## Current Features ## Current Features
- Select a model from a dropdown menu - Select a model from a dropdown menu or none (with reload button if added while the StartUI is open)
- Choose wbits and groupsize options - Choose wbits and groupsize options
- Select the operating mode (chat, cai-chat, notebook) - Select the operating mode (chat, cai-chat, notebook)
- Enable/disable GPU usage and set GPU VRAM (Only for Nvidia Right now, will detect if multiple GPU's are Present) - Choose between CPU, GPU or Autodevice
- Adjust pre-layer value - Set CPU RAM/GPU VRAM (Only for Nvidia Right now, will automatically detect if multiple GPU's are Present)
- Load the model with 8-bit precision - Adjust pre-layer value (for each Nvidia GPU found or 1 if none)
- Choose to run with 8bit, 16bit, trust_remote_code, Quant_attn, Autotune and no-cache flags
- Enable authentication and choose an authentication file - Enable authentication and choose an authentication file
- Choose extensions for the WebUI - Choose extensions for the WebUI
- Enable local network mode and specify the listen port - Enable local network mode and specify the listen port
- Automatically open the browser when loading is finished - Automatically open the browser when loading is finished
- Save settings to a profile - Save settings to a profile
- Load profiles via Dropdown menu. - Load profiles via Dropdown menu.
- Run the text-generation-webui Updater
- Character loader.
- deepspeed Settings
- flexgen Settings
- API Settings
- StartUI Update Notification
## How to Use ## How to Use
1. Clone the repository or download the source code. 1. Clone the repository or download the source code.
2. Install the required dependencies listed in the `requirements.txt` file. (PyQT5 & gpustat) 2. Install the required dependencies listed in the `requirements.txt` file.
3. Run the `StartUI.py` script using Python `python3 StartUI.py`. 3. Run the `StartUI.py` script using Python `python3 StartUI.py`.
4. Configure the desired settings using the GUI elements. 4. Configure the desired settings using the GUI elements.
5. Click the "Save Settings" button to save the current settings to a profile. 5. Click the "Save Settings" button to save the current settings to a profile.
@@ -28,7 +38,31 @@ WebUI StartGUI is a Python graphical user interface (GUI) written with PyQT5, th
## Binary Download ## Binary Download
Binary releases of this script can be found in the [Releases](https://github.com/your-username/your-repository/releases) section of this repository. Binary releases of this script can be found in the [Releases](https://github.com/Pakobbix/StartUI-oobabooga-webui/releases) section of this repository.
Just put the two files into the root Folder of oobabooga (where the folder with the webui.py and the start script is).
On Linux, you'll need to give StartUI the executable flag (`chmod +x StartUI` or right click -> properties -> make executable).
The WebuiGUI.py must also be there, to handle the flags properly
## Screenshots
V1.4 :\
<details>
<summary>Screenshots</summary>
![1 4](https://github.com/Pakobbix/StartUI-oobabooga-webui/assets/6762686/7f252274-b20b-4e52-9789-fc45645faf03)
![1 4 deepspeed](https://github.com/Pakobbix/StartUI-oobabooga-webui/assets/6762686/b3c566c3-bfa2-4d38-a1af-cee82bf6f5fa)
![1 4 llama options](https://github.com/Pakobbix/StartUI-oobabooga-webui/assets/6762686/8b7bb61d-9ab5-4e54-b4e2-34ec1a36439a)
![1 4 flexgen](https://github.com/Pakobbix/StartUI-oobabooga-webui/assets/6762686/def814cb-4f69-4a39-91cd-6731155c12a3)
![1 4 multi settings](https://github.com/Pakobbix/StartUI-oobabooga-webui/assets/6762686/f3478ff1-bcba-4935-9e4c-efb1a2e64dcd)
</details>
## Credits ## Credits
StartGUI is developed and maintained by [Pakobbix](https://github.com/Pakobbix). StartGUI is developed and maintained by [Pakobbix](https://github.com/Pakobbix).
+1734 -184
View File
File diff suppressed because it is too large Load Diff
+4
View File
@@ -1,2 +1,6 @@
PyQt5 PyQt5
gpustat gpustat
psutil
qdarkstyle
darkdetect
requests