69 Commits

Author SHA1 Message Date
Pakobbix 1ffd11eb5b copy & paste error
Package Release / package (ubuntu-latest) (push) Has been cancelled
Package Release / package (windows-latest) (push) Has been cancelled
2023-05-27 08:21:56 +02:00
Pakobbix 311cbfed75 fixing the leave venv 2023-05-27 08:20:29 +02:00
Pakobbix 646b7419a5 trying venv to hopefully decrease the binary size 2023-05-27 08:12:41 +02:00
Pakobbix 0fb9a42cc6 Update package.yml 2023-05-27 09:45:12 +02:00
Pakobbix b2f2a894c9 removed git commit compare, fixed startup if no nvidia_gpu was found. 2023-05-26 23:23:53 +02:00
Pakobbix ce9ef8f419 last try to fix this
Package Release / package (ubuntu-latest) (push) Has been cancelled
Package Release / package (windows-latest) (push) Has been cancelled
2023-05-26 18:46:42 +02:00
Pakobbix db6ed71594 last try to fix this 2023-05-26 18:44:36 +02:00
Pakobbix 86171f84d7 can't get this ***** fixed -.-
Package Release / package (ubuntu-latest) (push) Has been cancelled
Package Release / package (windows-latest) (push) Has been cancelled
2023-05-26 15:45:34 +02:00
Pakobbix 077669ea2e try fix github actions 2023-05-26 15:24:40 +02:00
Pakobbix 25087b1e2d try fix github actions 2023-05-26 15:21:02 +02:00
Pakobbix 5d755a302c try fix github actions 2023-05-26 15:20:27 +02:00
Pakobbix cc485f5342 try fix github actions 2023-05-26 15:15:05 +02:00
Pakobbix 20c847a532 try fix github actions 2023-05-26 15:11:42 +02:00
Pakobbix ab514acc40 fix for the pyinstaller cmd? 2023-05-26 15:10:31 +02:00
Pakobbix f28f1f21f9 Raised Version to 1.6 2023-05-26 15:06:56 +02:00
Pakobbix c3696284fa made the update text-gen-webui update button to disappear if already at the newest commit 2023-05-26 15:04:39 +02:00
Pakobbix 5e40ae8456 added llamap n_ctx and seed options, removed cai_chat (despite docs not working) 2023-05-26 08:32:36 +02:00
Pakobbix d1de11ecf4 removed the webuiGUI.py necessity, disable accelerate for windows (incompatible), remove some useless code (still learning) 2023-05-25 19:55:33 +02:00
Pakobbix b063f23e71 added save and load for accelerate. 2023-05-25 18:44:08 +02:00
Pakobbix 58772e86f6 Added Accelerate 4bit options, made DeepSpeed disable for windows systems, added pip install accelerate if 8bit is used. 2023-05-25 18:36:34 +02:00
Pakobbix c8ed510030 raised version to 1.5.1 due to fixes in pre_loading
Package Release / package (ubuntu-latest) (push) Has been cancelled
Package Release / package (windows-latest) (push) Has been cancelled
2023-05-23 18:33:34 +02:00
Pakobbix 39b2f0c54d fixed pre_slayer slider crashing on changes 2023-05-22 07:45:06 +02:00
Pakobbix ef7e4ed673 Updated package.yml and readme for 1.5
Package Release / package (ubuntu-latest) (push) Has been cancelled
Package Release / package (windows-latest) (push) Has been cancelled
2023-05-20 13:12:16 +02:00
Pakobbix 5aac959224 Added pre_slayer sliders for all GPU's found. (atm based on nvidia_gpu boolean, will change it next week whe I'm @ home) 2023-05-20 13:10:10 +02:00
Pakobbix 39ac8a094a Added autogptq and triton checkbox. 2023-05-20 11:59:50 +02:00
Pakobbix 2e0acc1b3d fixed nvidia_less save & load + deepspeed nvme offload save & load
Package Release / package (ubuntu-latest) (push) Has been cancelled
Package Release / package (windows-latest) (push) Has been cancelled
2023-05-17 01:20:17 +02:00
Pakobbix 2d6298c59b Update README.md Screenshots 2023-05-17 00:55:34 +02:00
Pakobbix f585e62ada to late to fix this now. 2023-05-17 00:52:39 +02:00
Pakobbix 486b31b39e fixed the ubuntu-latest are build on windows and windows-latest build on ubuntu 2023-05-17 00:41:33 +02:00
Pakobbix 9fa0424a6c fixed the ubuntu-latest are build on windows and windows-latest build on ubuntu 2023-05-17 00:38:30 +02:00
Pakobbix 334b1dde6c Auto build on changes to package.yml test 2023-05-17 00:27:14 +02:00
Pakobbix 31f2fe2cbc package.yml for v1.4 2023-05-17 00:20:30 +02:00
Pakobbix 6cdbea0cfd Updated Readme.md for v1.4 2023-05-17 00:19:45 +02:00
Pakobbix bf68fcfec5 Added: Almost all Options, Toolbar for advanced Options, finished no nvidia mode, made layout compact because of the additional options 2023-05-17 00:13:16 +02:00
Pakobbix 87a4c9fd2b Added Character Selector 2023-05-16 14:14:08 +02:00
Pakobbix 8217fb468d Added the possibility to use the UI without NVIDIA GPU's 2023-05-16 14:13:25 +02:00
Pakobbix ecc3131530 forgot again to uncomment the start, sry 2023-05-16 10:14:40 +02:00
Pakobbix 2df42114e9 Added an report bug menu (create new github issue) 2023-05-15 22:27:10 +02:00
Pakobbix 99d1d92e14 changed to v3 (node 16) 2023-05-15 22:04:35 +02:00
Pakobbix 8f4c651caa switched to self-hosted runner for future projects 2023-05-15 21:54:07 +02:00
Pakobbix 81cd746a46 Merge remote-tracking branch 'origin/main' 2023-05-15 21:15:53 +02:00
Pakobbix df82faee5a switched to qdarkstyle cause of ToolTips not readable in dark mode 2023-05-15 21:15:45 +02:00
Pakobbix e3780dafd5 Update README.md for v1.3
added screenshots and new features of v1.3
2023-05-15 19:04:13 +02:00
Pakobbix a062bbc7fa added requests. Thought it's a built in module. 2023-05-15 18:11:18 +02:00
Pakobbix 91e4e1f280 changed to manual run. Also my fix the node warnings. 2023-05-15 18:07:53 +02:00
Pakobbix 26c0cf03ca Stupid me, forgot to uncomment run_cmd again. 2023-05-15 17:06:43 +02:00
Pakobbix 36b9d3e9b4 fixed Update Button Font-Color 2023-05-15 17:00:15 +02:00
Pakobbix 8ca048e94d Added Dark OS detection + Dark Theme 2023-05-15 16:52:16 +02:00
Pakobbix 44227e2627 Added the possibility to choose none Model (start webui without loading up a model) 2023-05-15 13:57:33 +02:00
Pakobbix 3a2affa702 Raised Version to 1.3 2023-05-15 13:44:34 +02:00
Pakobbix 5c77703b38 Added Menu with some information. 2023-05-15 13:43:59 +02:00
Pakobbix 17e02d982b Added Update Notifier. 2023-05-15 13:43:11 +02:00
Pakobbix 8922d59b95 Fixed Linux Terminal output. 2023-05-14 12:24:15 +02:00
Pakobbix b878c717a3 raised version to 1.2 2023-05-14 13:26:21 +02:00
Pakobbix 9693d79bcc added lora selection. hide extension list if use extensions is not checked. 2023-05-14 13:25:52 +02:00
Pakobbix 22486fe6f7 Added model_type selection and made preperations for MPT 2023-05-14 12:40:28 +02:00
Pakobbix 9813fd193c Merge remote-tracking branch 'origin/main' 2023-05-14 11:03:09 +02:00
Pakobbix f3c85d0e0e added disk & disk-cache-dir option. Refactored load & save functions 2023-05-14 11:03:00 +02:00
Pakobbix ace921679e Added v1.1 screenshots 2023-05-13 23:22:44 +02:00
Pakobbix ad10789e60 removed the tag stuff, cause it isn't working as I hoped. (Still learning github actions) 2023-05-13 23:11:26 +02:00
Pakobbix 1120fa185a Updated Readme cause of recent changes. 2023-05-13 23:09:53 +02:00
Pakobbix d0326f479a Merge branch 'main' of https://github.com/Pakobbix/StartUI-oobabooga-webui 2023-05-13 23:03:36 +02:00
Pakobbix 0fd41f2714 added psutil as requirements 2023-05-13 23:02:52 +02:00
Pakobbix 0c3e925856 Added a lot. Read Release notes. 2023-05-13 23:02:42 +02:00
Pakobbix c15bac5579 Added Tag Counting for the release files
Added the webuiGUI.py to the Packages.
2023-05-13 22:53:11 +02:00
Pakobbix cb0eedcb49 Update README.md 2023-05-13 16:38:56 +02:00
Pakobbix bd55f9dd18 Update README.md
reuploaded images
2023-05-13 16:24:07 +02:00
Pakobbix 33d2fdcf8b Update README.md
Added an Disclaimer to the Readme.
2023-05-13 16:22:10 +02:00
Pakobbix ef260d7b10 Update README.md
Added Release URL
2023-05-13 16:14:03 +02:00
4 changed files with 1891 additions and 242 deletions
+25 -11
View File
@@ -1,23 +1,29 @@
name: Package Release
on:
push:
branches:
- main
paths:
- .github/workflows/**
workflow_dispatch:
jobs:
package:
runs-on: ${{ matrix.os }}
runs-on: self-hosted
strategy:
matrix:
os: [windows-latest, ubuntu-latest, macos-latest]
os: [windows-latest, ubuntu-latest]
steps:
- name: Set up Python
uses: actions/setup-python@v2
uses: actions/setup-python@v3
with:
python-version: 3.x
- name: Checkout repository
uses: actions/checkout@v2
uses: actions/checkout@v3
- name: Create and activate venv
run: |
python -m venv StartUI_env
source StartUI_env/bin/activate
- name: Install dependencies
run: |
@@ -26,11 +32,19 @@ jobs:
pip install pyinstaller
- name: Build and package
run: pyinstaller --noconfirm --onefile --windowed StartUI.py
run: pyinstaller --noconfirm --onefile --windowed StartUI.py --add-data="webuiGUI.py:."
- name: Leave venv and delete
run: |
if [ "$RUNNER_OS" == "Windows" ]; then
deactivate.bat
else
deactivate
fi
rm -rf StartUI_env
- name: Upload artifacts
uses: actions/upload-artifact@v2
uses: actions/upload-artifact@v3
with:
name: ${{ matrix.os }}-binary
path: dist # Assuming the packaged files are created in a 'dist' directory
name: ${{ matrix.os }}-binary-v1.6
path: dist
+40 -6
View File
@@ -1,25 +1,35 @@
# WebUI StartGUI
## Disclaimer
As someone who isn't a professional programmer, I enjoy experimenting and finding ways to simplify my workflow. This GUI was created to make it easier for me to adjust parameters and save them for future use, without constantly modifying the webui.py or managing multiple scripts. While I'm glad to share this script with others, please understand that my expertise in maintaining it might be limited. Nonetheless, I hope it proves helpful to you, and I appreciate your understanding.
## Description
WebUI StartGUI is a Python graphical user interface (GUI) written with PyQT5, that allows users to configure settings and start the oobabooga web user interface (WebUI). It provides a convenient way to adjust various parameters and launch the WebUI with the desired settings.
## Current Features
- Select a model from a dropdown menu
- Select a model from a dropdown menu or none (with reload button if added while the StartUI is open)
- Choose wbits and groupsize options
- Select the operating mode (chat, cai-chat, notebook)
- Enable/disable GPU usage and set GPU VRAM (Only for Nvidia Right now, will detect if multiple GPU's are Present)
- Adjust pre-layer value
- Load the model with 8-bit precision
- Choose between CPU, GPU or Autodevice
- Set CPU RAM/GPU VRAM (Only for Nvidia Right now, will automatically detect if multiple GPU's are Present)
- Adjust pre-layer value (for each Nvidia GPU found or 1 if none)
- Choose to run with 8bit, 16bit, trust_remote_code, Quant_attn, Autotune and no-cache flags
- Enable authentication and choose an authentication file
- Choose extensions for the WebUI
- Enable local network mode and specify the listen port
- Automatically open the browser when loading is finished
- Save settings to a profile
- Load profiles via Dropdown menu.
- Run the text-generation-webui Updater
- Character loader.
- deepspeed Settings
- flexgen Settings
- API Settings
- StartUI Update Notification
## How to Use
1. Clone the repository or download the source code.
2. Install the required dependencies listed in the `requirements.txt` file. (PyQT5 & gpustat)
2. Install the required dependencies listed in the `requirements.txt` file.
3. Run the `StartUI.py` script using Python `python3 StartUI.py`.
4. Configure the desired settings using the GUI elements.
5. Click the "Save Settings" button to save the current settings to a profile.
@@ -28,7 +38,31 @@ WebUI StartGUI is a Python graphical user interface (GUI) written with PyQT5, th
## Binary Download
Binary releases of this script can be found in the [Releases](https://github.com/your-username/your-repository/releases) section of this repository.
Binary releases of this script can be found in the [Releases](https://github.com/Pakobbix/StartUI-oobabooga-webui/releases) section of this repository.
Just put the two files into the root Folder of oobabooga (where the folder with the webui.py and the start script is).
On Linux, you'll need to give StartUI the executable flag (`chmod +x StartUI` or right click -> properties -> make executable).
The WebuiGUI.py must also be there, to handle the flags properly
## Screenshots
V1.4 :\
<details>
<summary>Screenshots</summary>
![1 4](https://github.com/Pakobbix/StartUI-oobabooga-webui/assets/6762686/7f252274-b20b-4e52-9789-fc45645faf03)
![1 4 deepspeed](https://github.com/Pakobbix/StartUI-oobabooga-webui/assets/6762686/b3c566c3-bfa2-4d38-a1af-cee82bf6f5fa)
![1 4 llama options](https://github.com/Pakobbix/StartUI-oobabooga-webui/assets/6762686/8b7bb61d-9ab5-4e54-b4e2-34ec1a36439a)
![1 4 flexgen](https://github.com/Pakobbix/StartUI-oobabooga-webui/assets/6762686/def814cb-4f69-4a39-91cd-6731155c12a3)
![1 4 multi settings](https://github.com/Pakobbix/StartUI-oobabooga-webui/assets/6762686/f3478ff1-bcba-4935-9e4c-efb1a2e64dcd)
</details>
## Credits
StartGUI is developed and maintained by [Pakobbix](https://github.com/Pakobbix).
+1823 -226
View File
File diff suppressed because it is too large Load Diff
+4
View File
@@ -1,2 +1,6 @@
PyQt5
gpustat
psutil
qdarkstyle
darkdetect
requests