Compare commits

..

83 Commits
1.0 ... main

Author SHA1 Message Date
adbb97ecc2 added desc_act option 2023-06-03 16:27:13 +02:00
b10c023810 next try adding patchelf installation
Some checks reported warnings
Package Release / package_on_ubuntu (push) Has been cancelled
Package Release / package_on_windows (push) Has been cancelled
2023-05-27 15:27:17 +02:00
757debce3a trying nuitka with linux 2023-05-27 15:23:35 +02:00
a8f033ac5b
switching to nuitka, fix removing build folders 2023-05-27 15:19:49 +02:00
a32aff730e
fixes indentations 2023-05-27 15:10:37 +02:00
0cd44016f5 trying out nuitka on github actions 2023-05-27 15:09:44 +02:00
21930ba8e9 fixed ubuntu & Windows package creation 2023-05-27 13:38:52 +02:00
b96c0914ed
Update package.yml 2023-05-27 13:36:45 +02:00
a07146e879
deleted venv
Some checks reported warnings
Package Release / package (ubuntu-latest) (push) Has been cancelled
Package Release / package (windows-latest) (push) Has been cancelled
2023-05-27 13:21:57 +02:00
807dad51dd too tired to get it in one go 2023-05-27 11:12:04 +02:00
395c347020 mistake fixing 2023-05-27 11:11:16 +02:00
a75a8f42bc still trying to use venv for packaging p2 2023-05-27 11:10:35 +02:00
24e5876eff removed venv deletion for now. 2023-05-27 09:26:37 +02:00
c87e12d75a still trying to use venv for packaging p1 2023-05-27 09:08:07 +02:00
1ffd11eb5b copy & paste error
Some checks reported warnings
Package Release / package (ubuntu-latest) (push) Has been cancelled
Package Release / package (windows-latest) (push) Has been cancelled
2023-05-27 08:21:56 +02:00
311cbfed75 fixing the leave venv 2023-05-27 08:20:29 +02:00
646b7419a5 trying venv to hopefully decrease the binary size 2023-05-27 08:12:41 +02:00
0fb9a42cc6
Update package.yml 2023-05-27 09:45:12 +02:00
b2f2a894c9 removed git commit compare, fixed startup if no nvidia_gpu was found. 2023-05-26 23:23:53 +02:00
ce9ef8f419 last try to fix this
Some checks reported warnings
Package Release / package (ubuntu-latest) (push) Has been cancelled
Package Release / package (windows-latest) (push) Has been cancelled
2023-05-26 18:46:42 +02:00
db6ed71594 last try to fix this 2023-05-26 18:44:36 +02:00
86171f84d7 can't get this ***** fixed -.-
Some checks reported warnings
Package Release / package (ubuntu-latest) (push) Has been cancelled
Package Release / package (windows-latest) (push) Has been cancelled
2023-05-26 15:45:34 +02:00
077669ea2e try fix github actions 2023-05-26 15:24:40 +02:00
25087b1e2d try fix github actions 2023-05-26 15:21:02 +02:00
5d755a302c try fix github actions 2023-05-26 15:20:27 +02:00
cc485f5342 try fix github actions 2023-05-26 15:15:05 +02:00
20c847a532 try fix github actions 2023-05-26 15:11:42 +02:00
ab514acc40 fix for the pyinstaller cmd? 2023-05-26 15:10:31 +02:00
f28f1f21f9 Raised Version to 1.6 2023-05-26 15:06:56 +02:00
c3696284fa made the update text-gen-webui update button to disappear if already at the newest commit 2023-05-26 15:04:39 +02:00
5e40ae8456 added llamap n_ctx and seed options, removed cai_chat (despite docs not working) 2023-05-26 08:32:36 +02:00
d1de11ecf4 removed the webuiGUI.py necessity, disable accelerate for windows (incompatible), remove some useless code (still learning) 2023-05-25 19:55:33 +02:00
b063f23e71 added save and load for accelerate. 2023-05-25 18:44:08 +02:00
58772e86f6 Added Accelerate 4bit options, made DeepSpeed disable for windows systems, added pip install accelerate if 8bit is used. 2023-05-25 18:36:34 +02:00
c8ed510030 raised version to 1.5.1 due to fixes in pre_loading
Some checks reported warnings
Package Release / package (ubuntu-latest) (push) Has been cancelled
Package Release / package (windows-latest) (push) Has been cancelled
2023-05-23 18:33:34 +02:00
39b2f0c54d fixed pre_slayer slider crashing on changes 2023-05-22 07:45:06 +02:00
ef7e4ed673 Updated package.yml and readme for 1.5
Some checks reported warnings
Package Release / package (ubuntu-latest) (push) Has been cancelled
Package Release / package (windows-latest) (push) Has been cancelled
2023-05-20 13:12:16 +02:00
5aac959224 Added pre_slayer sliders for all GPU's found. (atm based on nvidia_gpu boolean, will change it next week whe I'm @ home) 2023-05-20 13:10:10 +02:00
39ac8a094a Added autogptq and triton checkbox. 2023-05-20 11:59:50 +02:00
2e0acc1b3d fixed nvidia_less save & load + deepspeed nvme offload save & load
Some checks reported warnings
Package Release / package (ubuntu-latest) (push) Has been cancelled
Package Release / package (windows-latest) (push) Has been cancelled
2023-05-17 01:20:17 +02:00
2d6298c59b
Update README.md Screenshots 2023-05-17 00:55:34 +02:00
f585e62ada to late to fix this now. 2023-05-17 00:52:39 +02:00
486b31b39e fixed the ubuntu-latest are build on windows and windows-latest build on ubuntu 2023-05-17 00:41:33 +02:00
9fa0424a6c fixed the ubuntu-latest are build on windows and windows-latest build on ubuntu 2023-05-17 00:38:30 +02:00
334b1dde6c Auto build on changes to package.yml test 2023-05-17 00:27:14 +02:00
31f2fe2cbc package.yml for v1.4 2023-05-17 00:20:30 +02:00
6cdbea0cfd Updated Readme.md for v1.4 2023-05-17 00:19:45 +02:00
bf68fcfec5 Added: Almost all Options, Toolbar for advanced Options, finished no nvidia mode, made layout compact because of the additional options 2023-05-17 00:13:16 +02:00
87a4c9fd2b Added Character Selector 2023-05-16 14:14:08 +02:00
8217fb468d Added the possibility to use the UI without NVIDIA GPU's 2023-05-16 14:13:25 +02:00
ecc3131530 forgot again to uncomment the start, sry 2023-05-16 10:14:40 +02:00
2df42114e9 Added an report bug menu (create new github issue) 2023-05-15 22:27:10 +02:00
99d1d92e14 changed to v3 (node 16) 2023-05-15 22:04:35 +02:00
8f4c651caa switched to self-hosted runner for future projects 2023-05-15 21:54:07 +02:00
81cd746a46 Merge remote-tracking branch 'origin/main' 2023-05-15 21:15:53 +02:00
df82faee5a switched to qdarkstyle cause of ToolTips not readable in dark mode 2023-05-15 21:15:45 +02:00
e3780dafd5
Update README.md for v1.3
added screenshots and new features of v1.3
2023-05-15 19:04:13 +02:00
a062bbc7fa added requests. Thought it's a built in module. 2023-05-15 18:11:18 +02:00
91e4e1f280 changed to manual run. Also my fix the node warnings. 2023-05-15 18:07:53 +02:00
26c0cf03ca Stupid me, forgot to uncomment run_cmd again. 2023-05-15 17:06:43 +02:00
36b9d3e9b4 fixed Update Button Font-Color 2023-05-15 17:00:15 +02:00
8ca048e94d Added Dark OS detection + Dark Theme 2023-05-15 16:52:16 +02:00
44227e2627 Added the possibility to choose none Model (start webui without loading up a model) 2023-05-15 13:57:33 +02:00
3a2affa702 Raised Version to 1.3 2023-05-15 13:44:34 +02:00
5c77703b38 Added Menu with some information. 2023-05-15 13:43:59 +02:00
17e02d982b Added Update Notifier. 2023-05-15 13:43:11 +02:00
8922d59b95 Fixed Linux Terminal output. 2023-05-14 12:24:15 +02:00
b878c717a3 raised version to 1.2 2023-05-14 13:26:21 +02:00
9693d79bcc added lora selection. hide extension list if use extensions is not checked. 2023-05-14 13:25:52 +02:00
22486fe6f7 Added model_type selection and made preperations for MPT 2023-05-14 12:40:28 +02:00
9813fd193c Merge remote-tracking branch 'origin/main' 2023-05-14 11:03:09 +02:00
f3c85d0e0e added disk & disk-cache-dir option. Refactored load & save functions 2023-05-14 11:03:00 +02:00
ace921679e
Added v1.1 screenshots 2023-05-13 23:22:44 +02:00
ad10789e60 removed the tag stuff, cause it isn't working as I hoped. (Still learning github actions) 2023-05-13 23:11:26 +02:00
1120fa185a Updated Readme cause of recent changes. 2023-05-13 23:09:53 +02:00
d0326f479a Merge branch 'main' of https://github.com/Pakobbix/StartUI-oobabooga-webui 2023-05-13 23:03:36 +02:00
0fd41f2714 added psutil as requirements 2023-05-13 23:02:52 +02:00
0c3e925856 Added a lot. Read Release notes. 2023-05-13 23:02:42 +02:00
c15bac5579 Added Tag Counting for the release files
Added the webuiGUI.py to the Packages.
2023-05-13 22:53:11 +02:00
cb0eedcb49
Update README.md 2023-05-13 16:38:56 +02:00
bd55f9dd18
Update README.md
reuploaded images
2023-05-13 16:24:07 +02:00
33d2fdcf8b
Update README.md
Added an Disclaimer to the Readme.
2023-05-13 16:22:10 +02:00
ef260d7b10
Update README.md
Added Release URL
2023-05-13 16:14:03 +02:00
4 changed files with 1939 additions and 247 deletions

View File

@ -1,36 +1,83 @@
name: Package Release
on:
push:
branches:
- main
paths:
- .github/workflows/**
workflow_dispatch:
jobs:
package:
runs-on: ${{ matrix.os }}
strategy:
matrix:
os: [windows-latest, ubuntu-latest, macos-latest]
package_on_ubuntu:
runs-on: ubuntu-selfhosted
steps:
- name: Set up Python
uses: actions/setup-python@v2
uses: actions/setup-python@v3
with:
python-version: 3.x
- name: Checkout repository
uses: actions/checkout@v2
uses: actions/checkout@v3
- name: Upgrade Pip
run: python -m pip install --upgrade pip
- name: Install dependencies
run: |
python -m pip install --upgrade pip
sudo apt-get update
sudo apt-get upgrade -y
sudo apt-get install patchelf -y
pip install -r requirements.txt
pip install pyinstaller
pip install nuitka
sudo apt install patchelf
- name: Build and package
run: pyinstaller --noconfirm --onefile --windowed StartUI.py
run: python3 -m nuitka StartUI.py --onefile --enable-plugin=pyqt5 --product-version=1.6.0 --disable-console --include-data-files=webuiGUI.py=webuiGUI.py --output-dir=./dist --noinclude-pytest-mode=nofollow --noinclude-setuptools-mode=nofollow
- name: remove build folders
run: |
rm -rf dist/StartUI.build
rm -rf dist/StartUI.dist
rm -rf dist/StartUI.onefile-build
- name: Executive permission
run: |
chmod +x dist/StartUI
- name: Upload artifacts
uses: actions/upload-artifact@v2
uses: actions/upload-artifact@v3
with:
name: ${{ matrix.os }}-binary
path: dist # Assuming the packaged files are created in a 'dist' directory
name: ubuntu-binary-v1.6
path: dist
package_on_windows:
runs-on: windows-selfhosted
steps:
- name: Set up Python
uses: actions/setup-python@v3
with:
python-version: 3.x
- name: Checkout repository
uses: actions/checkout@v3
- name: Upgrade Pip
run: python -m pip install --upgrade pip
- name: Install dependencies
run: |
pip install -r requirements.txt
pip install nuitka
- name: Build and package
run: nuitka StartUI.py --onefile --enable-plugin=pyqt5 --product-version=1.6.0 --disable-console --include-data-files=webuiGUI.py=webuiGUI.py --output-dir=./dist --noinclude-pytest-mode=nofollow --noinclude-setuptools-mode=nofollow
- name: remove build folders
run: |
Remove-Item -Recurse -Force ./dist/StartUI.build
Remove-Item -Recurse -Force ./dist/StartUI.dist
Remove-Item -Recurse -Force ./dist/StartUI.onefile-build
- name: Upload artifacts
uses: actions/upload-artifact@v3
with:
name: windows-binary-v1.6
path: dist

View File

@ -1,25 +1,35 @@
# WebUI StartGUI
## Disclaimer
As someone who isn't a professional programmer, I enjoy experimenting and finding ways to simplify my workflow. This GUI was created to make it easier for me to adjust parameters and save them for future use, without constantly modifying the webui.py or managing multiple scripts. While I'm glad to share this script with others, please understand that my expertise in maintaining it might be limited. Nonetheless, I hope it proves helpful to you, and I appreciate your understanding.
## Description
WebUI StartGUI is a Python graphical user interface (GUI) written with PyQT5, that allows users to configure settings and start the oobabooga web user interface (WebUI). It provides a convenient way to adjust various parameters and launch the WebUI with the desired settings.
## Current Features
- Select a model from a dropdown menu
- Select a model from a dropdown menu or none (with reload button if added while the StartUI is open)
- Choose wbits and groupsize options
- Select the operating mode (chat, cai-chat, notebook)
- Enable/disable GPU usage and set GPU VRAM (Only for Nvidia Right now, will detect if multiple GPU's are Present)
- Adjust pre-layer value
- Load the model with 8-bit precision
- Choose between CPU, GPU or Autodevice
- Set CPU RAM/GPU VRAM (Only for Nvidia Right now, will automatically detect if multiple GPU's are Present)
- Adjust pre-layer value (for each Nvidia GPU found or 1 if none)
- Choose to run with 8bit, 16bit, trust_remote_code, Quant_attn, Autotune and no-cache flags
- Enable authentication and choose an authentication file
- Choose extensions for the WebUI
- Enable local network mode and specify the listen port
- Automatically open the browser when loading is finished
- Save settings to a profile
- Load profiles via Dropdown menu.
- Run the text-generation-webui Updater
- Character loader.
- deepspeed Settings
- flexgen Settings
- API Settings
- StartUI Update Notification
## How to Use
1. Clone the repository or download the source code.
2. Install the required dependencies listed in the `requirements.txt` file. (PyQT5 & gpustat)
2. Install the required dependencies listed in the `requirements.txt` file.
3. Run the `StartUI.py` script using Python `python3 StartUI.py`.
4. Configure the desired settings using the GUI elements.
5. Click the "Save Settings" button to save the current settings to a profile.
@ -28,7 +38,31 @@ WebUI StartGUI is a Python graphical user interface (GUI) written with PyQT5, th
## Binary Download
Binary releases of this script can be found in the [Releases](https://github.com/your-username/your-repository/releases) section of this repository.
Binary releases of this script can be found in the [Releases](https://github.com/Pakobbix/StartUI-oobabooga-webui/releases) section of this repository.
Just put the two files into the root Folder of oobabooga (where the folder with the webui.py and the start script is).
On Linux, you'll need to give StartUI the executable flag (`chmod +x StartUI` or right click -> properties -> make executable).
The WebuiGUI.py must also be there, to handle the flags properly
## Screenshots
V1.4 :\
<details>
<summary>Screenshots</summary>
![1 4](https://github.com/Pakobbix/StartUI-oobabooga-webui/assets/6762686/7f252274-b20b-4e52-9789-fc45645faf03)
![1 4 deepspeed](https://github.com/Pakobbix/StartUI-oobabooga-webui/assets/6762686/b3c566c3-bfa2-4d38-a1af-cee82bf6f5fa)
![1 4 llama options](https://github.com/Pakobbix/StartUI-oobabooga-webui/assets/6762686/8b7bb61d-9ab5-4e54-b4e2-34ec1a36439a)
![1 4 flexgen](https://github.com/Pakobbix/StartUI-oobabooga-webui/assets/6762686/def814cb-4f69-4a39-91cd-6731155c12a3)
![1 4 multi settings](https://github.com/Pakobbix/StartUI-oobabooga-webui/assets/6762686/f3478ff1-bcba-4935-9e4c-efb1a2e64dcd)
</details>
## Credits
StartGUI is developed and maintained by [Pakobbix](https://github.com/Pakobbix).

2061
StartUI.py

File diff suppressed because it is too large Load Diff

View File

@ -1,2 +1,6 @@
PyQt5
gpustat
psutil
qdarkstyle
darkdetect
requests