u/MushroomSaute

For a more specific problem description, on 4.7.3, I'm running the server with the same arguments as I always have, and it runs without server-side errors. But, after logging in, it's stuck on the Gradio loading animation... forever. The browser console log shows 404s for all the resources, like the JS and fonts, despite having extracted the whole tar.gz file just like before, and even in a new directory - so I'd expect it to run without issue. Permissions are 770 for my user, recursive across the whole tree.

I haven't changed anything except which executable I'm targeting after the update. So, instead of running start_linux.sh, I'm using the all-in-one executable with the same exact arguments as before:

$ ./textgen --listen --listen-port 7860 --gradio-auth-path /etc/textgen/users.conf
14:06:43-788319 INFO     Starting TextGen
14:06:43-798646 INFO     Loading settings from
                         "/opt/textgen/textgen-v4.7.3/user_data/settings.yaml"
14:06:44-422231 INFO     OpenAI/Anthropic-compatible API URL:

                         http://0.0.0.0:5000/v1


Running on local URL:  http://0.0.0.0:7860

Maybe it has do with the directory having a different structure now? Really not sure. All I know is that I get browser console logs like this for the fonts, JS, and CSS, and only after logging in (no logs/errors before that):

GET <my-server>/file/css/NotoSans/NotoSans-Medium.woff2
...
404 Not Found
...

^((<my-server> replacing the server's scheme and hostname in this example))

Not very helpful when the files are there:

$ ls app/css/NotoSans/
...                              ...
NotoSans-BlackItalic.woff2       NotoSans-Medium.woff
NotoSans-Bold.woff               NotoSans-Medium.woff2
...                              ...
$ tree app/js
app/js
├── dark_theme.js
├── global_scope_js.js
├── highlightjs
│   ├── highlightjs-copy.min.js
│   └── highlight.min.js
├── katex
│   ├── auto-render.js
│   └── katex.min.js
├── main.js
├── morphdom
│   └── morphdom-umd.min.js
├── save_files.js
├── show_controls.js
├── switch_tabs.js
└── update_big_picture.js

Changing the hostname does nothing - localhost, 127.0.0.1, my internal IPv4 address, etc. Ports 5000 and 7860 are open in my firewall.

What does work is if I run 4.6 first. I can log in and then stop the server, then run 4.7.3 again. It's all good, it works, until the cache clears (Ctrl+F5) and I get the same hang again. So, there's nothing wrong with my network, firewall, anything like that, since it works on the old version - all that's changed are the portable TextGen files, and those seem to be doing something differently or require some change that isn't documented (since the changes only say to use the new executable).

What also works is just running ./textgen, no parameters at all, and letting the standalone Electron app run. That doesn't work for my use case, though.

Anyone getting this issue, and does anyone have a fix? Thanks!

reddit.com
u/MushroomSaute — 8 days ago