calcuis

/

chatterbox-gguf

like 21

How did you get it working? the instructions are unclear and I seem to be completely lost.

I don't think this actually uses the gguf files
looks like ggc c2 just loads the safetensors from callgg/chatterbox-decoder

https://github.com/calcuis/gguf-connector/blob/main/src/gguf_connector/c2.py#L179

Hi,

same here ggc c2 try to download safetensors version !
how to make it work with gguf already downloaded please ?

Best

This smells like a full blown scam reading the code,
you better do a virus scan if you downloaded anything from that repo.

why do you making such false claim? those files are for other developers and the team to work on

Hi,

same here ggc c2 try to download safetensors version !
how to make it work with gguf already downloaded please ?

Best

someone is working on the gguf engine; those files are for coding and testing purposes; the demo version is using bf16 safetensors recently which is faster than the original f32 version already

hi all, upgrade your gguf-connector to the latest version; all gguf works right away

hi,

thank you for the update , i get this error :

D:\tts\chatterbox-gguf\vnv\Lib\site-packages\chichat\perth\perth_net_init_.py:1: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.
from pkg_resources import resource_filename
GGUF file(s) available. Select which one for ve:

1. s3gen-q8_0.gguf
2. t3_cfg-q6_k.gguf
3. ve_fp32-f16.gguf
4. ve_fp32-f32.gguf
   Enter your choice (1 to 4): 3
   ve file: ve_fp32-f16.gguf is selected!

GGUF file(s) available. Select which one for t3:

1. s3gen-q8_0.gguf
2. t3_cfg-q6_k.gguf
3. ve_fp32-f16.gguf
4. ve_fp32-f32.gguf
   Enter your choice (1 to 4): 2
   t3 file: t3_cfg-q6_k.gguf is selected!

• Running on local URL: http://127.0.0.1:7860
• To create a public link, set share=True in launch().
  tokenizer.json: 100%|█████████████████████████████████████████████████████████████| 25.5k/25.5k [00:00<00:00, 50.6MB/s]
  D:\tts\chatterbox-gguf\vnv\Lib\site-packages\huggingface_hub\file_download.py:143: UserWarning: huggingface_hub cache-system uses symlinks by default to efficiently store duplicated files but your machine does not support them in C:\Users\Sam.cache\huggingface\hub\models--callgg--chatterbox-encoder. Caching files will still work but in a degraded version that might require more space on your disk. This warning can be disabled by setting the HF_HUB_DISABLE_SYMLINKS_WARNING environment variable. For more details, see https://huggingface.co/docs/huggingface_hub/how-to-cache#limitations.
  To support symlinks on Windows, you either need to activate Developer Mode or to run Python as an administrator. In order to activate developer mode, see this article: https://docs.microsoft.com/en-us/windows/apps/get-started/enable-your-device-for-development
  warnings.warn(message)
  conds.pt: 100%|██████████████████████████████████████████████████████████████████████| 107k/107k [00:00<00:00, 300kB/s]
  Traceback (most recent call last):
  File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\gradio\queueing.py", line 625, in process_events
  response = await route_utils.call_process_api(
  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\gradio\route_utils.py", line 322, in call_process_api
  output = await app.get_blocks().process_api(
  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\gradio\blocks.py", line 2193, in process_api
  result = await self.call_function(
  ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\gradio\blocks.py", line 1704, in call_function
  prediction = await anyio.to_thread.run_sync( # type: ignore
  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\anyio\to_thread.py", line 56, in run_sync
  return await get_async_backend().run_sync_in_worker_thread(
  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\anyio_backends_asyncio.py", line 2470, in run_sync_in_worker_thread
  return await future
  ^^^^^^^^^^^^
  File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\anyio_backends_asyncio.py", line 967, in run
  result = context.run(func, *args)
  ^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\gradio\utils.py", line 894, in wrapper
  response = f(*args, **kwargs)
  ^^^^^^^^^^^^^^^^^^
  File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\gguf_connector\c2.py", line 359, in load_model
  model = ChatterboxTTS.from_pretrained(DEVICE)
  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\gguf_connector\c2.py", line 283, in from_pretrained
  return cls.from_local(Path(local_path).parent, device)
  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\gguf_connector\c2.py", line 243, in from_local
  load_file(vae_path)
  File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\safetensors\torch.py", line 313, in load_file
  with safe_open(filename, framework="pt", device=device) as f:
  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

FileNotFoundError: No such file or directory: "ve_fp32-f16-bf16.safetensors"
Traceback (most recent call last):
File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\gradio\queueing.py", line 625, in process_events
response = await route_utils.call_process_api(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\gradio\route_utils.py", line 322, in call_process_api
output = await app.get_blocks().process_api(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\gradio\blocks.py", line 2193, in process_api
result = await self.call_function(
^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\gradio\blocks.py", line 1704, in call_function
prediction = await anyio.to_thread.run_sync( # type: ignore
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\anyio\to_thread.py", line 56, in run_sync
return await get_async_backend().run_sync_in_worker_thread(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\anyio_backends_asyncio.py", line 2470, in run_sync_in_worker_thread
return await future
^^^^^^^^^^^^
File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\anyio_backends_asyncio.py", line 967, in run
result = context.run(func, *args)
^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\gradio\utils.py", line 894, in wrapper
response = f(*args, **kwargs)
^^^^^^^^^^^^^^^^^^
File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\gguf_connector\c2.py", line 364, in generate
model = ChatterboxTTS.from_pretrained(DEVICE)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\gguf_connector\c2.py", line 283, in from_pretrained
return cls.from_local(Path(local_path).parent, device)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\gguf_connector\c2.py", line 243, in from_local
load_file(vae_path)
File "D:\tts\chatterbox-gguf\vnv\Lib\site-packages\safetensors\torch.py", line 313, in load_file
with safe_open(filename, framework="pt", device=device) as f:
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
FileNotFoundError: No such file or directory: "ve_fp32-f16-bf16.safetensors"

seems your vnv has some compatible problems; update your dependencies and try again

for s3gen and ve it try to load the safetensors version !

see here : FileNotFoundError: No such file or directory: "ve_fp32-f16-bf16.safetensors"

GGUF file(s) available. Select which one for ve:

1. s3gen-q8_0.gguf
2. t3_cfg-q6_k.gguf
3. ve_fp32-f16.gguf
4. ve_fp32-f32.gguf
   Enter your choice (1 to 4): 3
   ve file: ve_fp32-f16.gguf is selected!

GGUF file(s) available. Select which one for t3:

1. s3gen-q8_0.gguf
2. t3_cfg-q6_k.gguf
3. ve_fp32-f16.gguf
4. ve_fp32-f32.gguf
   Enter your choice (1 to 4): 2
   t3 file: t3_cfg-q6_k.gguf is selected!

Safetensors file(s) available. Select which one for s3gen:

1. ve_fp32-f16-bf16.safetensors
   Enter your choice (1 to 1):

you need the s3gen safetensors; please refer to the example