microsoft/bitnet-b1.58-2B-4T

Great work! Do you plan to release an onnx version as well? I tried an old conversion but it currently errors:

optimum-cli export onnx --model microsoft/bitnet-b1.58-2B-4T bitnet-b1.58-2B-4T-onnx

2025-04-17 13:08:54.530274: I tensorflow/core/util/port.cc:153] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`.
2025-04-17 13:08:54.538551: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:477] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
WARNING: All log messages before absl::InitializeLog() is called are written to STDERR
E0000 00:00:1744895334.547566 3759150 cuda_dnn.cc:8310] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
E0000 00:00:1744895334.550233 3759150 cuda_blas.cc:1418] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2025-04-17 13:08:54.560717: I tensorflow/core/platform/cpu_feature_guard.cc:210] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 AVX512F AVX512_VNNI AVX512_BF16 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
Traceback (most recent call last):
  File "/home/eek/.local/bin/optimum-cli", line 8, in <module>
    sys.exit(main())
  File "/home/eek/.local/lib/python3.10/site-packages/optimum/commands/optimum_cli.py", line 185, in main
    load_subpackages()
  File "/home/eek/.local/lib/python3.10/site-packages/optimum/subpackages.py", line 78, in load_subpackages
    load_namespace_modules("optimum", SUBPACKAGE_LOADER)
  File "/home/eek/.local/lib/python3.10/site-packages/optimum/subpackages.py", line 49, in load_namespace_modules
    if not dist_name.startswith(f"{namespace}-"):
AttributeError: 'NoneType' object has no attribute 'startswith'

would be great to be able to run it client side since it's so efficient!

microsoft
/

bitnet-b1.58-2B-4T

ONNX version