Hugging Face's logo

JackBinary
/
OpenCodeReasoning-Nemotron-1.1-7B-q0f32-MLC

MLC-LLM
web-llm
Model card Files
xet
Community
JackBinary commited on
Commit
e36c3d1
·
verified ·
1 Parent(s): ab6879d

Add files using upload-large-folder tool

Browse files
Files changed (50) hide show
  1. README.md +52 -0
  2. ndarray-cache-b16.json +0 -0
  3. ndarray-cache.json +0 -0
  4. params_shard_100.bin +3 -0
  5. params_shard_101.bin +3 -0
  6. params_shard_102.bin +3 -0
  7. params_shard_103.bin +3 -0
  8. params_shard_107.bin +3 -0
  9. params_shard_108.bin +3 -0
  10. params_shard_109.bin +3 -0
  11. params_shard_111.bin +3 -0
  12. params_shard_113.bin +3 -0
  13. params_shard_14.bin +3 -0
  14. params_shard_15.bin +3 -0
  15. params_shard_16.bin +3 -0
  16. params_shard_17.bin +3 -0
  17. params_shard_18.bin +3 -0
  18. params_shard_20.bin +3 -0
  19. params_shard_26.bin +3 -0
  20. params_shard_29.bin +3 -0
  21. params_shard_3.bin +3 -0
  22. params_shard_4.bin +3 -0
  23. params_shard_40.bin +3 -0
  24. params_shard_41.bin +3 -0
  25. params_shard_46.bin +3 -0
  26. params_shard_49.bin +3 -0
  27. params_shard_51.bin +3 -0
  28. params_shard_54.bin +3 -0
  29. params_shard_59.bin +3 -0
  30. params_shard_64.bin +3 -0
  31. params_shard_65.bin +3 -0
  32. params_shard_67.bin +3 -0
  33. params_shard_68.bin +3 -0
  34. params_shard_69.bin +3 -0
  35. params_shard_70.bin +3 -0
  36. params_shard_73.bin +3 -0
  37. params_shard_75.bin +3 -0
  38. params_shard_78.bin +3 -0
  39. params_shard_79.bin +3 -0
  40. params_shard_8.bin +3 -0
  41. params_shard_81.bin +3 -0
  42. params_shard_82.bin +3 -0
  43. params_shard_84.bin +3 -0
  44. params_shard_85.bin +3 -0
  45. params_shard_86.bin +3 -0
  46. params_shard_87.bin +3 -0
  47. params_shard_90.bin +3 -0
  48. params_shard_93.bin +3 -0
  49. params_shard_94.bin +3 -0
  50. params_shard_96.bin +3 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlc-llm
3
+ base_model: nvidia/OpenCodeReasoning-Nemotron-1.1-7B
4
+ tags:
5
+ - mlc-llm
6
+ - web-llm
7
+ ---
8
+
9
+ # OpenCodeReasoning-Nemotron-1.1-7B-q0f32-MLC
10
+
11
+ This is the [OpenCodeReasoning-Nemotron-1.1-7B](https://huggingface.co/nvidia/OpenCodeReasoning-Nemotron-1.1-7B) model in MLC format `q0f32`.
12
+ The model can be used with [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
13
+
14
+ ## Example Usage
15
+
16
+ Before using the examples, please follow the [installation guide](https://llm.mlc.ai/docs/install/mlc_llm.html#install-mlc-packages).
17
+
18
+ ### Chat CLI
19
+
20
+ ```bash
21
+ mlc_llm chat HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-7B-q0f32-MLC
22
+ ````
23
+
24
+ ### REST Server
25
+
26
+ ```bash
27
+ mlc_llm serve HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-7B-q0f32-MLC
28
+ ```
29
+
30
+ ### Python API
31
+
32
+ ```python
33
+ from mlc_llm import MLCEngine
34
+
35
+ model = "HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-7B-q0f32-MLC"
36
+ engine = MLCEngine(model)
37
+
38
+ for response in engine.chat.completions.create(
39
+ messages=[{"role": "user", "content": "What is the meaning of life?"}],
40
+ model=model,
41
+ stream=True,
42
+ ):
43
+ for choice in response.choices:
44
+ print(choice.delta.content, end="", flush=True)
45
+ print("\n")
46
+
47
+ engine.terminate()
48
+ ```
49
+
50
+ ## Documentation
51
+
52
+ For more on MLC LLM, visit the [documentation](https://llm.mlc.ai/docs/) and [GitHub repo](https://github.com/mlc-ai/mlc-llm).
ndarray-cache-b16.json ADDED
The diff for this file is too large to render. See raw diff
 
ndarray-cache.json ADDED
The diff for this file is too large to render. See raw diff
 
params_shard_100.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7f9dfa346929e17a8c06dbe6738db11ca80bae6eb6fe0f93a66fc2bf3f67d12c
3
+ size 25690112
params_shard_101.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:808feeb7ad69e898bdf48987eaf704a5129254b73d40685a16cb0c8e95c6b909
3
+ size 135790592
params_shard_102.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:37295393bedfceb77a4aeace5887b6be83e360861b37ccfb79c6ad1daa0fd8b3
3
+ size 271581184
params_shard_103.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4177f08a55860edeed021170c3ce127e2a5b913145f9a6ef0126c5f3eedf0d7
3
+ size 33030144
params_shard_107.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:297ceb7dc8832556a843872726c4841096c3ee55ab8dbab81e1c138951c60f3f
3
+ size 33030144
params_shard_108.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70cfccaf88dcd3f65ada715d428f7e5afa5f76a3a557bb68c4430e07201fbd14
3
+ size 25690112
params_shard_109.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ea1058775d69cf31bc523329d5d0a33720eed1a7a6339477b2f2aa8a862c9eb
3
+ size 135790592
params_shard_111.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:346c32d7c54dd6e5aeb03687dd99e61475d0ffcd1cbdcaea0e584b3d1b9d55ed
3
+ size 33030144
params_shard_113.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4281891f9413e7c9d46b1c24496346dbfd95ff56da2b231b6df0b8ea894d9357
3
+ size 26356736
params_shard_14.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d96e1135ce3dd2009f729014b1d7fae1ed50cea981790d21e6f59ea647705753
3
+ size 25690112
params_shard_15.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4bf683004d6620a8b9d6e32ae76b4d9d993dd059d487e4f2af7b1a56640199de
3
+ size 135790592
params_shard_16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a31b0b3fbc6b1984df5b13c869059c526190ef854990b4ca2e0537368df7a38
3
+ size 271581184
params_shard_17.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:92c042fe29c2a8270edd9274e6b3f33ce72fda57e5d497a4a734619802ceb9a9
3
+ size 33030144
params_shard_18.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1eff016c5a4e8ec97105e654233c4e6c79febb9f539f0bfe17f2da66501341d5
3
+ size 25690112
params_shard_20.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed9a3d279585afd7367c15d545cf16280bbd91b27f0075c28aa6310fb5f6064d
3
+ size 271581184
params_shard_26.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:866d06d5d1551a7561b5b7e0803cd8425fb277accb48b6f8a42a7b1d44ff8238
3
+ size 25690112
params_shard_29.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8dc3f4e5f685d543381c347971a9985f0878673ad31bef40aed878fef2054b63
3
+ size 33030144
params_shard_3.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b3eb676c3e9d462c51e96767ace1651549cc65b7270d16d8d3888d4a860411c
3
+ size 135790592
params_shard_4.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:297c18760cefef76f74bbe37b635b53b028cd1bed650458eb798cec8d6e77c7d
3
+ size 271581184
params_shard_40.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a91952e84ab31e595a5382797fa31785a4eb66881fb854377a4bc8dde2612f4
3
+ size 135790592
params_shard_41.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e14ac275546af0e4de8a319544a38cf20ae636f89eaac021ad94a08aae4edd5
3
+ size 271581184
params_shard_46.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:377a67eda90eb3f706693947b22915244a1d63599aa73737c3a1d6340387f61e
3
+ size 33030144
params_shard_49.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c3d32b8cd4d9702660c63a7c9eda96a9c2d162bcd4dd37a1995afa656179f698
3
+ size 271581184
params_shard_51.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3251818b48be65151418aa8ddcfcd42267ddf2551917e78d4e10086ce4312902
3
+ size 25690112
params_shard_54.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d0c24f4390b54712e5cef995453650e91765f38ba9d6b7ff77d595b9f94c21f2
3
+ size 33030144
params_shard_59.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fb3ae974c1d2eda5409f686fd16642cea277501950d563e6f34e2b235634af22
3
+ size 25690112
params_shard_64.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1936ed725f60aa9af0f3ca81307866b8bcc3bedfff3940ab8efe752c23847e19
3
+ size 135790592
params_shard_65.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:07682bbaa9ced3811b9b7f9b9675486bb49a9a52be6fb0ea7fd84d0044cedf12
3
+ size 271581184
params_shard_67.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cc15adde2a61abdedbeb22d66898bfb648a109f4d756f762e5ef45942c1fb19c
3
+ size 25690112
params_shard_68.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:98c90e0974e6293e279c7ab141d6614e134005b744fb3c794b41195e8230e6fa
3
+ size 135790592
params_shard_69.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:410390aa046dd3efcb65c83f017c780f5495b4feb74986d2fcd8bdcf890e0f86
3
+ size 271581184
params_shard_70.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:350506e9e4b2b2d53724b6797743b033303be61cb6440a4160947c8a2d1de5ae
3
+ size 33030144
params_shard_73.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f3569ac9b340d5136db6b786cc4a29505d2ce87adc90dfac91064cdd55697ce
3
+ size 271581184
params_shard_75.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f086315ccc74df4037cde0534010f543e1dd9fbbfe4cd48f9f90855331adb969
3
+ size 25690112
params_shard_78.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68b268186c9e7b130be63fef121190dced1d5c5d47c4c9d4bd6c93b330c5f1e4
3
+ size 33030144
params_shard_79.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:15f90c09bb929e39052aef9764531bd512b938d0c5693f3a02c6281a0f0ab28c
3
+ size 25690112
params_shard_8.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6638d604c9322253316b511e97b1a1627bddaf74582a3c34e4204d3afdac86a3
3
+ size 271581184
params_shard_81.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57addecdd5a759df67a4b86f0e0e11fbf05a3b305c6b00f74a756725802ad4e2
3
+ size 135790592
params_shard_82.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:97537f8c6e78d84b16c4d6dd72f78a37796e05e16660744ea7ff91681c0d5649
3
+ size 271581184
params_shard_84.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a71647edf199a48917c6bd46590c39e496b6307ab19cb8e406f3626d49faaa0c
3
+ size 25690112
params_shard_85.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ceef3ec612404aeb680966da1daedab619d51d1cd8a0310f54a67b29deb1d403
3
+ size 135790592
params_shard_86.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2d717e0196ae53d84089be87c4e251355b26180e6d63cf805bb8e400982f8c3a
3
+ size 271581184
params_shard_87.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5d3136d8169a63106325ceef3167bde90b665a111704caae97208d2064eb44ac
3
+ size 33030144
params_shard_90.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ee1186a8b9f59f8e24597db44652f57954659852eeceb6653d039aac48ed9dd
3
+ size 271581184
params_shard_93.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c18b1d3d8e917ed48883c4381eea988ee2ef0fc129912a1927c154598fc3b2b7
3
+ size 135790592
params_shard_94.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:24914212bb740f106a83792df2789699df9ea2150e5dd08addbee7c8ea04102e
3
+ size 271581184
params_shard_96.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7baebd98f9cbd640559edc51f3a368c8fdabddf2dde9520b772e2a370dcbf7bc
3
+ size 25690112