Hugging Face's logo

JackBinary
/
OpenCodeReasoning-Nemotron-1.1-7B-q4f32_1-MLC

MLC-LLM
web-llm
Model card Files
xet
Community
JackBinary commited on
Commit
fe03a76
·
verified ·
1 Parent(s): 5330f7d

Add files using upload-large-folder tool

Browse files
Files changed (50) hide show
  1. README.md +52 -0
  2. ndarray-cache-b16.json +0 -0
  3. ndarray-cache.json +0 -0
  4. params_shard_1.bin +3 -0
  5. params_shard_14.bin +3 -0
  6. params_shard_15.bin +3 -0
  7. params_shard_16.bin +3 -0
  8. params_shard_17.bin +3 -0
  9. params_shard_18.bin +3 -0
  10. params_shard_19.bin +3 -0
  11. params_shard_20.bin +3 -0
  12. params_shard_25.bin +3 -0
  13. params_shard_26.bin +3 -0
  14. params_shard_27.bin +3 -0
  15. params_shard_29.bin +3 -0
  16. params_shard_3.bin +3 -0
  17. params_shard_33.bin +3 -0
  18. params_shard_4.bin +3 -0
  19. params_shard_40.bin +3 -0
  20. params_shard_41.bin +3 -0
  21. params_shard_44.bin +3 -0
  22. params_shard_46.bin +3 -0
  23. params_shard_47.bin +3 -0
  24. params_shard_49.bin +3 -0
  25. params_shard_50.bin +3 -0
  26. params_shard_51.bin +3 -0
  27. params_shard_53.bin +3 -0
  28. params_shard_54.bin +3 -0
  29. params_shard_59.bin +3 -0
  30. params_shard_61.bin +3 -0
  31. params_shard_63.bin +3 -0
  32. params_shard_64.bin +3 -0
  33. params_shard_65.bin +3 -0
  34. params_shard_67.bin +3 -0
  35. params_shard_68.bin +3 -0
  36. params_shard_69.bin +3 -0
  37. params_shard_7.bin +3 -0
  38. params_shard_70.bin +3 -0
  39. params_shard_71.bin +3 -0
  40. params_shard_73.bin +3 -0
  41. params_shard_75.bin +3 -0
  42. params_shard_78.bin +3 -0
  43. params_shard_79.bin +3 -0
  44. params_shard_8.bin +3 -0
  45. params_shard_81.bin +3 -0
  46. params_shard_82.bin +3 -0
  47. params_shard_84.bin +3 -0
  48. params_shard_85.bin +3 -0
  49. params_shard_86.bin +3 -0
  50. params_shard_87.bin +3 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlc-llm
3
+ base_model: nvidia/OpenCodeReasoning-Nemotron-1.1-7B
4
+ tags:
5
+ - mlc-llm
6
+ - web-llm
7
+ ---
8
+
9
+ # OpenCodeReasoning-Nemotron-1.1-7B-q4f32_1-MLC
10
+
11
+ This is the [OpenCodeReasoning-Nemotron-1.1-7B](https://huggingface.co/nvidia/OpenCodeReasoning-Nemotron-1.1-7B) model in MLC format `q4f32_1`.
12
+ The model can be used with [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
13
+
14
+ ## Example Usage
15
+
16
+ Before using the examples, please follow the [installation guide](https://llm.mlc.ai/docs/install/mlc_llm.html#install-mlc-packages).
17
+
18
+ ### Chat CLI
19
+
20
+ ```bash
21
+ mlc_llm chat HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-7B-q4f32_1-MLC
22
+ ````
23
+
24
+ ### REST Server
25
+
26
+ ```bash
27
+ mlc_llm serve HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-7B-q4f32_1-MLC
28
+ ```
29
+
30
+ ### Python API
31
+
32
+ ```python
33
+ from mlc_llm import MLCEngine
34
+
35
+ model = "HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-7B-q4f32_1-MLC"
36
+ engine = MLCEngine(model)
37
+
38
+ for response in engine.chat.completions.create(
39
+ messages=[{"role": "user", "content": "What is the meaning of life?"}],
40
+ model=model,
41
+ stream=True,
42
+ ):
43
+ for choice in response.choices:
44
+ print(choice.delta.content, end="", flush=True)
45
+ print("\n")
46
+
47
+ engine.terminate()
48
+ ```
49
+
50
+ ## Documentation
51
+
52
+ For more on MLC LLM, visit the [documentation](https://llm.mlc.ai/docs/) and [GitHub repo](https://github.com/mlc-ai/mlc-llm).
ndarray-cache-b16.json ADDED
The diff for this file is too large to render. See raw diff
 
ndarray-cache.json ADDED
The diff for this file is too large to render. See raw diff
 
params_shard_1.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f23e0c717c688f6310763de013e30dd22ec36aedc6efe80673d01ce4eeee6953
3
+ size 34062336
params_shard_14.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ee3c2f221c6f0e67364e13511d12e368fc2ab051f1cd99fe2bc0c2d723520ec
3
+ size 67895296
params_shard_15.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e1149e49c40b273c0f107a79d002771b16d1ea1b116fcd1ff3c965cc73154969
3
+ size 29268992
params_shard_16.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57b32b3931fefb5a2333c26af17e7bfa5b6b544e4a4dfbb74cf854459c4d518d
3
+ size 33947648
params_shard_17.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a37e1685f2ccd3c93a422a77833a2280faf939148ce924c5fec20ccb2c4351a7
3
+ size 67895296
params_shard_18.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bdbd4e47b5c92d1b64f0c7eabfecfc661bc098396dc4c1bcd35d943ab9a0f272
3
+ size 29268992
params_shard_19.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a09a3057888bbe45d004882ea5e7ca643bd7c5c241007f8e3da7a52d2909e0a5
3
+ size 33947648
params_shard_20.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7d169bdbe4cb71a7b9bf5cde246a69800d051a0cc0466ce23a40d434e6d6b456
3
+ size 67895296
params_shard_25.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8bb37e69315fa0ef41af493632d044fa45792670bdfac8b83a14e676ca1170de
3
+ size 33947648
params_shard_26.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:997f899d9980c8f8ba1acc51a5dd0897d22be577370ea9b7049a6ce831a86108
3
+ size 67895296
params_shard_27.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2ca3d7e083005a9e16734d93879093005bcd3200e4074d49c654aff81732e48c
3
+ size 29268992
params_shard_29.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:86404cd94831fe18befec17c82c01e8915949eedc0b0d30c3130e36de08b37b1
3
+ size 34062336
params_shard_3.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f7a6024b1c28ee4a0b9ffffd007ff50f383160963d61f530fa27ba17ad913ec
3
+ size 67895296
params_shard_33.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c5bf359890e0c8c492127ad7681fb221315f71012a3b758bd3eb69b4f884906b
3
+ size 33947648
params_shard_4.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88fdf3a87e78e18a8b30e843b399ab06bc69bcc662e0c7aa6bb24207e893d140
3
+ size 33947648
params_shard_40.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e9f6458f9ddf2da34bacaaa04e38619dd276c2f25ddf6eca4e2a993c0f8f4a3c
3
+ size 67895296
params_shard_41.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f180b5add0e9c44fe3dc62fd45f88d2d79e4e67dcdff6be05d0f213887364d14
3
+ size 29268992
params_shard_44.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7f502318165d32420e4f68862934e051b0593bdca1476897ff84bb10be61d9d
3
+ size 29268992
params_shard_46.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a10a39138b7f3e4763036986405834e6e2dda12ede96c70799451bcb3ca24aa
3
+ size 67895296
params_shard_47.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2a11d4304db69732e0e7c7c34d6e7348f497c880f67da8e9d400e3b6e0bf4f15
3
+ size 29268992
params_shard_49.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75dae1e6b89890148912da319fc405a5f41e58165ecf097316fe2fb9063cb2cf
3
+ size 67895296
params_shard_50.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7854d4153c41dd018808453daa4ca68d469cad2abfc79bb92c4d4417216f1eaa
3
+ size 29268992
params_shard_51.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6b53d4fec4dfb1305eff2b1ad75360aad7d13038d23795975382b281d081a63
3
+ size 33947648
params_shard_53.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:47c88a31a8f515ec158e2f40ba2a361aac0d7d16d1479ae043e1a56f8140c985
3
+ size 29268992
params_shard_54.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:006cfba188cb2f7a0b224ae3bd5a58f7a5b4236ba0427478252f557626c906a9
3
+ size 33947648
params_shard_59.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f2546f1c38d44a1c536c30aae3d5d7752ffa86c17806b3a8f1eb229cbf94c93a
3
+ size 29268992
params_shard_61.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c48a6e07e77acc41e1813122307c941022ab7c7dcec395c00796df2ad817dee
3
+ size 67895296
params_shard_63.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7a10938302821b31b0c5e681fbafea7e86ee00ff11c9e9b42d57c1f15d4e6fd
3
+ size 33947648
params_shard_64.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9df52fc773f5b7ebd016569a3b162f0e2e0ed8359f8d8a67c6d342189e479b4f
3
+ size 67895296
params_shard_65.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f22807f11c8f90338cee8a64928949240fd3ba0fc34ff503cad6aee60a1ebe26
3
+ size 30064640
params_shard_67.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:769923d04d3a92a66f46dd2be6c34a4909d4bf65ee1a26f3968658f1ab4a64e6
3
+ size 67895296
params_shard_68.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5af7bf5588083097730529704812245fe06a9e5d94b2d08b9dc2fe216cb0b217
3
+ size 29268992
params_shard_69.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6e1ff6b3f522b1537162c3ba0cf53c09a957b13cbe8b5c7a15859d7966738f65
3
+ size 33947648
params_shard_7.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bca1e114d2285d806e0f9d3a126cae179587230e80c98b3ac9bafac8e17d37ea
3
+ size 33947648
params_shard_70.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:774fbe3ba04d5ccf8c7b5fac955dde12423494457c7f09e5316fbf165b767376
3
+ size 67895296
params_shard_71.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1605775f5aa6ef5d1bad197cf4f94fd5829db67c327642ccb6169c284d35be95
3
+ size 29268992
params_shard_73.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:215e718cdf9c47c3200772c3afd3771da1448c61b3066fd66cb015db648a47ea
3
+ size 67895296
params_shard_75.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:901898006d9ef188453b6e432c98beaecea49f1d1d878106d3703e77576ee0c9
3
+ size 33947648
params_shard_78.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:85f51b2217a1eb6572554dc8accd04e6f5ed363bd18612a4e42297bd89673e9d
3
+ size 33947648
params_shard_79.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f0df54e53a5e09b914b1a7a95c330289c948af4b958c5ed334ceb781d83d7dd8
3
+ size 67895296
params_shard_8.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb1a44458488dfcfe1122ee92e74107ec34f4ad28dbae5faf0604ff5e48d22dc
3
+ size 67895296
params_shard_81.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:874184b9b35d90791b53fd5366e2c683e3daaefcdaaeccc5ac936141cc9135dd
3
+ size 33947648
params_shard_82.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2fa3bb6d451a2b6e71c7fa11d5a9a8faa3bb063c77babaa18ec8ace87d2e61e3
3
+ size 67895296
params_shard_84.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ae7725cd2ca2ebce332070f5896c9512ef402f1c3cc4e2322aab658474695517
3
+ size 33947648
params_shard_85.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:821e4743b85b61b547fc697692a5ee5819baaed5a7c5c834bcf4fe8868372af3
3
+ size 67895296
params_shard_86.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f5f2e61068d9342902c9559b57fab1821acf8679539e0a93a546641ef878df3
3
+ size 29268992
params_shard_87.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b8000c8033b03d3cb7a6c0c87a1f6b0e3f830d0a60921a7f5458166ffe6bdc9
3
+ size 25018368