Hugging Face's logo

JackBinary
/
OpenCodeReasoning-Nemotron-1.1-14B-q0f32-MLC

MLC-LLM
web-llm
Model card Files
xet
Community
JackBinary commited on
Commit
6f23d78
·
verified ·
1 Parent(s): 88feba5

Add files using upload-large-folder tool

Browse files
This view is limited to 50 files because it contains too many changes.   See raw diff
Files changed (50) hide show
  1. README.md +52 -0
  2. params_shard_0.bin +3 -0
  3. params_shard_1.bin +3 -0
  4. params_shard_103.bin +3 -0
  5. params_shard_108.bin +3 -0
  6. params_shard_111.bin +3 -0
  7. params_shard_114.bin +3 -0
  8. params_shard_115.bin +3 -0
  9. params_shard_120.bin +3 -0
  10. params_shard_121.bin +3 -0
  11. params_shard_122.bin +3 -0
  12. params_shard_123.bin +3 -0
  13. params_shard_128.bin +3 -0
  14. params_shard_129.bin +3 -0
  15. params_shard_131.bin +3 -0
  16. params_shard_133.bin +3 -0
  17. params_shard_135.bin +3 -0
  18. params_shard_136.bin +3 -0
  19. params_shard_139.bin +3 -0
  20. params_shard_14.bin +3 -0
  21. params_shard_140.bin +3 -0
  22. params_shard_141.bin +3 -0
  23. params_shard_143.bin +3 -0
  24. params_shard_146.bin +3 -0
  25. params_shard_147.bin +3 -0
  26. params_shard_149.bin +3 -0
  27. params_shard_154.bin +3 -0
  28. params_shard_155.bin +3 -0
  29. params_shard_156.bin +3 -0
  30. params_shard_160.bin +3 -0
  31. params_shard_162.bin +3 -0
  32. params_shard_163.bin +3 -0
  33. params_shard_165.bin +3 -0
  34. params_shard_168.bin +3 -0
  35. params_shard_169.bin +3 -0
  36. params_shard_170.bin +3 -0
  37. params_shard_172.bin +3 -0
  38. params_shard_174.bin +3 -0
  39. params_shard_177.bin +3 -0
  40. params_shard_178.bin +3 -0
  41. params_shard_179.bin +3 -0
  42. params_shard_187.bin +3 -0
  43. params_shard_19.bin +3 -0
  44. params_shard_193.bin +3 -0
  45. params_shard_25.bin +3 -0
  46. params_shard_26.bin +3 -0
  47. params_shard_27.bin +3 -0
  48. params_shard_29.bin +3 -0
  49. params_shard_31.bin +3 -0
  50. params_shard_33.bin +3 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: mlc-llm
3
+ base_model: nvidia/OpenCodeReasoning-Nemotron-1.1-14B
4
+ tags:
5
+ - mlc-llm
6
+ - web-llm
7
+ ---
8
+
9
+ # OpenCodeReasoning-Nemotron-1.1-14B-q0f32-MLC
10
+
11
+ This is the [OpenCodeReasoning-Nemotron-1.1-14B](https://huggingface.co/nvidia/OpenCodeReasoning-Nemotron-1.1-14B) model in MLC format `q0f32`.
12
+ The model can be used with [MLC-LLM](https://github.com/mlc-ai/mlc-llm) and [WebLLM](https://github.com/mlc-ai/web-llm).
13
+
14
+ ## Example Usage
15
+
16
+ Before using the examples, please follow the [installation guide](https://llm.mlc.ai/docs/install/mlc_llm.html#install-mlc-packages).
17
+
18
+ ### Chat CLI
19
+
20
+ ```bash
21
+ mlc_llm chat HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-14B-q0f32-MLC
22
+ ````
23
+
24
+ ### REST Server
25
+
26
+ ```bash
27
+ mlc_llm serve HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-14B-q0f32-MLC
28
+ ```
29
+
30
+ ### Python API
31
+
32
+ ```python
33
+ from mlc_llm import MLCEngine
34
+
35
+ model = "HF://JackBinary/OpenCodeReasoning-Nemotron-1.1-14B-q0f32-MLC"
36
+ engine = MLCEngine(model)
37
+
38
+ for response in engine.chat.completions.create(
39
+ messages=[{"role": "user", "content": "What is the meaning of life?"}],
40
+ model=model,
41
+ stream=True,
42
+ ):
43
+ for choice in response.choices:
44
+ print(choice.delta.content, end="", flush=True)
45
+ print("\n")
46
+
47
+ engine.terminate()
48
+ ```
49
+
50
+ ## Documentation
51
+
52
+ For more on MLC LLM, visit the [documentation](https://llm.mlc.ai/docs/) and [GitHub repo](https://github.com/mlc-ai/mlc-llm).
params_shard_0.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02ce010011c885057494a99bed2d9803a5d31dbd6927d7dc176111a831650fa7
3
+ size 1557135360
params_shard_1.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f444c90c6eb533f3351ec6aaea2b22eec6c5d3a2cba1a2abcbbbe7867f44375d
3
+ size 141557760
params_shard_103.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6e15cb9edd43934a772c3a680e80edba4c36959c8d17f5b10fd88693367cbb3
3
+ size 283115520
params_shard_108.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:951f878f3aa0ad9354de83a7878e4629204d40c7a6e1baf6475c9ec9d8943f47
3
+ size 73400320
params_shard_111.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32a09961b59ca1a9ef2063de61f9f743cc2dd2196b69788ad4537068e438032a
3
+ size 283115520
params_shard_114.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a69892b3f1a4b1d222bf199e001563c9a91ba25e95959e57d81d8dbe564621b
3
+ size 141557760
params_shard_115.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e335a22f97bad89c4b16e4c554a3e2cb3d85d332f9d9973310c030a3a2a9fbca
3
+ size 283115520
params_shard_120.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7fc2adad7ec8655241c71ed50d7981a2ea27b0659221e4c818708383455a8b27
3
+ size 73400320
params_shard_121.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:85e33d5db827d68695766198c965532be4af7b431bf704d91b4912cf53a1d6bc
3
+ size 52428800
params_shard_122.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:139c98086e02a561fcb655809f6f19733e5504f383c22f7c65e21a7119aa5bb8
3
+ size 141557760
params_shard_123.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c27a6a8b101d1e8c6d2e2d0eb5cbe333891314ed406f6f575f494de0374407de
3
+ size 283115520
params_shard_128.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c1822ace5dda0fb77aa2829c2a708fc02bf16745c3cd304f60b094f07829b034
3
+ size 141557760
params_shard_129.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:90ea4c0e32a3faec739550f1f62df8ce41b3759e0ccb87af3849692b18893f8b
3
+ size 283115520
params_shard_131.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:780917b5e0d5b731a6478dd9629151407505f051e0e77c80c4829b8b5b1adda6
3
+ size 52428800
params_shard_133.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:111a2d4f42a8a228dd1204df0702a657c645b5c7fcac8395c58d36e3b6268a86
3
+ size 283115520
params_shard_135.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f96566229a762282f337bfc3bbb07e9474b5141575855263b76d3efed4b254b
3
+ size 52428800
params_shard_136.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7c044caf4c89846f1383356562d833c9bd3be9a7e951b50b3097f3e6152b2c19
3
+ size 141557760
params_shard_139.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6d64efc038169e43ccdb43cbe93694f172b0496229e966c4aab040b21765163
3
+ size 52428800
params_shard_14.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc8138ef736fef8b847862841a83f87d4d00c8b74df5b90930b855f77aeec9e5
3
+ size 52428800
params_shard_140.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ab57761965c0e4c3a84ae4c6f93013ad1c5404ce8650d8a5872301e620c2ff6
3
+ size 141557760
params_shard_141.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:69ba293472b0ede434da99b59b638df2b7e13abf6417183f43b7dcccaa977e49
3
+ size 283115520
params_shard_143.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9803f734a16240a94ac53a9b03342584565af2d48de88a3781b6491138dc9ba3
3
+ size 52428800
params_shard_146.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a03320df5ca33a58e0bada9948c755fccabde79ce2100ce9c2311d66953802e
3
+ size 73400320
params_shard_147.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c621cf5e24de7d35493f891f6eefb0dca1b8b6f7a6d53ccd524b306d99523e45
3
+ size 52428800
params_shard_149.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2715375645eeba8b62fcc02c7c2a6dc0f0f7a723ae6b29c9ddc2b4b5099eb2a7
3
+ size 283115520
params_shard_154.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ed62afb7ab04596964137f8f01a2d5ede87121ce87cd55e2981fa8901f17f4ee
3
+ size 73400320
params_shard_155.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d97f3508a87cd23faec1351f0b346234d83d3dcfee7e3bd873587a487de3a63
3
+ size 52428800
params_shard_156.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a86387e25381187623d865ab46ee9078fd327a406fcd346f5a7753f169e544d8
3
+ size 141557760
params_shard_160.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a08a0f1021d21dfeaad98106fc85238e81268c84302b887c6238309258fc4522
3
+ size 141557760
params_shard_162.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d75d2330e11a927a04bcaf84f34254d48669d6fa7de616562bde6b88b99aa25c
3
+ size 73400320
params_shard_163.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5c593163d42df93bc11ba7cfb677917841b4e5b16a51fc8f2be0759379b7e415
3
+ size 52428800
params_shard_165.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45c4b52b72c93b320a9c4e01212f60b41cc54405c69e4fca70fcb3abc3a2e86f
3
+ size 283115520
params_shard_168.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:57dad2b0cb976fc36e551a4a2570b27660af5b00924d3f2c5b08d7268a3091ac
3
+ size 141557760
params_shard_169.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7ba97a6fe2974fee390ac09e6a0b809617b68b7990d9e9f6f707be72c63b721
3
+ size 283115520
params_shard_170.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:066bb61cbfdff0aa450069dc488663a725d125923b6bf6d6137f838cbaa30fb6
3
+ size 73400320
params_shard_172.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:210a4f3cc1c7743f466003367c156168079392aee2f1219b4777ad2dc122c349
3
+ size 141557760
params_shard_174.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:17ca5e900d80f041e99d8cc3dd2aaee36c1f3d292e688af6ebda9ef436d21ebb
3
+ size 73400320
params_shard_177.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:782185fc412083af614656767b2d4f96eefafda0d049ed79440f717064bdb68f
3
+ size 283115520
params_shard_178.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9b6a431ed72fbee7cd7f8fd7cef92d615f868af7f21c289037e9794e64eab65b
3
+ size 73400320
params_shard_179.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8ebc5c1f28702c51ab72179978253103848bfcdc36991351bf7f1c62da94047b
3
+ size 52428800
params_shard_187.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9a80579011d9e5655546d308c9c11e1a387130cd6ec5f516f0343347de8baa5e
3
+ size 52428800
params_shard_19.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:04474c75a3d013f94928ed8847010465b4a5c40f6e0e7461644f009b338d350b
3
+ size 141557760
params_shard_193.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2e3a94dce246622d266d704cf234b50625c327916cc40086512b7de1e37533ea
3
+ size 52428800
params_shard_25.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cbb92ef9cdeb2e96145e8c4164cb5d37f24b2f524315b4d442afe773e3d15eb5
3
+ size 73400320
params_shard_26.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:99ffbb4d172464cadfbd8019870e2e5490125917b682a16c8ff792c3297c943e
3
+ size 52428800
params_shard_27.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0f70661d400ad515d467e5dbb94c79ac76cbb1074591e22115f141201284728c
3
+ size 141557760
params_shard_29.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7a816d23897ad289f21187d248f8ff986fcbf7bcbc2d771e85b3197196a117b3
3
+ size 73400320
params_shard_31.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:318a72afaa3f5fc6c9d596a73233e742dd29be6fe85b8d6b8c0d6fc10fd50456
3
+ size 141557760
params_shard_33.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18eba06400301aec4bb22a8beb36f7a407f99517ef73f4e268410b734abecf8a
3
+ size 73400320