Upload folder using huggingface_hub

README.md

@@ -26,14 +26,7 @@ This is a compressed model using [deltazip](https://github.com/eth-easl/deltazip
 #### Prompt: 
 
 ```
-<|begin_of_text|><|start_header_id|>system<|end_header_id|>
-
-Cutting Knowledge Date: December 2023
-Today Date: 26 Jul 2024
-
-<|eot_id|><|start_header_id|>user<|end_header_id|>
-
-Who is Alan Turing?<|eot_id|>
+[{'role': 'user', 'content': 'Who is Alan Turing?'}]
 ```
 
 #### Output: 
@@ -46,18 +39,13 @@ Today Date: 26 Jul 2024
 
 <|eot_id|><|start_header_id|>user<|end_header_id|>
 
-<|begin_of_text|><|start_header_id|>system<|end_header_id|>
-
-Cutting Knowledge Date: December 2023
-Today Date: 26 Jul 2024
-
-<|eot_id|><|start_header_id|>user<|end_header_id|>
+Who is Alan Turing?<|eot_id|><|start_header_id|>assistant<|end_header_id|>
 
-Who is Alan Turing?<|eot_id|><|eot_id|>assistant<|end_header_id|>
+Alan Turing (1912-1954) was a British mathematician, computer scientist, logician, and philosopher who made significant contributions to various fields, including computer science, artificial intelligence, cryptography, and mathematics. He is widely considered one of the most influential figures in the history of computer science.
 
-Alan Turing (1912-1954) was a British mathematician, computer scientist, logician, and philosopher who made significant contributions to the development of computer science, artificial intelligence, and cryptography. He is widely considered one of the most influential figures in the history of computer science.
+**Early Life and Education**
 
-T
+Turing was born in London, England, to a family of civil servants. He was a brilliant student and
 ```
 
 ## Evaluation

compress_config.json

@@ -4,7 +4,7 @@
   "sparsity": 0.5,
   "damp_percent": 0.01,
   "desc_act": false,
-  "sym": false,
+  "sym": true,
   "true_sequential": true,
   "lossless": "none",
   "prunen": 2,

delta_config.json

@@ -1 +1 @@
-{"base_model": "meta-llama/Llama-3.1-8B", "compress_config": {"bits": 4, "group_size": -1, "sparsity": 0.5, "damp_percent": 0.01, "desc_act": false, "sym": false, "true_sequential": true, "lossless": "none", "prunen": 2, "prunem": 4, "block_size": 128}, "target_modules": ["self_attn.k_proj", "self_attn.v_proj", "self_attn.q_proj", "self_attn.o_proj", "mlp.up_proj", "mlp.gate_proj", "mlp.down_proj"]}
+{"base_model": "meta-llama/Llama-3.1-8B", "compress_config": {"bits": 4, "group_size": -1, "sparsity": 0.5, "damp_percent": 0.01, "desc_act": false, "sym": true, "true_sequential": true, "lossless": "none", "prunen": 2, "prunem": 4, "block_size": 128}, "target_modules": ["self_attn.k_proj", "self_attn.v_proj", "self_attn.q_proj", "self_attn.o_proj", "mlp.up_proj", "mlp.gate_proj", "mlp.down_proj"]}

deltazip-compressed.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c0cd0a1c20d9549e199602331fa4d7454cab5dda9ff34c004dc75b89bf765b2d
-size 5600068824
+oid sha256:e0dd944dcb048222bfa2f5725cd4b4e1d83b6031ba6f2b8e56b41c24378ab2f8
+size 4721389400

tokenizer.json

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:384a7e7c676f7be2e5d2e8449c508be9b00e5b18c5b3c39ebc626e96b3f4b988
-size 17210019
+oid sha256:6b9e4e7fb171f92fd137b777cc2714bf87d11576700a1dcd7a399e7bbe39537b
+size 17209920