Model save
Browse files- README.md +60 -0
- generation_config.json +4 -0
- model-00001-of-00003.safetensors +1 -1
- model-00002-of-00003.safetensors +1 -1
- model-00003-of-00003.safetensors +1 -1
    	
        README.md
    ADDED
    
    | @@ -0,0 +1,60 @@ | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | 
|  | |
| 1 | 
            +
            ---
         | 
| 2 | 
            +
            library_name: transformers
         | 
| 3 | 
            +
            license: apple-ascl
         | 
| 4 | 
            +
            base_model: apple/DCLM-7B
         | 
| 5 | 
            +
            tags:
         | 
| 6 | 
            +
            - llama-factory
         | 
| 7 | 
            +
            - generated_from_trainer
         | 
| 8 | 
            +
            model-index:
         | 
| 9 | 
            +
            - name: dclm_baseline_openthoughts1
         | 
| 10 | 
            +
              results: []
         | 
| 11 | 
            +
            ---
         | 
| 12 | 
            +
             | 
| 13 | 
            +
            <!-- This model card has been generated automatically according to the information the Trainer had access to. You
         | 
| 14 | 
            +
            should probably proofread and complete it, then remove this comment. -->
         | 
| 15 | 
            +
             | 
| 16 | 
            +
            # dclm_baseline_openthoughts1
         | 
| 17 | 
            +
             | 
| 18 | 
            +
            This model is a fine-tuned version of [apple/DCLM-7B](https://huggingface.co/apple/DCLM-7B) on an unknown dataset.
         | 
| 19 | 
            +
             | 
| 20 | 
            +
            ## Model description
         | 
| 21 | 
            +
             | 
| 22 | 
            +
            More information needed
         | 
| 23 | 
            +
             | 
| 24 | 
            +
            ## Intended uses & limitations
         | 
| 25 | 
            +
             | 
| 26 | 
            +
            More information needed
         | 
| 27 | 
            +
             | 
| 28 | 
            +
            ## Training and evaluation data
         | 
| 29 | 
            +
             | 
| 30 | 
            +
            More information needed
         | 
| 31 | 
            +
             | 
| 32 | 
            +
            ## Training procedure
         | 
| 33 | 
            +
             | 
| 34 | 
            +
            ### Training hyperparameters
         | 
| 35 | 
            +
             | 
| 36 | 
            +
            The following hyperparameters were used during training:
         | 
| 37 | 
            +
            - learning_rate: 1e-05
         | 
| 38 | 
            +
            - train_batch_size: 2
         | 
| 39 | 
            +
            - eval_batch_size: 2
         | 
| 40 | 
            +
            - seed: 42
         | 
| 41 | 
            +
            - distributed_type: multi-GPU
         | 
| 42 | 
            +
            - num_devices: 4
         | 
| 43 | 
            +
            - gradient_accumulation_steps: 2
         | 
| 44 | 
            +
            - total_train_batch_size: 16
         | 
| 45 | 
            +
            - total_eval_batch_size: 8
         | 
| 46 | 
            +
            - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
         | 
| 47 | 
            +
            - lr_scheduler_type: cosine
         | 
| 48 | 
            +
            - lr_scheduler_warmup_ratio: 0.1
         | 
| 49 | 
            +
            - num_epochs: 5.0
         | 
| 50 | 
            +
             | 
| 51 | 
            +
            ### Training results
         | 
| 52 | 
            +
             | 
| 53 | 
            +
             | 
| 54 | 
            +
             | 
| 55 | 
            +
            ### Framework versions
         | 
| 56 | 
            +
             | 
| 57 | 
            +
            - Transformers 4.46.1
         | 
| 58 | 
            +
            - Pytorch 2.6.0+cu124
         | 
| 59 | 
            +
            - Datasets 3.1.0
         | 
| 60 | 
            +
            - Tokenizers 0.20.3
         | 
    	
        generation_config.json
    ADDED
    
    | @@ -0,0 +1,4 @@ | |
|  | |
|  | |
|  | |
|  | 
|  | |
| 1 | 
            +
            {
         | 
| 2 | 
            +
              "_from_model_config": true,
         | 
| 3 | 
            +
              "transformers_version": "4.46.1"
         | 
| 4 | 
            +
            }
         | 
    	
        model-00001-of-00003.safetensors
    CHANGED
    
    | @@ -1,3 +1,3 @@ | |
| 1 | 
             
            version https://git-lfs.github.com/spec/v1
         | 
| 2 | 
            -
            oid sha256: | 
| 3 | 
             
            size 5000000704
         | 
|  | |
| 1 | 
             
            version https://git-lfs.github.com/spec/v1
         | 
| 2 | 
            +
            oid sha256:bf21b02829ca5350289b326aebb88923d1b23e9b27921c49d8dc35e6765b5bca
         | 
| 3 | 
             
            size 5000000704
         | 
    	
        model-00002-of-00003.safetensors
    CHANGED
    
    | @@ -1,3 +1,3 @@ | |
| 1 | 
             
            version https://git-lfs.github.com/spec/v1
         | 
| 2 | 
            -
            oid sha256: | 
| 3 | 
             
            size 4857411192
         | 
|  | |
| 1 | 
             
            version https://git-lfs.github.com/spec/v1
         | 
| 2 | 
            +
            oid sha256:a8bd256a5f4eba1da372bcccf8166fadb771ff4fcfab44c41f402ece38897152
         | 
| 3 | 
             
            size 4857411192
         | 
    	
        model-00003-of-00003.safetensors
    CHANGED
    
    | @@ -1,3 +1,3 @@ | |
| 1 | 
             
            version https://git-lfs.github.com/spec/v1
         | 
| 2 | 
            -
            oid sha256: | 
| 3 | 
             
            size 3921970888
         | 
|  | |
| 1 | 
             
            version https://git-lfs.github.com/spec/v1
         | 
| 2 | 
            +
            oid sha256:092551ea2305d079649b560884d4712accfa221d686a4b4ea11033d552cc71a6
         | 
| 3 | 
             
            size 3921970888
         |