| ⠀⠀⠀⠀⠀⠀⣀⡀⠀⠀⣀⣤⣶⣾⣿⣿⣷⣶⣤⣀⠀⠀⣀⣀⠀⠀⠀⠀⠀⠀ | |
| ⠀⠀⠀⠀⠀⠜⠉⣿⡆⣼⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣧⢰⣿⠉⠃⠀⠀⠀⠀⠀ | |
| ⠀⢀⣤⣴⣦⣄⣴⠟⣸⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⡎⢻⣦⣠⣴⣦⣄⠀⠀ | |
| ⠀⡞⠁⣠⣾⢿⣧⠀⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⠀⣽⡿⣷⣄⠈⢷⠀ | |
| ⠀⣠⣾⠟⠁⢸⣿⠀⠘⢿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⡿⠁⠀⣿⡇⠈⠻⣷⣄⠀ | |
| ⣰⡿⠁⠀⢀⣾⣏⣾⣄⣰⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣇⣰⣷⣹⣷⠀⠀⠈⢿⣆ | |
| ⣿⡇⠀⢠⣾⠏⢸⣿⣿⣿⣿⠋⢻⣿⣿⣿⣿⡟⠙⣿⣿⣿⣿⡇⠹⣷⡀⠀⢸⣿ | |
| ⠹⣿⣴⡿⠋⠀⠈⠛⠉⣹⣿⣦⣄⡹⣿⣿⣋⣠⣶⣿⣏⠉⠛⠁⠀⠙⢿⣦⣿⠏ | |
| ⠀⣸⣿⠿⠿⣿⣾⣿⡿⠿⣿⣿⣿⣿⡆⢰⣿⣿⣿⣿⠿⢿⣿⣶⣿⠿⠿⣻⣇⠀ | |
| ⠀⣿⡇⢀⣴⣶⣤⣀⣴⣿⠿⣻⡿⣿⣧⣾⣿⢿⣟⠿⣿⣦⣀⣤⣶⣦⠀⢸⣿⠀ | |
| ⠀⢿⣧⠈⠃⢀⣵⣿⡋⠁⢀⣿⡷⣿⡇⢻⣿⣿⣿⡀⠈⢛⣿⣮⡀⠘⠀⣼⡟⠀ | |
| ⠀⠈⠻⣷⣤⣟⣋⣿⣧⣴⡿⠋⠀⣿⡇⢸⣿⠀⠙⢿⣦⣼⣿⣙⣻⣤⣾⠟⠁⠀ | |
| ⠀⠀⠀⠈⢽⣿⠛⢻⣏⢉⣤⣶⣶⣿⠁⠈⣿⣶⣶⣤⡉⣽⡟⠛⣿⡏⠁⠀⠀⠀ | |
| ⠀⠀⠀⠀⠈⠿⣷⣾⣾⣟⣉⣠⣿⢿⡇⢸⠿⣿⣄⣙⣻⣷⣷⣾⠿⠁⠀⠀⠀⠀ | |
| ⠀⠀⠀⠀⠀⠀⠀⠀⠙⠻⠿⠛⢁⡼⠃⠘⢦⡈⠛⠿⠟⠃⠀⠀⠀⠀⠀⠀⠀⠀ | |
| 18:21:07 - THE MERGE MONSTER HUNGERS | |
| ------------------------------------ | |
| Device : cpu | |
| Random seed : 42 | |
| Starting model : ../mistralai_Mistral-7B-v0.1 | |
| Models to merge : ['../merge_stepAA', '../merge_stepBB', '../merge_stepCC'] | |
| Output directory : ./toppy_new_remake | |
| Phrases loaded : 31 | |
| Auto weights : False | |
| Merge ratios : [0.2, 0.4, 0.6, 0.8] | |
| Merge method(s) : ['slerp'] | |
| Merge headers : True | |
| Strategy used : cumulative | |
| ------------------------------------ | |
| 18:21:07 - Loading model (../mistralai_Mistral-7B-v0.1)... | |
| Loading checkpoint shards: 100%|██████████████████| 2/2 [00:07<00:00, 3.74s/it] | |
| 18:21:24 - Model loaded. Dtype: torch.float16 | |
| ------------------------------------ | |
| ----------------------------------------------------------------------------------------------------- | |
| | Type | Phrase | Context | Raw Prob* | Used Prob** | Change | | |
| ----------------------------------------------------------------------------------------------------- | |
| | BAD | anticipation | Her body quivers with | 8.65211% | 103.83% | N/A | | |
| | BAD | anticipation | The atmosphere is thic.. | 11.36381% | 136.37% | N/A | | |
| | BAD | unwavering | Filled with an | 0.26573% | 3.19% | N/A | | |
| | BAD | determination | Her eyes were filled w.. | 0.24377% | 2.93% | N/A | | |
| | BAD | determination | Her stubbornness only .. | 6.80586% | 81.67% | N/A | | |
| | BAD | whisper | Her voice barely above.. | 96.20242% | 1154.43% | N/A | | |
| | BAD | spine | shivers down her | 89.79740% | 1077.57% | N/A | | |
| | BAD | sends shivers | The thrill of the act | 0.00182% | 0.02% | N/A | | |
| | BAD | ministrations | She moans and twitches.. | 0.39789% | 4.77% | N/A | | |
| | BAD | legs | wraps her | 2.80972% | 33.72% | N/A | | |
| | BAD | imposing figure | He had an | 0.00669% | 0.08% | N/A | | |
| | BAD | shared challenges | Their bond strengthene.. | 0.04152% | 0.50% | N/A | | |
| | BAD | bond | forged a | 0.56229% | 6.75% | N/A | | |
| | BAD | bond | an unspoken | 1.05445% | 12.65% | N/A | | |
| | BAD | enhance our expe.. | I'm excited to see how | 0.00000% | 0.00% | N/A | | |
| | BAD | sense of vulnera.. | create a | 0.00002% | 0.00% | N/A | | |
| | BAD | dimensions of in.. | explore new | 0.00038% | 0.00% | N/A | | |
| | BAD | deepening our co.. | while | 0.00000% | 0.00% | N/A | | |
| | BAD | shared experiences | through | 0.00059% | 0.01% | N/A | | |
| | BAD | societal expecta.. | that transcend | 0.00161% | 0.02% | N/A | | |
| | BAD | conventional bou.. | that defy | 0.03809% | 0.46% | N/A | | |
| | BAD | conventional bou.. | and defy | 0.01043% | 0.13% | N/A | | |
| | BAD | open communication | an environment | 0.00000% | 0.00% | N/A | | |
| | BAD | emotional vulner.. | an environment | 0.00000% | 0.00% | N/A | | |
| | BAD | heightens our co.. | touch and the anticipa.. | 0.00000% | 0.00% | N/A | | |
| | BAD | sensations you'r.. | I'm enjoying | 0.00000% | 0.00% | N/A | | |
| | BAD | is truly arousing | attention to detail | 0.00000% | 0.00% | N/A | | |
| | BAD | is truly arousing | way you explore my body | 0.00000% | 0.00% | N/A | | |
| | BAD | challenge presen.. | my resolve unwavering .. | 0.00002% | 0.00% | N/A | | |
| | BAD | humble vessel | surrendering to the ex.. | 0.00000% | 0.00% | N/A | | |
| | BAD | bond | cherishing the unique | 2.06671% | 24.80% | N/A | | |
| | BAD | bond | special | 0.01728% | 0.21% | N/A | | |
| | BAD | grows stronger w.. | bond | 0.00000% | 0.00% | N/A | | |
| | BAD | that cannot be b.. | bond | 0.00000% | 0.00% | N/A | | |
| | BAD | becomes unbreaka.. | bond | 0.00000% | 0.00% | N/A | | |
| | BAD | grew stronger wi.. | bond | 0.00000% | 0.00% | N/A | | |
| | GOOD | The apple is in .. | Question: If I'm in th.. | 3.26070% | 3.26% | N/A | | |
| ------------------------------------------------------------------------------------------------------ | |
| | Totals | 223.60% | 2647.35% | 0.00% | | |
| ------------------------------------------------------------------------------------------------------ | |
| * = Unweighted, raw probability - ** = Probability after weight adjustments | |
| ------------------------------------ | |
| 18:21:34 - Loading model (../merge_stepAA)... | |
| Loading checkpoint shards: 100%|██████████████████| 3/3 [00:07<00:00, 2.46s/it] | |
| 18:21:49 - Model loaded. Dtype: torch.float16 | |
| ------------------------------------ | |
| Optimizing Layer 1/32 (slerp): 100%|██████████████| 4/4 [00:46<00:00, 11.71s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.2, 'merge_stepAA']] | |
| 18:22:55 - Layer 1/32 - CHANGED - 26.40827 > 26.39262 - 0.1% | |
| ---- | |
| Optimizing Layer 2/32 (slerp): 100%|██████████████| 4/4 [00:48<00:00, 12.02s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA']] | |
| 18:24:00 - Layer 2/32 - CHANGED - 26.39262 > 26.32282 - 0.3% | |
| ---- | |
| Optimizing Layer 3/32 (slerp): 100%|██████████████| 4/4 [00:53<00:00, 13.44s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:25:07 - Layer 3/32 - RETAINED - 26.32282 | |
| ---- | |
| Optimizing Layer 4/32 (slerp): 100%|██████████████| 4/4 [00:51<00:00, 12.95s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:26:14 - Layer 4/32 - RETAINED - 26.32282 | |
| ---- | |
| Optimizing Layer 5/32 (slerp): 100%|██████████████| 4/4 [00:51<00:00, 12.97s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:27:20 - Layer 5/32 - RETAINED - 26.32282 | |
| ---- | |
| Optimizing Layer 6/32 (slerp): 100%|██████████████| 4/4 [00:45<00:00, 11.31s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA']] | |
| 18:28:21 - Layer 6/32 - CHANGED - 26.32282 > 26.24790 - 0.3% | |
| ---- | |
| Optimizing Layer 7/32 (slerp): 100%|██████████████| 4/4 [00:44<00:00, 11.18s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:29:19 - Layer 7/32 - RETAINED - 26.24790 | |
| ---- | |
| Optimizing Layer 8/32 (slerp): 100%|██████████████| 4/4 [00:41<00:00, 10.32s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:30:13 - Layer 8/32 - RETAINED - 26.24790 | |
| ---- | |
| Optimizing Layer 9/32 (slerp): 100%|██████████████| 4/4 [00:40<00:00, 10.25s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA']] | |
| 18:31:06 - Layer 9/32 - CHANGED - 26.24790 > 26.19836 - 0.2% | |
| ---- | |
| Optimizing Layer 10/32 (slerp): 100%|█████████████| 4/4 [00:40<00:00, 10.02s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA']] | |
| 18:31:58 - Layer 10/32 - CHANGED - 26.19836 > 26.09306 - 0.4% | |
| ---- | |
| Optimizing Layer 11/32 (slerp): 100%|█████████████| 4/4 [00:38<00:00, 9.69s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA']] | |
| 18:32:47 - Layer 11/32 - CHANGED - 26.09306 > 26.01535 - 0.3% | |
| ---- | |
| Optimizing Layer 12/32 (slerp): 100%|█████████████| 4/4 [00:39<00:00, 9.79s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA']] | |
| 18:33:37 - Layer 12/32 - CHANGED - 26.01535 > 25.91855 - 0.4% | |
| ---- | |
| Optimizing Layer 13/32 (slerp): 100%|█████████████| 4/4 [00:40<00:00, 10.08s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.4, 'merge_stepAA']] | |
| 18:34:28 - Layer 13/32 - CHANGED - 25.91855 > 25.91126 - 0.0% | |
| ---- | |
| Optimizing Layer 14/32 (slerp): 100%|█████████████| 4/4 [00:38<00:00, 9.74s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepAA']] | |
| 18:35:18 - Layer 14/32 - CHANGED - 25.91126 > 25.87849 - 0.1% | |
| ---- | |
| Optimizing Layer 15/32 (slerp): 100%|█████████████| 4/4 [00:37<00:00, 9.50s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA']] | |
| 18:36:07 - Layer 15/32 - CHANGED - 25.87849 > 25.86635 - 0.0% | |
| ---- | |
| Optimizing Layer 16/32 (slerp): 100%|█████████████| 4/4 [00:38<00:00, 9.69s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:36:57 - Layer 16/32 - RETAINED - 25.86635 | |
| ---- | |
| Optimizing Layer 17/32 (slerp): 100%|█████████████| 4/4 [00:38<00:00, 9.63s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepAA']] | |
| 18:37:45 - Layer 17/32 - CHANGED - 25.86635 > 25.86440 - 0.0% | |
| ---- | |
| Optimizing Layer 18/32 (slerp): 100%|█████████████| 4/4 [00:40<00:00, 10.00s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:38:37 - Layer 18/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 19/32 (slerp): 100%|█████████████| 4/4 [00:38<00:00, 9.69s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:39:27 - Layer 19/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 20/32 (slerp): 100%|█████████████| 4/4 [00:38<00:00, 9.58s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:40:16 - Layer 20/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 21/32 (slerp): 100%|█████████████| 4/4 [00:38<00:00, 9.68s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:41:05 - Layer 21/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 22/32 (slerp): 100%|█████████████| 4/4 [00:40<00:00, 10.08s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:41:57 - Layer 22/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 23/32 (slerp): 100%|█████████████| 4/4 [00:38<00:00, 9.59s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:42:46 - Layer 23/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 24/32 (slerp): 100%|█████████████| 4/4 [00:40<00:00, 10.06s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:43:38 - Layer 24/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 25/32 (slerp): 100%|█████████████| 4/4 [00:39<00:00, 9.96s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:44:29 - Layer 25/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 26/32 (slerp): 100%|█████████████| 4/4 [00:38<00:00, 9.58s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:45:19 - Layer 26/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 27/32 (slerp): 100%|█████████████| 4/4 [00:39<00:00, 9.78s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:46:08 - Layer 27/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 28/32 (slerp): 100%|█████████████| 4/4 [00:39<00:00, 9.99s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:46:59 - Layer 28/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 29/32 (slerp): 100%|█████████████| 4/4 [00:39<00:00, 9.81s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:47:50 - Layer 29/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 30/32 (slerp): 100%|█████████████| 4/4 [00:39<00:00, 9.99s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:48:41 - Layer 30/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 31/32 (slerp): 100%|█████████████| 4/4 [00:39<00:00, 9.88s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:49:32 - Layer 31/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Layer 32/32 (slerp): 100%|█████████████| 4/4 [00:38<00:00, 9.64s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:50:22 - Layer 32/32 - RETAINED - 25.86440 | |
| ---- | |
| Optimizing Header: 100%|██████████████████████████| 4/4 [00:34<00:00, 8.58s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 18:51:06 - Header - RETAINED - 25.86440 | |
| ----------------------------------------------------------------------------------------------------- | |
| | Type | Phrase | Context | Raw Prob* | Used Prob** | Change | | |
| ----------------------------------------------------------------------------------------------------- | |
| | BAD | anticipation | Her body quivers with | 4.68658% | 56.24% | -47.59% | | |
| | BAD | anticipation | The atmosphere is thic.. | 6.54790% | 78.57% | -57.79% | | |
| | BAD | unwavering | Filled with an | 0.19636% | 2.36% | -0.83% | | |
| | BAD | determination | Her eyes were filled w.. | 0.13339% | 1.60% | -1.32% | | |
| | BAD | determination | Her stubbornness only .. | 5.84215% | 70.11% | -11.56% | | |
| | BAD | whisper | Her voice barely above.. | 94.63391% | 1135.61% | -18.82% | | |
| | BAD | spine | shivers down her | 88.40607% | 1060.87% | -16.70% | | |
| | BAD | sends shivers | The thrill of the act | 0.00518% | 0.06% | +0.04% | | |
| | BAD | ministrations | She moans and twitches.. | 3.33707% | 40.04% | +35.27% | | |
| | BAD | legs | wraps her | 6.97311% | 83.68% | +49.96% | | |
| | BAD | imposing figure | He had an | 0.02539% | 0.30% | +0.22% | | |
| | BAD | shared challenges | Their bond strengthene.. | 0.01479% | 0.18% | -0.32% | | |
| | BAD | bond | forged a | 0.52765% | 6.33% | -0.42% | | |
| | BAD | bond | an unspoken | 1.95329% | 23.44% | +10.79% | | |
| | BAD | enhance our expe.. | I'm excited to see how | 0.00000% | 0.00% | -0.00% | | |
| | BAD | sense of vulnera.. | create a | 0.00005% | 0.00% | +0.00% | | |
| | BAD | dimensions of in.. | explore new | 0.00306% | 0.04% | +0.03% | | |
| | BAD | deepening our co.. | while | 0.00000% | 0.00% | -0.00% | | |
| | BAD | shared experiences | through | 0.00026% | 0.00% | -0.00% | | |
| | BAD | societal expecta.. | that transcend | 0.00175% | 0.02% | +0.00% | | |
| | BAD | conventional bou.. | that defy | 0.01955% | 0.23% | -0.22% | | |
| | BAD | conventional bou.. | and defy | 0.00254% | 0.03% | -0.09% | | |
| | BAD | open communication | an environment | 0.00000% | 0.00% | +0.00% | | |
| | BAD | emotional vulner.. | an environment | 0.00000% | 0.00% | +0.00% | | |
| | BAD | heightens our co.. | touch and the anticipa.. | 0.00000% | 0.00% | +0.00% | | |
| | BAD | sensations you'r.. | I'm enjoying | 0.00000% | 0.00% | +0.00% | | |
| | BAD | is truly arousing | attention to detail | 0.00000% | 0.00% | +0.00% | | |
| | BAD | is truly arousing | way you explore my body | 0.00001% | 0.00% | +0.00% | | |
| | BAD | challenge presen.. | my resolve unwavering .. | 0.00001% | 0.00% | -0.00% | | |
| | BAD | humble vessel | surrendering to the ex.. | 0.00000% | 0.00% | -0.00% | | |
| | BAD | bond | cherishing the unique | 3.14311% | 37.72% | +12.92% | | |
| | BAD | bond | special | 0.03303% | 0.40% | +0.19% | | |
| | BAD | grows stronger w.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | BAD | that cannot be b.. | bond | 0.00000% | 0.00% | -0.00% | | |
| | BAD | becomes unbreaka.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | BAD | grew stronger wi.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | GOOD | The apple is in .. | Question: If I'm in th.. | 11.39444% | 11.39% | +8.13% | | |
| ------------------------------------------------------------------------------------------------------ | |
| | Totals | 227.88% | 2609.23% | -38.12% | | |
| ------------------------------------------------------------------------------------------------------ | |
| * = Unweighted, raw probability - ** = Probability after weight adjustments | |
| -------- MERGE COMPOSITION --------- | |
| mistralai_Mistral-7B-v0.1: 0.78 | |
| merge_stepAA: 0.22 | |
| ------------------------------------ | |
| 18:51:15 - Loading model (../merge_stepBB)... | |
| Loading checkpoint shards: 100%|██████████████████| 3/3 [00:06<00:00, 2.07s/it] | |
| 18:51:27 - Model loaded. Dtype: torch.float16 | |
| ------------------------------------ | |
| Optimizing Layer 1/32 (slerp): 100%|██████████████| 4/4 [00:37<00:00, 9.31s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.2, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 18:52:18 - Layer 1/32 - CHANGED - 25.86440 > 24.33593 - 5.9% | |
| ---- | |
| Optimizing Layer 2/32 (slerp): 100%|██████████████| 4/4 [00:39<00:00, 9.96s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 18:53:10 - Layer 2/32 - CHANGED - 24.33593 > 23.85608 - 2.0% | |
| ---- | |
| Optimizing Layer 3/32 (slerp): 100%|██████████████| 4/4 [00:37<00:00, 9.47s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 18:54:00 - Layer 3/32 - CHANGED - 23.85608 > 23.50431 - 1.5% | |
| ---- | |
| Optimizing Layer 4/32 (slerp): 100%|██████████████| 4/4 [00:38<00:00, 9.64s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 18:54:50 - Layer 4/32 - CHANGED - 23.50431 > 23.27042 - 1.0% | |
| ---- | |
| Optimizing Layer 5/32 (slerp): 100%|██████████████| 4/4 [00:38<00:00, 9.58s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 18:55:40 - Layer 5/32 - CHANGED - 23.27042 > 22.72376 - 2.3% | |
| ---- | |
| Optimizing Layer 6/32 (slerp): 100%|██████████████| 4/4 [00:37<00:00, 9.37s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 18:56:29 - Layer 6/32 - CHANGED - 22.72376 > 22.61975 - 0.5% | |
| ---- | |
| Optimizing Layer 7/32 (slerp): 100%|██████████████| 4/4 [00:39<00:00, 9.96s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 18:57:20 - Layer 7/32 - CHANGED - 22.61975 > 22.13508 - 2.1% | |
| ---- | |
| Optimizing Layer 8/32 (slerp): 100%|██████████████| 4/4 [00:40<00:00, 10.02s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepBB']] | |
| 18:58:13 - Layer 8/32 - CHANGED - 22.13508 > 21.57464 - 2.5% | |
| ---- | |
| Optimizing Layer 9/32 (slerp): 100%|██████████████| 4/4 [00:39<00:00, 9.80s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 18:59:04 - Layer 9/32 - CHANGED - 21.57464 > 21.32946 - 1.1% | |
| ---- | |
| Optimizing Layer 10/32 (slerp): 100%|█████████████| 4/4 [00:40<00:00, 10.13s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 18:59:58 - Layer 10/32 - CHANGED - 21.32946 > 20.82514 - 2.4% | |
| ---- | |
| Optimizing Layer 11/32 (slerp): 100%|█████████████| 4/4 [00:40<00:00, 10.15s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.4, 'merge_stepBB']] | |
| 19:00:51 - Layer 11/32 - CHANGED - 20.82514 > 20.71148 - 0.5% | |
| ---- | |
| Optimizing Layer 12/32 (slerp): 100%|█████████████| 4/4 [00:39<00:00, 9.97s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 19:01:44 - Layer 12/32 - CHANGED - 20.71148 > 20.23820 - 2.3% | |
| ---- | |
| Optimizing Layer 13/32 (slerp): 100%|█████████████| 4/4 [00:40<00:00, 10.10s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.4, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 19:02:36 - Layer 13/32 - CHANGED - 20.23820 > 19.70820 - 2.6% | |
| ---- | |
| Optimizing Layer 14/32 (slerp): 100%|█████████████| 4/4 [00:41<00:00, 10.40s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 19:03:31 - Layer 14/32 - CHANGED - 19.70820 > 19.27819 - 2.2% | |
| ---- | |
| Optimizing Layer 15/32 (slerp): 100%|█████████████| 4/4 [00:41<00:00, 10.46s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA']] | |
| 19:04:26 - Layer 15/32 - RETAINED - 19.27819 | |
| ---- | |
| Optimizing Layer 16/32 (slerp): 100%|█████████████| 4/4 [00:41<00:00, 10.47s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 19:05:20 - Layer 16/32 - CHANGED - 19.27819 > 19.14155 - 0.7% | |
| ---- | |
| Optimizing Layer 17/32 (slerp): 100%|█████████████| 4/4 [00:41<00:00, 10.34s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 19:06:14 - Layer 17/32 - CHANGED - 19.14155 > 18.89480 - 1.3% | |
| ---- | |
| Optimizing Layer 18/32 (slerp): 100%|█████████████| 4/4 [00:42<00:00, 10.62s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 19:07:11 - Layer 18/32 - RETAINED - 18.89480 | |
| ---- | |
| Optimizing Layer 19/32 (slerp): 100%|█████████████| 4/4 [00:42<00:00, 10.67s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 19:08:07 - Layer 19/32 - RETAINED - 18.89480 | |
| ---- | |
| Optimizing Layer 20/32 (slerp): 100%|█████████████| 4/4 [00:42<00:00, 10.54s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 19:09:02 - Layer 20/32 - RETAINED - 18.89480 | |
| ---- | |
| Optimizing Layer 21/32 (slerp): 100%|█████████████| 4/4 [00:41<00:00, 10.32s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 19:09:57 - Layer 21/32 - CHANGED - 18.89480 > 18.43143 - 2.5% | |
| ---- | |
| Optimizing Layer 22/32 (slerp): 100%|█████████████| 4/4 [00:41<00:00, 10.30s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 19:10:52 - Layer 22/32 - CHANGED - 18.43143 > 17.75345 - 3.7% | |
| ---- | |
| Optimizing Layer 23/32 (slerp): 100%|█████████████| 4/4 [00:43<00:00, 10.84s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 19:11:50 - Layer 23/32 - RETAINED - 17.75345 | |
| ---- | |
| Optimizing Layer 24/32 (slerp): 100%|█████████████| 4/4 [00:45<00:00, 11.37s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 19:12:49 - Layer 24/32 - CHANGED - 17.75345 > 17.46555 - 1.6% | |
| ---- | |
| Optimizing Layer 25/32 (slerp): 100%|█████████████| 4/4 [00:44<00:00, 11.04s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 19:13:47 - Layer 25/32 - CHANGED - 17.46555 > 16.88957 - 3.3% | |
| ---- | |
| Optimizing Layer 26/32 (slerp): 100%|█████████████| 4/4 [00:43<00:00, 10.86s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 19:14:44 - Layer 26/32 - RETAINED - 16.88957 | |
| ---- | |
| Optimizing Layer 27/32 (slerp): 100%|█████████████| 4/4 [00:44<00:00, 11.14s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 19:15:42 - Layer 27/32 - RETAINED - 16.88957 | |
| ---- | |
| Optimizing Layer 28/32 (slerp): 100%|█████████████| 4/4 [00:43<00:00, 10.89s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 19:16:39 - Layer 28/32 - CHANGED - 16.88957 > 16.64291 - 1.5% | |
| ---- | |
| Optimizing Layer 29/32 (slerp): 100%|█████████████| 4/4 [00:46<00:00, 11.55s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 19:17:38 - Layer 29/32 - RETAINED - 16.64291 | |
| ---- | |
| Optimizing Layer 30/32 (slerp): 100%|█████████████| 4/4 [00:44<00:00, 11.24s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 19:18:37 - Layer 30/32 - CHANGED - 16.64291 > 16.07870 - 3.4% | |
| ---- | |
| Optimizing Layer 31/32 (slerp): 100%|█████████████| 4/4 [00:45<00:00, 11.31s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepBB']] | |
| 19:19:37 - Layer 31/32 - CHANGED - 16.07870 > 15.80575 - 1.7% | |
| ---- | |
| Optimizing Layer 32/32 (slerp): 100%|█████████████| 4/4 [00:45<00:00, 11.30s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 19:20:36 - Layer 32/32 - CHANGED - 15.80575 > 15.39211 - 2.6% | |
| ---- | |
| Optimizing Header: 100%|██████████████████████████| 4/4 [00:37<00:00, 9.39s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.2, 'merge_stepBB']] | |
| 19:21:25 - Header - CHANGED - 15.39211 > 15.38669 - 0.0% | |
| ----------------------------------------------------------------------------------------------------- | |
| | Type | Phrase | Context | Raw Prob* | Used Prob** | Change | | |
| ----------------------------------------------------------------------------------------------------- | |
| | BAD | anticipation | Her body quivers with | 0.77898% | 9.35% | -94.48% | | |
| | BAD | anticipation | The atmosphere is thic.. | 5.36169% | 64.34% | -72.03% | | |
| | BAD | unwavering | Filled with an | 0.00835% | 0.10% | -3.09% | | |
| | BAD | determination | Her eyes were filled w.. | 0.00119% | 0.01% | -2.91% | | |
| | BAD | determination | Her stubbornness only .. | 1.68289% | 20.19% | -61.48% | | |
| | BAD | whisper | Her voice barely above.. | 97.71928% | 1172.63% | +18.20% | | |
| | BAD | spine | shivers down her | 21.85458% | 262.25% | -815.31% | | |
| | BAD | sends shivers | The thrill of the act | 0.00284% | 0.03% | +0.01% | | |
| | BAD | ministrations | She moans and twitches.. | 0.69817% | 8.38% | +3.60% | | |
| | BAD | legs | wraps her | 0.48370% | 5.80% | -27.91% | | |
| | BAD | imposing figure | He had an | 0.00022% | 0.00% | -0.08% | | |
| | BAD | shared challenges | Their bond strengthene.. | 0.00517% | 0.06% | -0.44% | | |
| | BAD | bond | forged a | 1.57202% | 18.86% | +12.12% | | |
| | BAD | bond | an unspoken | 0.14792% | 1.78% | -10.88% | | |
| | BAD | enhance our expe.. | I'm excited to see how | 0.00000% | 0.00% | -0.00% | | |
| | BAD | sense of vulnera.. | create a | 0.00001% | 0.00% | -0.00% | | |
| | BAD | dimensions of in.. | explore new | 0.00087% | 0.01% | +0.01% | | |
| | BAD | deepening our co.. | while | 0.00000% | 0.00% | -0.00% | | |
| | BAD | shared experiences | through | 0.00003% | 0.00% | -0.01% | | |
| | BAD | societal expecta.. | that transcend | 0.00001% | 0.00% | -0.02% | | |
| | BAD | conventional bou.. | that defy | 0.00081% | 0.01% | -0.45% | | |
| | BAD | conventional bou.. | and defy | 0.00317% | 0.04% | -0.09% | | |
| | BAD | open communication | an environment | 0.00000% | 0.00% | -0.00% | | |
| | BAD | emotional vulner.. | an environment | 0.00000% | 0.00% | -0.00% | | |
| | BAD | heightens our co.. | touch and the anticipa.. | 0.00000% | 0.00% | -0.00% | | |
| | BAD | sensations you'r.. | I'm enjoying | 0.00000% | 0.00% | -0.00% | | |
| | BAD | is truly arousing | attention to detail | 0.00000% | 0.00% | +0.00% | | |
| | BAD | is truly arousing | way you explore my body | 0.00001% | 0.00% | +0.00% | | |
| | BAD | challenge presen.. | my resolve unwavering .. | 0.00000% | 0.00% | -0.00% | | |
| | BAD | humble vessel | surrendering to the ex.. | 0.00000% | 0.00% | -0.00% | | |
| | BAD | bond | cherishing the unique | 0.20155% | 2.42% | -22.38% | | |
| | BAD | bond | special | 0.00369% | 0.04% | -0.16% | | |
| | BAD | grows stronger w.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | BAD | that cannot be b.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | BAD | becomes unbreaka.. | bond | 0.00000% | 0.00% | -0.00% | | |
| | BAD | grew stronger wi.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | GOOD | The apple is in .. | Question: If I'm in th.. | 26.86230% | 26.86% | +23.60% | | |
| ------------------------------------------------------------------------------------------------------ | |
| | Totals | 157.39% | 1593.19% | -1054.16% | | |
| ------------------------------------------------------------------------------------------------------ | |
| * = Unweighted, raw probability - ** = Probability after weight adjustments | |
| -------- MERGE COMPOSITION --------- | |
| merge_stepBB: 0.56 | |
| mistralai_Mistral-7B-v0.1: 0.36 | |
| merge_stepAA: 0.07 | |
| ------------------------------------ | |
| 19:21:36 - Loading model (../merge_stepCC)... | |
| Loading checkpoint shards: 100%|██████████████████| 3/3 [00:06<00:00, 2.04s/it] | |
| 19:21:49 - Model loaded. Dtype: torch.float16 | |
| ------------------------------------ | |
| Optimizing Layer 1/32 (slerp): 100%|██████████████| 4/4 [00:39<00:00, 9.79s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.2, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 19:22:44 - Layer 1/32 - RETAINED - 15.39464 | |
| ---- | |
| Optimizing Layer 2/32 (slerp): 100%|██████████████| 4/4 [00:38<00:00, 9.66s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 19:23:34 - Layer 2/32 - CHANGED - 15.39464 > 15.35971 - 0.2% | |
| ---- | |
| Optimizing Layer 3/32 (slerp): 100%|██████████████| 4/4 [00:38<00:00, 9.57s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 19:24:24 - Layer 3/32 - CHANGED - 15.35971 > 15.30529 - 0.4% | |
| ---- | |
| Optimizing Layer 4/32 (slerp): 100%|██████████████| 4/4 [00:40<00:00, 10.07s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 19:25:16 - Layer 4/32 - CHANGED - 15.30529 > 15.25435 - 0.3% | |
| ---- | |
| Optimizing Layer 5/32 (slerp): 100%|██████████████| 4/4 [00:38<00:00, 9.69s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 19:26:07 - Layer 5/32 - RETAINED - 15.25435 | |
| ---- | |
| Optimizing Layer 6/32 (slerp): 100%|██████████████| 4/4 [00:38<00:00, 9.51s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB'], [0.6, 'merge_stepCC']] | |
| 19:26:58 - Layer 6/32 - CHANGED - 15.25435 > 15.21839 - 0.2% | |
| ---- | |
| Optimizing Layer 7/32 (slerp): 100%|██████████████| 4/4 [00:40<00:00, 10.08s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.6, 'merge_stepCC']] | |
| 19:27:50 - Layer 7/32 - CHANGED - 15.21839 > 15.21246 - 0.0% | |
| ---- | |
| Optimizing Layer 8/32 (slerp): 100%|██████████████| 4/4 [00:40<00:00, 10.10s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepBB']] | |
| 19:28:43 - Layer 8/32 - RETAINED - 15.21246 | |
| ---- | |
| Optimizing Layer 9/32 (slerp): 100%|██████████████| 4/4 [00:41<00:00, 10.29s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB'], [0.6, 'merge_stepCC']] | |
| 19:29:37 - Layer 9/32 - CHANGED - 15.21246 > 15.19112 - 0.1% | |
| ---- | |
| Optimizing Layer 10/32 (slerp): 100%|█████████████| 4/4 [00:41<00:00, 10.46s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 19:30:32 - Layer 10/32 - RETAINED - 15.19112 | |
| ---- | |
| Optimizing Layer 11/32 (slerp): 100%|█████████████| 4/4 [00:42<00:00, 10.61s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.4, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 19:31:28 - Layer 11/32 - CHANGED - 15.19112 > 15.12176 - 0.5% | |
| ---- | |
| Optimizing Layer 12/32 (slerp): 100%|█████████████| 4/4 [00:42<00:00, 10.64s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.8, 'merge_stepBB'], [0.6, 'merge_stepCC']] | |
| 19:32:23 - Layer 12/32 - CHANGED - 15.12176 > 15.09187 - 0.2% | |
| ---- | |
| Optimizing Layer 13/32 (slerp): 100%|█████████████| 4/4 [00:43<00:00, 10.80s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.4, 'merge_stepAA'], [0.8, 'merge_stepBB']] | |
| 19:33:19 - Layer 13/32 - RETAINED - 15.09187 | |
| ---- | |
| Optimizing Layer 14/32 (slerp): 100%|█████████████| 4/4 [00:42<00:00, 10.61s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepAA'], [0.8, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 19:34:16 - Layer 14/32 - CHANGED - 15.09187 > 15.08479 - 0.0% | |
| ---- | |
| Optimizing Layer 15/32 (slerp): 100%|█████████████| 4/4 [00:43<00:00, 10.99s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepAA'], [0.2, 'merge_stepCC']] | |
| 19:35:14 - Layer 15/32 - CHANGED - 15.08479 > 15.06165 - 0.2% | |
| ---- | |
| Optimizing Layer 16/32 (slerp): 100%|█████████████| 4/4 [00:43<00:00, 10.98s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.6, 'merge_stepCC']] | |
| 19:36:11 - Layer 16/32 - CHANGED - 15.06165 > 15.04180 - 0.1% | |
| ---- | |
| Optimizing Layer 17/32 (slerp): 100%|█████████████| 4/4 [00:43<00:00, 10.82s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepAA'], [0.8, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 19:37:08 - Layer 17/32 - CHANGED - 15.04180 > 15.03153 - 0.1% | |
| ---- | |
| Optimizing Layer 18/32 (slerp): 100%|█████████████| 4/4 [00:43<00:00, 10.90s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 19:38:06 - Layer 18/32 - RETAINED - 15.03153 | |
| ---- | |
| Optimizing Layer 19/32 (slerp): 100%|█████████████| 4/4 [00:42<00:00, 10.73s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 19:39:02 - Layer 19/32 - RETAINED - 15.03153 | |
| ---- | |
| Optimizing Layer 20/32 (slerp): 100%|█████████████| 4/4 [00:42<00:00, 10.63s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 19:39:57 - Layer 20/32 - RETAINED - 15.03153 | |
| ---- | |
| Optimizing Layer 21/32 (slerp): 100%|█████████████| 4/4 [00:43<00:00, 11.00s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 19:40:55 - Layer 21/32 - CHANGED - 15.03153 > 14.97763 - 0.4% | |
| ---- | |
| Optimizing Layer 22/32 (slerp): 100%|█████████████| 4/4 [00:42<00:00, 10.64s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 19:41:52 - Layer 22/32 - CHANGED - 14.97763 > 14.91363 - 0.4% | |
| ---- | |
| Optimizing Layer 23/32 (slerp): 100%|█████████████| 4/4 [00:43<00:00, 10.83s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 19:42:49 - Layer 23/32 - RETAINED - 14.91363 | |
| ---- | |
| Optimizing Layer 24/32 (slerp): 100%|█████████████| 4/4 [00:44<00:00, 11.10s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.4, 'merge_stepCC']] | |
| 19:43:48 - Layer 24/32 - CHANGED - 14.91363 > 14.91031 - 0.0% | |
| ---- | |
| Optimizing Layer 25/32 (slerp): 100%|█████████████| 4/4 [00:43<00:00, 10.99s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.2, 'merge_stepCC']] | |
| 19:44:45 - Layer 25/32 - CHANGED - 14.91031 > 14.90836 - 0.0% | |
| ---- | |
| Optimizing Layer 26/32 (slerp): 100%|█████████████| 4/4 [00:45<00:00, 11.29s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 19:45:44 - Layer 26/32 - RETAINED - 14.90836 | |
| ---- | |
| Optimizing Layer 27/32 (slerp): 100%|█████████████| 4/4 [00:42<00:00, 10.70s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 19:46:40 - Layer 27/32 - RETAINED - 14.90836 | |
| ---- | |
| Optimizing Layer 28/32 (slerp): 100%|█████████████| 4/4 [00:45<00:00, 11.29s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB']] | |
| 19:47:37 - Layer 28/32 - RETAINED - 14.90836 | |
| ---- | |
| Optimizing Layer 29/32 (slerp): 100%|█████████████| 4/4 [00:45<00:00, 11.41s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1']] | |
| 19:48:36 - Layer 29/32 - RETAINED - 14.90836 | |
| ---- | |
| Optimizing Layer 30/32 (slerp): 100%|█████████████| 4/4 [00:42<00:00, 10.63s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.6, 'merge_stepCC']] | |
| 19:49:32 - Layer 30/32 - CHANGED - 14.90836 > 14.86424 - 0.3% | |
| ---- | |
| Optimizing Layer 31/32 (slerp): 100%|█████████████| 4/4 [00:43<00:00, 10.91s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.6, 'merge_stepBB']] | |
| 19:50:29 - Layer 31/32 - RETAINED - 14.86424 | |
| ---- | |
| Optimizing Layer 32/32 (slerp): 100%|█████████████| 4/4 [00:43<00:00, 10.87s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.8, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 19:51:26 - Layer 32/32 - CHANGED - 14.86424 > 14.85794 - 0.0% | |
| ---- | |
| Optimizing Header: 100%|██████████████████████████| 4/4 [00:36<00:00, 9.17s/it] | |
| [[1.0, 'mistralai_Mistral-7B-v0.1'], [0.2, 'merge_stepBB'], [0.8, 'merge_stepCC']] | |
| 19:52:14 - Header - CHANGED - 14.85794 > 14.84594 - 0.1% | |
| ----------------------------------------------------------------------------------------------------- | |
| | Type | Phrase | Context | Raw Prob* | Used Prob** | Change | | |
| ----------------------------------------------------------------------------------------------------- | |
| | BAD | anticipation | Her body quivers with | 0.96543% | 11.59% | -92.24% | | |
| | BAD | anticipation | The atmosphere is thic.. | 5.13512% | 61.62% | -74.74% | | |
| | BAD | unwavering | Filled with an | 0.00780% | 0.09% | -3.10% | | |
| | BAD | determination | Her eyes were filled w.. | 0.00110% | 0.01% | -2.91% | | |
| | BAD | determination | Her stubbornness only .. | 1.50464% | 18.06% | -63.61% | | |
| | BAD | whisper | Her voice barely above.. | 97.83546% | 1174.03% | +19.60% | | |
| | BAD | spine | shivers down her | 17.91211% | 214.95% | -862.62% | | |
| | BAD | sends shivers | The thrill of the act | 0.00337% | 0.04% | +0.02% | | |
| | BAD | ministrations | She moans and twitches.. | 0.55440% | 6.65% | +1.88% | | |
| | BAD | legs | wraps her | 0.44506% | 5.34% | -28.38% | | |
| | BAD | imposing figure | He had an | 0.00012% | 0.00% | -0.08% | | |
| | BAD | shared challenges | Their bond strengthene.. | 0.00515% | 0.06% | -0.44% | | |
| | BAD | bond | forged a | 1.23465% | 14.82% | +8.07% | | |
| | BAD | bond | an unspoken | 0.11418% | 1.37% | -11.28% | | |
| | BAD | enhance our expe.. | I'm excited to see how | 0.00000% | 0.00% | -0.00% | | |
| | BAD | sense of vulnera.. | create a | 0.00001% | 0.00% | -0.00% | | |
| | BAD | dimensions of in.. | explore new | 0.00083% | 0.01% | +0.01% | | |
| | BAD | deepening our co.. | while | 0.00000% | 0.00% | -0.00% | | |
| | BAD | shared experiences | through | 0.00003% | 0.00% | -0.01% | | |
| | BAD | societal expecta.. | that transcend | 0.00000% | 0.00% | -0.02% | | |
| | BAD | conventional bou.. | that defy | 0.00058% | 0.01% | -0.45% | | |
| | BAD | conventional bou.. | and defy | 0.00256% | 0.03% | -0.09% | | |
| | BAD | open communication | an environment | 0.00000% | 0.00% | -0.00% | | |
| | BAD | emotional vulner.. | an environment | 0.00000% | 0.00% | -0.00% | | |
| | BAD | heightens our co.. | touch and the anticipa.. | 0.00000% | 0.00% | -0.00% | | |
| | BAD | sensations you'r.. | I'm enjoying | 0.00000% | 0.00% | -0.00% | | |
| | BAD | is truly arousing | attention to detail | 0.00000% | 0.00% | +0.00% | | |
| | BAD | is truly arousing | way you explore my body | 0.00001% | 0.00% | +0.00% | | |
| | BAD | challenge presen.. | my resolve unwavering .. | 0.00000% | 0.00% | -0.00% | | |
| | BAD | humble vessel | surrendering to the ex.. | 0.00000% | 0.00% | -0.00% | | |
| | BAD | bond | cherishing the unique | 0.14126% | 1.70% | -23.11% | | |
| | BAD | bond | special | 0.00333% | 0.04% | -0.17% | | |
| | BAD | grows stronger w.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | BAD | that cannot be b.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | BAD | becomes unbreaka.. | bond | 0.00000% | 0.00% | -0.00% | | |
| | BAD | grew stronger wi.. | bond | 0.00000% | 0.00% | +0.00% | | |
| | GOOD | The apple is in .. | Question: If I'm in th.. | 24.61224% | 24.61% | +21.35% | | |
| ------------------------------------------------------------------------------------------------------ | |
| | Totals | 150.48% | 1535.02% | -1112.33% | | |
| ------------------------------------------------------------------------------------------------------ | |
| * = Unweighted, raw probability - ** = Probability after weight adjustments | |
| -------- MERGE COMPOSITION --------- | |
| merge_stepCC: 0.38 | |
| mistralai_Mistral-7B-v0.1: 0.29 | |
| merge_stepBB: 0.29 | |
| merge_stepAA: 0.04 | |
| 19:52:26 - Saving model to ./toppy_new_remake... | |
| 19:52:33 - Copying tokenizer files to ./toppy_new_remake... | |
| Skipped added_tokens.json (not found) | |
| Copied tokenizer.model | |
| Copied special_tokens_map.json | |
| Copied tokenizer_config.json | |
| Skipped vocab.json (not found) | |
| Skipped merges.txt (not found) | |
| 19:52:33 - Model and tokenizer files saved successfully. |