AbstractPhil commited on
Commit
c5b64a3
·
verified ·
1 Parent(s): 890fb8d

Update REAME.md

Browse files
Files changed (1) hide show
  1. REAME.md +1 -1
REAME.md CHANGED
@@ -6,7 +6,7 @@ This T5-small model is fried to echo and interpolate math in complex intended wa
6
 
7
  This adapter here is trained using T5 inputs with this code below.
8
 
9
- This isn't a bad first test. I will be improving the adapter with common lora techniques, including more techniques from training LLM-style loras, and including additional loss methodologies while simultaneously including more advanced and carefully curated response fomrulas to the way the adapter responded.
10
 
11
  Given time I'm certain this will work; whether it be creating a layered lora structure to interpolate differences layer by layer within the clip_l, or perhaps in a much more direct neuron interpolation. Time will tell and I'm definitely enjoying this sort of thing.
12
 
 
6
 
7
  This adapter here is trained using T5 inputs with this code below.
8
 
9
+ This isn't a bad first test. I will be improving the adapter with common lora techniques, including more techniques from training LLM-style loras, and including additional loss methodologies while simultaneously including more advanced and carefully curated response formulas to the way the adapter responded to training and the extrapolative math from the CLIP_L adapted response.
10
 
11
  Given time I'm certain this will work; whether it be creating a layered lora structure to interpolate differences layer by layer within the clip_l, or perhaps in a much more direct neuron interpolation. Time will tell and I'm definitely enjoying this sort of thing.
12