Motif-Technologies
/

Motif-2.6B

Text Generation

text-generation-inference

Model card Files Files and versions

leejunhyeok commited on 22 days ago

Commit

6230f77

·

verified ·

1 Parent(s): c281339

Update modeling_motif.py

Files changed (1) hide show

modeling_motif.py +1 -1

modeling_motif.py CHANGED Viewed

@@ -251,7 +251,7 @@ def rotate_half(x):
     return rotated_tensor
-def apply_rotary_pos_emb(q, k, cos, sin, position_ids=None, unsqueeze_dim=1, fused_rope=True):
     """
     Applies rotary position embeddings to the input tensors.
     Args:

     return rotated_tensor
+def apply_rotary_pos_emb(q, k, cos, sin, position_ids=None, unsqueeze_dim=1):
     """
     Applies rotary position embeddings to the input tensors.
     Args: