gioandrade

/

llama1_TinyShakespeare

like 0

• "__builtin__.set",
• "__main__.FFN_SwiGLU",
• "torch.nn.modules.dropout.Dropout",
• "__main__.MultiheadRopeAttention",
• "torch.nn.modules.container.ModuleList",
• "torch._utils._rebuild_parameter",
• "__main__.LlamaBlock",
• "torch.nn.modules.linear.Linear",
• "__main__.Llama",
• "torch.nn.modules.container.Sequential",
• "__main__.RopeAttentionHead",
• "torch.nn.modules.sparse.Embedding",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "__main__.RMSNorm",
• "torch.FloatStorage"

How to fix it?

• "torch.nn.modules.linear.Linear",
• "torch.nn.modules.container.Sequential",
• "__main__.RopeAttentionHead",
• "torch.nn.modules.container.ModuleList",
• "__main__.FFN_SwiGLU",
• "torch.FloatStorage",
• "torch.nn.modules.sparse.Embedding",
• "torch.nn.modules.dropout.Dropout",
• "__builtin__.set",
• "__main__.Llama",
• "collections.OrderedDict",
• "__main__.LlamaBlock",
• "__main__.RMSNorm",
• "torch._utils._rebuild_parameter",
• "torch._utils._rebuild_tensor_v2",
• "__main__.MultiheadRopeAttention"

How to fix it?