yahavb

/

inf2-bs16-tp16-mml16k-llama-31-8b-vllm

like 0

• "torch.jit._pickle.restore_type_tag",
• "__torch__.neuronx_distributed.trace.spmd.NxDModel",
• "__torch__.neuronx_distributed.trace.spmd.NxDModelExecutor",
• "__torch__.torch.classes.neuron.LayoutTransformation",
• "torch.jit._pickle.build_intlist",
• "torch.jit._pickle.build_intlist",
• "torch.jit._pickle.build_intlist",
• "torch.jit._pickle.build_intlist",
• "torch.jit._pickle.build_intlist",
• "torch.jit._pickle.build_intlist",
• "torch.jit._pickle.build_intlist",
• "collections.OrderedDict",
• "torch._utils._rebuild_tensor_v2",
• "torch.IntStorage",
• "torch.FloatStorage",
• "torch.jit._pickle.restore_type_tag"

How to fix it?