First Commit

Hello HuggingFace！

.gitattributes

@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+DocsAsset/GAMESOUL_top_pic.png filter=lfs diff=lfs merge=lfs -text
+tokenizer.json filter=lfs diff=lfs merge=lfs -text

README.md

@@ -1,3 +1,330 @@
----
-license: apache-2.0
----
+---
+base_model: unsloth/qwen3-4b-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/qwen3-4b-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+- game
+- npc
+- gamesoul
+- ai
+- RAG
+- MCP
+- 游戏
+- Unreal
+- Unity
+- Cocos
+---
+
+# Model Card for GameSoul-AI-NPC
+
+![Image Alt Text](DocsAsset\GAMESOUL_top_pic.png)
+
+[English] | [中文](README_ZH_CN.md)
+
+🤖 GameSoul-AI-NPC is a game NPC behavior decision model that fuses multi-source information to generate dynamic actions consistent with character settings. It supports real-time environment responses, event reactions, memory retrieval, and character consistency. Capable of invoking Reasoning, RAG (Retrieval-Augmented Generation), and MCP (Multi-Character Planning).
+
+## Model Details 🔍
+
+### Core Capabilities
+
+| Module | Capabilities |
+|------|----------|
+| **Environment Perception** | Parses scene state, player interactions, time/weather signals |
+| **Memory System** | Supports long-term behavior memory (stored in a database) |
+| **Character Consistency** | Generates actions according to predefined background (personality, goals, identity, abilities, memory) |
+| **Dynamic Decision** | Generates action sequences (movement, dialogue, interaction) based on combined state |
+
+### Architecture🏗️
+
+```mermaid
+graph TD
+A[🌏 Environment State] --> C(🧠LLM Decision Engine)
+B[🧙‍♂️Character Memory] --> C
+D[💭Current Event] --> C
+C --> E{Behavior Arbitration}
+E --> F[👊Action Commands]
+E --> G[💬Natural Language Feedback]
+E --> H[📌Store Memory]
+```
+
+### Extension Interface
+
+🔌 MCP Protocol (reference only): Call MCP via npc_memory_api (example) to fetch database information
+
+```json
+// example
+{
+  "jsonrpc": "2.0",
+  "id": 123456789,
+  "method": "get_npc_memory",
+  "params": {
+    "player_action": "steal_item",
+    "npc_id": "npc_123456"
+  }
+}
+```
+
+### Model Description 📝
+
+- **Developed by : NewOrigin**
+- **Funded by : NewOrigin**
+- **Shared by : NewOrigin**
+- **Model type : Decoder&MoE Transformer**
+- **Language(s) (NLP) : English & Chinese & 110+ languages**
+- **License : apache-2.0**
+- **Finetuned from model : unsloth/qwen3-4b**
+
+### Model Sources🌐
+
+- **Repository : <https://huggingface.co/unsloth/Qwen3-4B>**
+
+## Uses🚀
+
+This model is a fine-tuned version of unsloth/qwen3-4b, designed to empower NPCs in games with intelligent behavior. It generates dynamic responses based on character background, memory context, and environmental state, supporting Reasoning, RAG, and MCP calls.
+
+Intended users:
+
+- Game developers and designers
+
+- Researchers in game NPC behavior AI
+
+- Game studios and indie developers
+
+- Other interested parties
+
+Potential beneficiaries:
+
+- End players interacting with NPCs
+
+### Direct Use🖥️
+
+The model can be used directly in game environments to generate AI behavior without additional fine-tuning. It produces NPC responses based on context, memory, player actions, and environmental state. Developers can call it via a reasoning interface or integrate it into game logic or RAG workflows.
+
+Typical scenarios include:
+
+- Automated NPC ecosystems for real-time world simulation
+- Story and memory-based NPC interactions
+- Behavior planning based on environmental conditions
+- Multi-agent collaborative reasoning and responses
+
+### Downstream Use📦
+
+This model is suitable for embedding into game systems as the core reasoning and dialogue engine for AI-driven NPCs, integrated with:
+
+- Game engines for real-time dialogue generation and behavior control
+- Multi-agent simulation platforms providing long-term memory and contextual reasoning
+- RAG-based reasoning systems that enhance NPC decision-making through knowledge retrieval
+- MCP protocol-supporting databases to store NPC data and fetch it when needed
+
+Further fine-tuning can be applied to match game tone, settings, or mission requirements.
+
+### Out-of-Scope Use⚠️
+
+This model is not suitable for applications with high-risk or security-sensitive contexts, such as:
+
+- Legal, medical, financial, or safety-critical decision-making
+- Scenarios requiring high factual accuracy or ethical reasoning
+
+## Bias, Risks, and Limitations🚧
+
+The model may inherit biases from pre-training or fine-tuning data, including cultural stereotypes, sexual content, gender bias, and character behavior patterns.
+
+Technical limitations include:
+
+- Cannot verify the truthfulness or logical correctness of generated content
+
+Filtering of outputs is recommended, especially when deployed in systems involving minors.
+
+### Recommendations💡
+
+- Thoroughly test the model across various game scenarios before deployment to understand its boundaries and potential failure modes.
+- Establish an actionable framework within the game engine before integrating the model.
+
+## How to Get Started with the Model🚩
+
+Example of loading and calling the fine-tuned model:
+
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+import torch
+
+model_name = "NewOrigin/GameSoul-AI-NPC-4B-v0.1"
+
+tokenizer = AutoTokenizer.from_pretrained(model_name)
+model = AutoModelForCausalLM.from_pretrained(
+    model_name,
+    torch_dtype=torch.auto,  
+    device_map="auto"
+)
+
+prompt = "input your content"
+messages = [
+    {"role": "user", "content": prompt}
+]
+
+text = tokenizer.apply_chat_template(
+    messages,
+    tokenize=False,
+    add_generation_prompt=False,
+    enable_thinking=False
+)
+
+model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
+
+generated_ids = model.generate(
+    **model_inputs,
+    max_new_tokens=1024,
+    do_sample=True,
+    top_p=0.9,
+)
+
+output_ids = generated_ids[0].tolist()
+think_token_id = tokenizer.convert_tokens_to_ids("</think>")
+if think_token_id in output_ids:
+    idx = output_ids.index(think_token_id)
+    thinking = tokenizer.decode(output_ids[:idx], skip_special_tokens=True).strip()
+    response = tokenizer.decode(output_ids[idx+1:], skip_special_tokens=True).strip()
+else:
+    thinking, response = "", tokenizer.decode(output_ids, skip_special_tokens=True).strip()
+
+print("🧠 think", thinking)
+print("💬 answer", response)
+```
+
+### An example of analog input and output📥📤
+
+- Input📥
+
+```json
+{
+    "NPCID": "npc_585919",
+    "Character Background": "A succubus apothecary from the Mysterious Forest, aged 20. She studied herbal medicine and magical knowledge in the forest since childhood. After her homeland suffered evil magic corruption and her family perished, she resolved to find a way to counteract the magic. Proficient in potion brewing, charm magic, and magical perception.",
+    "Traits": {
+        "Core Personality": [
+            "Charismatic",
+            "Cunning",
+            "Curious"
+        ],
+        "Special Skills": [
+            "Potion Brewing",
+            "Charm Magic",
+            "Magical Perception"
+        ]
+    },
+    "Dynamic Status": {
+        "Current Emotion": "Anger (due to worsening magic pollution in the forest recently, which has weakened her powers)"
+    }
+},
+"Memory Events": [
+    {
+        "eventid": "evt_20240805_001",
+        "timestamp": "2024-08-05",
+        "Event Type": "Assistance",
+        "Initiator": "player_004",
+        "Recipient": "npc_585919",
+        "Action": "Provided magical books",
+        "Impact": "Developed favorable impression of player_004, gained additional magical energy"
+    },
+    {
+        "eventid": "evt_20240720_002",
+        "timestamp": "2024-07-20",
+        "Event Type": "Conflict",
+        "Initiator": "npc_006",
+        "Recipient": "npc_585919",
+        "Action": "Stole herbs",
+        "Impact": "Developed hostility toward npc_006, increased vigilance"
+    },
+    {
+        "eventid": "evt_20240712_003",
+        "timestamp": "2024-07-12",
+        "Event Type": "Transaction",
+        "Initiator": "player_005",
+        "Recipient": "npc_585919",
+        "Action": "Purchased potions",
+        "Impact": "Earned gold coins, improved mood, used charm magic to enhance transaction"
+    },
+    {
+        "eventid": "evt_20240630_004",
+        "timestamp": "2024-06-30",
+        "Event Type": "Assistance",
+        "Initiator": "npc_585919",
+        "Recipient": "player_006",
+        "Action": "Healed wounds",
+        "Impact": "Generated favorable impression and dependency through magical healing"
+    },
+    {
+        "eventid": "evt_20240615_005",
+        "timestamp": "2024-06-15",
+        "Event Type": "Exploration",
+        "Initiator": "npc_585919",
+        "Recipient": "npc_585919",
+        "Action": "Discovered new herbs",
+        "Impact": "Expanded magical knowledge, enhanced charm"
+    }
+],
+"Current Event": "Encountered a lecherous hero"
+}
+```
+
+- Output📤
+
+```json
+{"Event Reaction": "Upon sensing the hero's harassment, npc_585919 casts a charm spell to induce hallucinations, uses magical perception to track his movements, and sets a trap deep within the forest"}
+```
+
+## Training Details🏋️‍♀️
+
+### Training Procedure
+
+This model is fine-tuned from unsloth/qwen3-4b-unsloth-bnb-4bit using the LoRA (Low-Rank Adaptation) method from the Unsloth toolkit for efficient low-resource tuning.
+
+- Fine-tuning method: LoRA
+
+- Trainer: Unsloth SFTTrainer
+
+- Model format: adapter-only weights in safetensors
+
+- Training hardware: Nvidia A10 GPU
+
+## Environmental Impact🌱
+
+- **Hardware Type : cloud server**
+- **Cloud Provider : Google Cloud Platform & Alibaba Cloud**
+- **Compute Region : NorthAmerica & Asia**
+- **Carbon Emitted : <1Kg**
+
+**BibTeX:**
+
+```bibtex
+@misc{NewOrigin2025GameSoul-AI-NPC,
+  title        = {GameSoul-AI-NPC: A LoRA fine-tuned Qwen3-4B   model for game NPC reasoning and interaction},
+  author       = {NewOrigin},
+  year         = {2025},
+  publisher    = {Hugging Face},
+  howpublished = {https://huggingface.co/NewOrigin/GameSoul-AI-NPC-4B-v0.1}
+}
+```
+
+**APA:**
+
+NewOrigin. (2025). *GameSoul-AI-NPC: A LoRA fine-tuned Qwen3-4B model for game NPC reasoning and interaction*. Hugging Face. <https://huggingface.co/NewOrigin/GameSoul-AI-NPC-4B-v0.1>
+
+## Model Card Authors✍️
+
+- **Author by : NewOrigin**
+
+## Model Card Contact📧
+
+For questions, feedback, or collaboration inquiries, please contact:
+
+**email ：<[email protected]>**
+
+### Framework versions
+
+- PEFT 0.16.0

README_ZH_CN.md

@@ -0,0 +1,326 @@
+---
+base_model: unsloth/qwen3-4b-unsloth-bnb-4bit
+library_name: peft
+pipeline_tag: text-generation
+tags:
+- base_model:adapter:unsloth/qwen3-4b-unsloth-bnb-4bit
+- lora
+- sft
+- transformers
+- trl
+- unsloth
+- game
+- npc
+- gamesoul
+- ai
+- RAG
+- MCP
+- 游戏
+- Unreal
+- Unity
+- Cocos
+---
+
+# Model Card for GameSoul-AI-NPC
+
+![Image Alt Text](DocsAsset\GAMESOUL_top_pic.png)
+
+[English](README.md) | [中文]
+
+🤖 GameSoul-AI-NPC 遊戲 NPC 行為決策模型，透過多來源資訊融合，生成符合角色設定的動態行為。支援即時環境回應、事件回應、記憶回溯與角色一致性維持。可呼叫推理 (Reasoning)、RAG (檢索增強生成) 及 MCP (多角色協同規劃)。
+
+## 模型細節 🔍
+
+### 核心能力
+
+| 模組        | 功能描述                               |
+| --------- | ---------------------------------- |
+| **環境感知**  | 解析場景狀態、玩家互動、時間/天氣等即時訊號             |
+| **記憶系統**  | 支援長期行為記憶（使用資料庫儲存）                  |
+| **角色一致性** | 根據預設背景（性格/目標/身分/能力/記憶等）生成符合角色設定的行為 |
+| **動態決策**  | 基於綜合狀態生成動作序列（移動/對話/互動）             |
+
+### 技術架構 🏗️
+
+```mermaid
+graph TD
+A[🌏環境狀態] --> C(🧠LLM決策引擎)
+B[🧙‍♂️角色記憶] --> C
+D[💭當前事件] --> C
+C --> E{行為裁決}
+E --> F[👊動作指令]
+E --> G[💬自然語言回饋]
+E --> H[📌儲存記憶]
+```
+
+### 擴展介面
+
+🔌MCP 協議 (reference only)：透過 npc\_memory\_api (example) 呼叫 MCP 取得資料庫資訊
+
+```json
+// example
+{
+  "jsonrpc": "2.0",
+  "id": 123456789,
+  "method": "get_npc_memory",
+  "params": {
+    "player_action": "steal_item",
+    "npc_id": "npc_123456"
+  }
+}
+```
+
+### 模型描述 📝
+
+- **Developed by : NewOrigin**
+- **Funded by : NewOrigin**
+- **Shared by : NewOrigin**
+- **Model type : Decoder&MoE Transformer**
+- **Language(s) (NLP) : English & Chinese & 110+ languages**
+- **License : apache-2.0**
+- **Finetuned from model : unsloth/qwen3-4b**
+
+### 模型來源 🌐
+
+- **Repository :** [https://huggingface.co/unsloth/Qwen3-4B](https://huggingface.co/unsloth/Qwen3-4B)
+
+## 使用場景 🚀
+
+本模型為 unsloth/qwen3-4b 的微調版本，專為遊戲中非玩家角色 (NPC) 賦能智能行為。模型可根據角色背景、記憶上下文與環境狀態生成動態回應，支援推理 (Reasoning)、RAG (檢索增強生成) 及 MCP (多角色協同規劃) 呼叫。
+
+預期使用者：
+
+- 遊戲開發者、遊戲設計師
+- 研究遊戲 NPC 行為 AI 的專業人員
+- 遊戲工作室、獨立遊戲開發者
+- 其他有興趣的使用者
+
+潛在影響對象：
+
+- 與 NPC 互動的最終玩家
+
+### 直接使用 🖥️
+
+本模型可直接用於遊戲環境中生成 AI 行為，無需額外微調。它能根據上下文、記憶資訊、玩家行為及環境狀態生成符合預期的 NPC 回應。開發者可透過推理介面直接呼叫，或整合至遊戲系統、決策邏輯或 RAG 流程中使用。
+
+典型應用場景包括：
+
+- 自動化 NPC 生態，形成遊戲世界即時推演
+- 基於劇情與記憶的 NPC 互動
+- 根據環境狀態的行為規劃
+- 多智能體協作推理與回應
+
+### 下游整合 📦
+
+該模型適合嵌入遊戲系統等下游場景，可作為 AI 驅動 NPC 的核心推理與對話引擎，融入：
+
+- 遊戲引擎中，實現即時對話生成與行為邏輯控制
+- 多智能體模擬平台，提供長期記憶及上下文推理能力的互動行為
+- 基於 RAG 的推理系統，透過知識檢索增強 NPC 的決策過程
+- 支援 MCP 協議的資料庫，用於儲存 NPC 資訊，並於需要時呼叫
+
+依據遊戲調性、設定或任務需求，亦可進行進一步微調以符合風格。
+
+### 不建議使用範圍 ⚠️
+
+本模型不適用於涉及高風險或安全敏感的應用情境，以下為不建議使用方式：
+
+- 涉及法律、醫療、金融或安全等決策類任務
+- 需要高度事實準確度或倫理推理的應用場景
+
+## 偏見、風險與限制 🚧
+
+本模型可能繼承基礎預訓練資料或微調語料中的偏見，例如文化刻板印象、色情內容、性別偏見、角色行為模式等。
+
+技術限制包括：
+
+- 無法驗證生成內容的真實性或邏輯正確性
+
+在任何包含生成內容的系統中，尤其面向未成年玩家時，建議對輸出結果進行必要過濾。
+
+### 建議事項 💡
+
+- 部署前請充分測試模型於多種遊戲情境下的表現，釐清其邊界與潛在失效風險。
+- 在遊戲引擎中，先建立能執行動作的框架，再整合該模型。
+
+## 快速上手 🚩
+
+以下範例示範如何快速載入並呼叫微調後模型：
+
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+import torch
+
+model_name = "NewOrigin/GameSoul-AI-NPC-4B-v0.1"
+
+tokenizer = AutoTokenizer.from_pretrained(model_name)
+model = AutoModelForCausalLM.from_pretrained(
+    model_name,
+    torch_dtype=torch.auto,  
+    device_map="auto"
+)
+
+prompt = "input your content"
+messages = [
+    {"role": "user", "content": prompt}
+]
+
+text = tokenizer.apply_chat_template(
+    messages,
+    tokenize=False,
+    add_generation_prompt=False,
+    enable_thinking=False
+)
+
+model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
+
+generated_ids = model.generate(
+    **model_inputs,
+    max_new_tokens=1024,
+    do_sample=True,
+    top_p=0.9,
+)
+
+output_ids = generated_ids[0].tolist()
+think_token_id = tokenizer.convert_tokens_to_ids("</think>")
+if think_token_id in output_ids:
+    idx = output_ids.index(think_token_id)
+    thinking = tokenizer.decode(output_ids[:idx], skip_special_tokens=True).strip()
+    response = tokenizer.decode(output_ids[idx+1:], skip_special_tokens=True).strip()
+else:
+    thinking, response = "", tokenizer.decode(output_ids, skip_special_tokens=True).strip()
+
+print("🧠 think", thinking)
+print("💬 answer", response)
+```
+
+### 範例輸入與輸出 📥📤
+
+- 輸入📥
+
+```json
+{
+    "NPCID": "npc_585919",
+    "角色背景": "一位來自神秘森林的魅魔藥劑師，二十歲，從小在森林中學習草藥和魔法知識。因森林遭遇邪惡魔法侵襲，親人離世，她決心尋找破解魔法的方法。擅長調配藥劑、魅惑與魔法感知。",
+    "特徵": {
+        "核心性格": [
+            "誘惑",
+            "狡猾",
+            "好奇"
+        ],
+        "特長": [
+            "藥劑調配",
+            "魅惑術",
+            "魔法感知"
+        ]
+    },
+    "動態狀態": {
+        "當前情緒": "憤怒（因最近魔法污染在森林中加劇，影響了她的力量）"
+    },
+    "記憶事件": [
+        {
+            "eventid": "evt_20240805_001",
+            "timestamp": "2024-08-05",
+            "事件類型": "幫助",
+            "發起者": "player_004",
+            "接受者": "npc_585919",
+            "動作": "提供魔法書籍",
+            "影響": "對player_004產生好感，獲得更多魔法能量"
+        },
+        {
+            "eventid": "evt_20240720_002",
+            "timestamp": "2024-07-20",
+            "事件類型": "衝突",
+            "發起者": "npc_006",
+            "接受者": "npc_585919",
+            "動作": "搶奪草藥",
+            "影響": "npc_585919對npc_006產生敵意，警惕性上升"
+        },
+        {
+            "eventid": "evt_20240712_003",
+            "timestamp": "2024-07-12",
+            "事件類型": "交易",
+            "發起者": "player_005",
+            "接受者": "npc_585919",
+            "動作": "購買藥劑",
+            "影響": "獲得金幣，心情愉悅，利用魅力加強交易"
+        },
+        {
+            "eventid": "evt_20240630_004",
+            "timestamp": "2024-06-30",
+            "事件類型": "幫助",
+            "發起者": "npc_585919",
+            "接受者": "player_006",
+            "動作": "治療傷口",
+            "影響": "透過魔法治療，產生好感與依賴"
+        },
+        {
+            "eventid": "evt_20240615_005",
+            "timestamp": "2024-06-15",
+            "事件類型": "探索",
+            "發起者": "npc_585919",
+            "接受者": "npc_585919",
+            "動作": "發現新草藥",
+            "影響": "增加魔法知識，提升魅力"
+        }
+    ]
+},
+{
+    "當前事件": "遇到了好色的勇者"
+}
+```
+
+- 輸出📤
+
+```json
+{"事件反應": "npc_585919察覺到勇者對她的騷擾後，釋放魅惑術使其陷入幻覺，同時用魔法感知追蹤其行動軌跡，並在森林深處設下陷阱"}
+```
+
+## 訓練細節 🏋️‍♀️
+
+### 訓練流程
+
+本模型基於 unsloth/qwen3-4b-unsloth-bnb-4bit 進行微調，採用 Unsloth 工具庫中的 LoRA (Low-Rank Adaptation) 方法，實現高效低資源微調。
+
+- 微調方式： LoRA
+- 訓練器： 使用 Unsloth 的 SFTTrainer
+- 模型格式： 僅保存 adapter 權重，格式為 safetensors
+- 訓練設備： Nvidia A10 GPU
+
+## 環境影響 🌱
+
+- **Hardware Type : cloud server**
+- **Cloud Provider : Google Cloud Platform & Alibaba Cloud**
+- **Compute Region : NorthAmerica & Asia**
+- **Carbon Emitted : <1Kg**
+
+**BibTeX:**
+
+```bibtex
+@misc{NewOrigin2025GameSoul-AI-NPC,
+  title        = {GameSoul-AI-NPC: A LoRA fine-tuned Qwen3-4B   model for game NPC reasoning and interaction},
+  author       = {NewOrigin},
+  year         = {2025},
+  publisher    = {Hugging Face},
+  howpublished = {https://huggingface.co/NewOrigin/GameSoul-AI-NPC-4B-v0.1}
+}
+```
+
+**APA:**
+
+NewOrigin. (2025). *GameSoul-AI-NPC: A LoRA fine-tuned Qwen3-4B model for game NPC reasoning and interaction*. Hugging Face. [https://huggingface.co/NewOrigin/GameSoul-AI-NPC-4B-v0.1](https://huggingface.co/NewOrigin/GameSoul-AI-NPC-4B-v0.1)
+
+## Model Card Authors ✍️
+
+- **Author by : NewOrigin**
+
+## 聯絡方式 📧
+
+如有任何問題、建議或合作意向，歡迎聯繫：
+
+**電子郵件：**[**[email protected]**](mailto\:[email protected])
+
+### Framework versions
+
+- PEFT 0.16.0
+

adapter_config.json

@@ -0,0 +1,41 @@
+{
+  "alpha_pattern": {},
+  "auto_mapping": null,
+  "base_model_name_or_path": "unsloth/qwen3-4b-unsloth-bnb-4bit",
+  "bias": "none",
+  "corda_config": null,
+  "eva_config": null,
+  "exclude_modules": null,
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layer_replication": null,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "loftq_config": {},
+  "lora_alpha": 32,
+  "lora_bias": false,
+  "lora_dropout": 0,
+  "megatron_config": null,
+  "megatron_core": "megatron.core",
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "qalora_group_size": 16,
+  "r": 32,
+  "rank_pattern": {},
+  "revision": null,
+  "target_modules": [
+    "gate_proj",
+    "down_proj",
+    "q_proj",
+    "o_proj",
+    "up_proj",
+    "k_proj",
+    "v_proj"
+  ],
+  "task_type": "CAUSAL_LM",
+  "trainable_token_indices": null,
+  "use_dora": false,
+  "use_qalora": false,
+  "use_rslora": false
+}

adapter_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:ae419f50758c68e93155cd2ceb130683efeec93ac0e0e2ad2ee57b3d8a98fe95
+size 264308896

added_tokens.json

@@ -0,0 +1,28 @@
+{
+  "</think>": 151668,
+  "</tool_call>": 151658,
+  "</tool_response>": 151666,
+  "<think>": 151667,
+  "<tool_call>": 151657,
+  "<tool_response>": 151665,
+  "<|box_end|>": 151649,
+  "<|box_start|>": 151648,
+  "<|endoftext|>": 151643,
+  "<|file_sep|>": 151664,
+  "<|fim_middle|>": 151660,
+  "<|fim_pad|>": 151662,
+  "<|fim_prefix|>": 151659,
+  "<|fim_suffix|>": 151661,
+  "<|im_end|>": 151645,
+  "<|im_start|>": 151644,
+  "<|image_pad|>": 151655,
+  "<|object_ref_end|>": 151647,
+  "<|object_ref_start|>": 151646,
+  "<|quad_end|>": 151651,
+  "<|quad_start|>": 151650,
+  "<|repo_name|>": 151663,
+  "<|video_pad|>": 151656,
+  "<|vision_end|>": 151653,
+  "<|vision_pad|>": 151654,
+  "<|vision_start|>": 151652
+}

chat_template.jinja

@@ -0,0 +1,97 @@
+{%- if tools %}
+    {{- '<|im_start|>system\n' }}
+    {%- if messages[0].role == 'system' %}
+        {{- messages[0].content + '\n\n' }}
+    {%- endif %}
+    {{- "# Tools\n\nYou may call one or more functions to assist with the user query.\n\nYou are provided with function signatures within <tools></tools> XML tags:\n<tools>" }}
+    {%- for tool in tools %}
+        {{- "\n" }}
+        {{- tool | tojson }}
+    {%- endfor %}
+    {{- "\n</tools>\n\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\n<tool_call>\n{\"name\": <function-name>, \"arguments\": <args-json-object>}\n</tool_call><|im_end|>\n" }}
+{%- else %}
+    {%- if messages[0].role == 'system' %}
+        {{- '<|im_start|>system\n' + messages[0].content + '<|im_end|>\n' }}
+    {%- endif %}
+{%- endif %}
+{%- set ns = namespace(multi_step_tool=true, last_query_index=messages|length - 1) %}
+{%- for forward_message in messages %}
+    {%- set index = (messages|length - 1) - loop.index0 %}
+    {%- set message = messages[index] %}
+    {%- set tool_start = '<tool_response>' %}
+    {%- set tool_start_length = tool_start|length %}
+    {%- set start_of_message = message.content[:tool_start_length] %}
+    {%- set tool_end = '</tool_response>' %}
+    {%- set tool_end_length = tool_end|length %}
+    {%- set start_pos = (message.content|length) - tool_end_length %}
+    {%- if start_pos < 0 %}
+        {%- set start_pos = 0 %}
+    {%- endif %}
+    {%- set end_of_message = message.content[start_pos:] %}
+    {%- if ns.multi_step_tool and message.role == "user" and not(start_of_message == tool_start and end_of_message == tool_end) %}
+        {%- set ns.multi_step_tool = false %}
+        {%- set ns.last_query_index = index %}
+    {%- endif %}
+{%- endfor %}
+{%- for message in messages %}
+    {%- if (message.role == "user") or (message.role == "system" and not loop.first) %}
+        {{- '<|im_start|>' + message.role + '\n' + message.content + '<|im_end|>' + '\n' }}
+    {%- elif message.role == "assistant" %}
+        {%- set content = message.content %}
+        {%- set reasoning_content = '' %}
+        {%- if message.reasoning_content is defined and message.reasoning_content is not none %}
+            {%- set reasoning_content = message.reasoning_content %}
+        {%- else %}
+            {%- if '</think>' in message.content %}
+                {%- set content = (message.content.split('</think>')|last).lstrip('\n') %}
+                {%- set reasoning_content = (message.content.split('</think>')|first).rstrip('\n') %}
+                {%- set reasoning_content = (reasoning_content.split('<think>')|last).lstrip('\n') %}
+            {%- endif %}
+        {%- endif %}
+        {%- if loop.index0 > ns.last_query_index %}
+            {%- if loop.last or (not loop.last and reasoning_content) %}
+                {{- '<|im_start|>' + message.role + '\n<think>\n' + reasoning_content.strip('\n') + '\n</think>\n\n' + content.lstrip('\n') }}
+            {%- else %}
+                {{- '<|im_start|>' + message.role + '\n' + content }}
+            {%- endif %}
+        {%- else %}
+            {{- '<|im_start|>' + message.role + '\n' + content }}
+        {%- endif %}
+        {%- if message.tool_calls %}
+            {%- for tool_call in message.tool_calls %}
+                {%- if (loop.first and content) or (not loop.first) %}
+                    {{- '\n' }}
+                {%- endif %}
+                {%- if tool_call.function %}
+                    {%- set tool_call = tool_call.function %}
+                {%- endif %}
+                {{- '<tool_call>\n{"name": "' }}
+                {{- tool_call.name }}
+                {{- '", "arguments": ' }}
+                {%- if tool_call.arguments is string %}
+                    {{- tool_call.arguments }}
+                {%- else %}
+                    {{- tool_call.arguments | tojson }}
+                {%- endif %}
+                {{- '}\n</tool_call>' }}
+            {%- endfor %}
+        {%- endif %}
+        {{- '<|im_end|>\n' }}
+    {%- elif message.role == "tool" %}
+        {%- if loop.first or (messages[loop.index0 - 1].role != "tool") %}
+            {{- '<|im_start|>user' }}
+        {%- endif %}
+        {{- '\n<tool_response>\n' }}
+        {{- message.content }}
+        {{- '\n</tool_response>' }}
+        {%- if loop.last or (messages[loop.index0 + 1].role != "tool") %}
+            {{- '<|im_end|>\n' }}
+        {%- endif %}
+    {%- endif %}
+{%- endfor %}
+{%- if add_generation_prompt %}
+    {{- '<|im_start|>assistant\n' }}
+    {%- if enable_thinking is defined and enable_thinking is false %}
+        {{- '<think>\n\n</think>\n\n' }}
+    {%- endif %}
+{%- endif %}

special_tokens_map.json

@@ -0,0 +1,31 @@
+{
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "eos_token": {
+    "content": "<|im_end|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<|vision_pad|>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:aeb13307a71acd8fe81861d94ad54ab689df773318809eed3cbe794b4492dae4
+size 11422654

tokenizer_config.json

@@ -0,0 +1,240 @@
+{
+  "add_bos_token": false,
+  "add_prefix_space": false,
+  "added_tokens_decoder": {
+    "151643": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151644": {
+      "content": "<|im_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151645": {
+      "content": "<|im_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151646": {
+      "content": "<|object_ref_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151647": {
+      "content": "<|object_ref_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151648": {
+      "content": "<|box_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151649": {
+      "content": "<|box_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151650": {
+      "content": "<|quad_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151651": {
+      "content": "<|quad_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151652": {
+      "content": "<|vision_start|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151653": {
+      "content": "<|vision_end|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151654": {
+      "content": "<|vision_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151655": {
+      "content": "<|image_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151656": {
+      "content": "<|video_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "151657": {
+      "content": "<tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151658": {
+      "content": "</tool_call>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151659": {
+      "content": "<|fim_prefix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151660": {
+      "content": "<|fim_middle|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151661": {
+      "content": "<|fim_suffix|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151662": {
+      "content": "<|fim_pad|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151663": {
+      "content": "<|repo_name|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151664": {
+      "content": "<|file_sep|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151665": {
+      "content": "<tool_response>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151666": {
+      "content": "</tool_response>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151667": {
+      "content": "<think>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "151668": {
+      "content": "</think>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "additional_special_tokens": [
+    "<|im_start|>",
+    "<|im_end|>",
+    "<|object_ref_start|>",
+    "<|object_ref_end|>",
+    "<|box_start|>",
+    "<|box_end|>",
+    "<|quad_start|>",
+    "<|quad_end|>",
+    "<|vision_start|>",
+    "<|vision_end|>",
+    "<|vision_pad|>",
+    "<|image_pad|>",
+    "<|video_pad|>"
+  ],
+  "bos_token": null,
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|im_end|>",
+  "errors": "replace",
+  "extra_special_tokens": {},
+  "model_max_length": 40960,
+  "pad_token": "<|vision_pad|>",
+  "padding_side": "right",
+  "split_special_tokens": false,
+  "tokenizer_class": "Qwen2Tokenizer",
+  "unk_token": null
+}