README.md

metadata

base_model: unsloth/Qwen3-8B-unsloth-bnb-4bit
tags:
  - text-generation-inference
  - transformers
  - unsloth
  - qwen3
  - trl
license: apache-2.0
language:
  - en
datasets:
  - ping98k/squad-qwq-recall-1k

recall-writer

ตั้งใจจะใช้ วิธีการ recall ความรู้ใน <think> ของ qwq มาเป็น format ในการ finetune recall-writer

เพื่อที่จะ ใช้ recall-writer เป็นตัว augment data ในการไป finetune knowledge ใหม่ๆ ที่ model ยังจำไม่ได้

ผลเหมือนว่า model focus ที่ [question] อย่างเดียว และไม่สนใจใช้ประโยชน์ [knowledge] ที่ใส่ไว้เลย 😢

น่าจะยังมีปัญหาที่การเตรียม training data.

Code

from unsloth import FastLanguageModel
model, tokenizer = FastLanguageModel.from_pretrained(
    model_name = "ping98k/qwen3-8b-recall-writer-4e-2e5",
    max_seq_length = 2048,
    load_in_4bit = True,
)



messages = [
    {"role" : "user", "content" : """
Convert the given question and knowledge into memory recall traces.

[question]
What does GGG stand for?
[/question]

[knowledge]
Gigantic Giraffe Gymnastics (GGG) is an exclusive and legendary training academy designed for the most daring giraffes, where participants perform extraordinary feats of acrobatics. Defying all known principles of physics, these giraffes execute stunning acts like synchronized backflips, intricate aerial cartwheels, and breathtaking trapeze stunts high above the ground. GGG is not just a display of remarkable agility but a showcase of both strength and elegance, proving that even creatures as lanky as giraffes can master the art of gymnastics.
[/knowledge]
"""}
]
text = tokenizer.apply_chat_template(
    messages,
    tokenize = False,
    add_generation_prompt = True, # Must add for generation
    enable_thinking = False, # Disable thinking
)

from transformers import TextStreamer
_ = model.generate(
    **tokenizer(text, return_tensors = "pt").to("cuda"),
    max_new_tokens = 1512, # Increase for longer outputs!
    temperature = 0.7, top_p = 0.8, top_k = 20, # For non thinking
    streamer = TextStreamer(tokenizer, skip_prompt = True),
)

Output

Okay, the user wants me to recall as much knowledge as possible to prepare for upcoming questions. They mentioned an example about GGG, so I should focus on that first. Let me think about what GGG could stand for. Maybe it's an acronym. Common ones I know: GGG could be "Greatest Gift Giving" or "Gigantic Giraffe Gymnastics" but that seems less likely. Wait, in sports, there's the GGG (Greatest of All Time) in boxing, like Floyd Mayweather. Or maybe in technology, like Google Groups? Hmm, not sure. Let me think of other possibilities. In education, maybe a school abbreviation. Or in business, a company name. Alternatively, in gaming, perhaps a game title. I need to list possible meanings.

Wait, the user's example is just an example, so maybe they want me to recall any possible GGG meanings. Let me go through different fields. In sports, GGG could be a team name. In technology, maybe a product. In medicine, a study group. Or in general knowledge, maybe a famous acronym. Let me think of common acronyms. For instance, GGG in computing might stand for something like "Global Governance Group" or "General Graphics Group". Alternatively, in the context of the user's example, maybe it's a fictional term from a book or a movie. Alternatively, in the context of a specific field like biology, perhaps a species abbreviation. Alternatively, in the context of a famous person's initials. 

Wait, the user might be expecting me to recall any possible GGG acronyms. Let me list them out systematically. In sports, boxing has GGG as a title for Floyd Mayweather. In technology, maybe a software company. In education, perhaps a school or program. In medicine, maybe a research group. In the arts, maybe a theater group. In gaming, maybe a game's name. Alternatively, in the context of a famous quote or phrase. 

Alternatively, maybe the user is thinking of "Greatest Gift Giving" as a charity or a movement. Or "Global Giving Group". Alternatively, "Gigantic Giraffe Gymnastics" as a fictional example. Since the user's example is just an example, perhaps they want me to think of all possible meanings. Let me try to recall as much as possible. 

In sports, GGG could be a team name, like the GGG Team. In computing, maybe a group or a project. In education, maybe a program like the GGG Program for gifted students. In the context of a specific field like physics, maybe a group of researchers. Alternatively, in the context of a famous person's initials, like someone's name. 

Alternatively, in the context of a fictional universe, like in a book or a movie, GGG could be an organization. For example, in "The Lord of the Rings", there are groups like the Fellowship of the Ring, but that's not GGG. Maybe in a different franchise. 

Alternatively, in the context of a company, like Google's GGG division? Not sure. Alternatively, in the context of a university's department. 

Alternatively, in the context of a famous quote, like "GGG" standing for "Greatest Gift Giving" in a motivational context. 

Hmm, I think the key is to list as many possibilities as possible. Let me try to recall any acronyms I know that start with GGG. 

Wait, in the context of the example given by the user, maybe it's a fictional term. The user said "the example is just an example", so perhaps they are testing my ability to recall possible meanings. 

Alternatively, maybe GGG stands for "Greatest of All Time" in boxing, like Floyd Mayweather's GGG title. 

Alternatively, in the context of a game, like a game called "GGG" which is a game title. 

Alternatively, in the context of a famous group, like the GGG (Greatest Gift Giving) group. 

Alternatively, in the context of a school, like the GGG School. 

Alternatively, in the context of a research group, like the GGG Research Group. 

Alternatively, in the context of a charity, like the GGG Foundation. 

Alternatively, in the context of a fictional organization, like in a book or a movie. 

Alternatively, in the context of a famous quote, like "GGG" being an acronym for a famous phrase. 

Hmm, I need to make sure I cover as many possibilities as possible. Let me think of other acronyms starting with GGG. 

In computing, maybe a group name like the GGG Group. 

In technology, perhaps a software company's name. 

Alternatively, in the context of a famous person's initials, like someone's name. 

Alternatively, in the context of a famous event, like the GGG Conference. 

Alternatively, in the context of a famous organization, like the GGG Association. 

Alternatively, in the context of a famous university's department, like the GGG Department. 

Alternatively, in the context of a famous movie or book, like a group in the story. 

Alternatively, in the context of a famous quote, like "GGG" being an acronym for a famous saying. 

Alternatively, in the context of a famous song, like a song title. 

Alternatively, in the context of a famous landmark, like a group of landmarks. 

Alternatively, in the context of a famous invention, like a group of inventors. 

Alternatively, in the context of a famous historical event, like a group involved in the event. 

Alternatively, in the context of a famous historical figure, like a group of figures. 

Alternatively, in the context of a famous historical battle, like a group of soldiers. 

Alternatively, in the context of a famous historical document, like a group of authors. 

Alternatively, in the context of a famous historical treaty, like a group of signatories. 

Alternatively, in the context of a famous historical movement, like a group of activists. 

Alternatively, in the context of a famous historical figure's initials, like someone's name. 

Hmm, I think I've covered a lot of possibilities. Maybe I should list them all out in the knowledge tags.<|im_end|>

eval loss

• ping98k/qwen3-8b-recall-writer-4e-2e5
• ping98k/qwen3-8b-recall-writer-4e-2e4

Uploaded model

• Developed by: ping98k
• License: apache-2.0
• Finetuned from model : unsloth/Qwen3-8B-unsloth-bnb-4bit

This qwen3 model was trained 2x faster with Unsloth and Huggingface's TRL library.