Update README.md

README.md

@@ -208,7 +208,7 @@ model = AutoModelForCausalLM.from_pretrained(
     _attn_implementation = "eager", # also supports flash_attention_2
 ).cuda()
 
-query = "hello. how are you?"
+query = "What is the capital city of South Korea?"
 tokenizer = AutoTokenizer.from_pretrained(
     "Motif-Technologies/Motif-2.6B", 
     trust_remote_code = True, 
@@ -223,12 +223,12 @@ input_ids = tokenizer.apply_chat_template(
     return_tensors='pt',
 ).cuda()
 
-res = model.generate(input_ids)[0]
-print(tokenizer.decode(res[input_ids.shape[-1]:], skip_special_tokens = True))
+output = model.generate(input_ids, max_new_tokens=128, pad_token_id=tokenizer.eos_token_id)
+output = tokenizer.decode(res[0, input_ids.shape[-1]:], skip_special_tokens = True)
+print(output)
 
 """
-Hello! It seems there might be a bit of a mix-up. I am an AI assistant designed to help answer questions and provide information. If you have any questions or need assistance with something, feel free to ask, and I'll do my best to help you out! 
-
-Regarding your initial question, if you were asking about the weather or a specific topic, please provide more details so I can give you an accurate response. If you meant to ask something else, feel free to clarify, and I'll be happy to assist you further.
-"""
-```
+The capital city of South Korea is Seoul. Located in the southern part of the country, Seoul is not only the largest city in South Korea but also one of the largest metropolitan areas in the world.
+It is a vibrant and dynamic city known for its rich history, cultural heritage, and modern amenities. Seoul is a major economic, cultural, and political center in East Asia, and it plays a crucial role in the region's politics, economy, and culture.
+The city is divided into different administrative districts, each with its own unique characteristics and attractions.
+"""