19 6 162

Huang Liang Hsun PRO

lianghsun

https://www.lianghsun.dev

AI & ML interests

Focused on applying deep learning in legal and scientific domains, with expertise in NLP and model fine-tuning.

Recent Activity

liked a model 1 day ago

itlwas/Llama-3.2-Taiwan-3B-Instruct-Q4_K_M-GGUF

liked a dataset 2 days ago

instruction-pretrain/ft-instruction-synthesizer-collection

posted an update 3 days ago

🖖 Let me introduce the work I've done over the past three months: 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕 and 𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕-𝗜𝗻𝘀𝘁𝗿𝘂𝗰𝘁, now open-sourced on 🤗 Hugging Face. 𝗹𝗶𝗮𝗻𝗴𝗵𝘀𝘂𝗻/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕: This model is built on top of 𝗺𝗲𝘁𝗮-𝗹𝗹𝗮𝗺𝗮/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝟯𝗕 with continual pretraining. The training dataset consists of a mixture of Traditional Chinese and multilingual texts in specific proportions, including 20B tokens of Traditional Chinese text. 𝗹𝗶𝗮𝗻𝗴𝗵𝘀𝘂𝗻/𝗟𝗹𝗮𝗺𝗮-𝟯.𝟮-𝗧𝗮𝗶𝘄𝗮𝗻-𝟯𝗕-𝗜𝗻𝘀𝘁𝗿𝘂𝗰𝘁: This is a fine-tuned conversational model based on the foundation model. This Llama-3.2-Taiwan open-source project is currently a one-person effort (yes, I did everything from text preparation — so exhausting!). If you're interested, feel free to join the Discord server for discussions. 🅱🅴🅽🅲🅷🅼🅰🆁🅺🅸🅽🅶 The evaluation was conducted using https://huggingface.co/datasets/ikala/tmmluplus, though the README page does not yet reflect the latest results. The performance is close to the previous versions, indicating that further improvements might require adding more specialized knowledge in the datasets. 🅰 🅲🅰🅻🅻 🅵🅾🆁 🆂🆄🅿🅿🅾🆁🆃 If anyone is willing to provide compute resources, it would be greatly appreciated to help this project continue and grow. 💪 --- 🏔️ Foundation model: https://huggingface.co/lianghsun/Llama-3.2-Taiwan-3B 🤖 Instruction model: https://huggingface.co/lianghsun/Llama-3.2-Taiwan-3B-Instruct ⚡ GGUF: https://huggingface.co/lianghsun/Llama-3.2-Taiwan-3B-Instruct-GGUF

View all activity

Organizations

lianghsun's activity

liked a model 1 day ago

itlwas/Llama-3.2-Taiwan-3B-Instruct-Q4_K_M-GGUF

Text Generation • Updated 3 days ago • 22 • 1

liked a dataset 2 days ago

instruction-pretrain/ft-instruction-synthesizer-collection

Viewer • Updated Dec 2, 2024 • 249k • 1.17k • 60

liked a dataset 4 days ago

benchang1110/Taiwan-pretrain-9B

Viewer • Updated 4 days ago • 9.28M • 26 • 2

liked a model 7 days ago

lianghsun/Llama-3.2-Taiwan-3B

Text Generation • Updated 9 days ago • 417 • 15

liked a dataset 10 days ago

win10/clean_lmsys_chat_1m-v2

Viewer • Updated 15 days ago • 14.6k • 7 • 1

liked a dataset 11 days ago

lianghsun/tw-instruct-500k

Viewer • Updated 8 days ago • 500k • 111 • 12

liked a model 12 days ago

DevQuasar/lianghsun.Llama-3.2-Taiwan-3B-Instruct-GGUF

Text Generation • Updated 13 days ago • 166 • 1

liked 2 datasets 19 days ago

Isotonic/agentinstruct-1Mv1-combined

Viewer • Updated Nov 20, 2024 • 1.04M • 60 • 5

microsoft/orca-agentinstruct-1M-v1

Viewer • Updated Nov 1, 2024 • 1.05M • 8.6k • 413

liked 2 datasets 21 days ago

togethercomputer/Long-Data-Collections

Viewer • Updated 14 days ago • 4.12M • 452 • 134

Open-Orca/OpenOrca

Viewer • Updated Oct 21, 2023 • 2.91M • 8.28k • 1.36k

liked 2 datasets 23 days ago

TheSkullery/Aether-Lite-v1.8.1

Viewer • Updated Jun 23, 2024 • 125k • 44 • 10

nvidia/ChatQA2-Long-SFT-data

Viewer • Updated Sep 9, 2024 • 117k • 106 • 20

liked a dataset 24 days ago

Hello-SimpleAI/HC3-Chinese

Viewer • Updated Jan 21, 2023 • 25.7k • 1.21k • 157

liked a model 24 days ago

lianghsun/Llama-3.2-Taiwan-1B-Instruct

Text Generation • Updated 19 days ago • 4 • 2

liked a dataset 24 days ago

THUDM/AgentInstruct

Viewer • Updated Oct 23, 2023 • 1.87k • 196 • 204

liked 4 datasets 28 days ago