Yi Cui

onekq

AI & ML interests

Benchmark, Code Generation Model

Recent Activity

Organizations

MLX Community's profile picture ONEKQ AI's profile picture

onekq's activity

posted an update 1 day ago
posted an update 2 days ago
posted an update 4 days ago
posted an update 6 days ago
view post
Post
3719
Folks, let's get ready.πŸ₯³ We will be busy soon. πŸ˜…πŸ€—https://github.com/huggingface/transformers/pull/36878
replied to their post 6 days ago
replied to their post 7 days ago
posted an update 7 days ago
view post
Post
1553
I like to benchmark πŸ’΅o1-proπŸ’΅ but it is way too expensive for me πŸ€¦β€β™‚οΈ
Β·
replied to their post 8 days ago
view reply

You can infer on CPU, but it will be very very slow πŸ˜•

posted an update 8 days ago
view post
Post
442
The majority of OneSQL downloads went to the lowest end (7B-GGUF). I didn't expect this at all. The accuracy of this variant is the lowest, as the tradeoff for its small size.

Like all LLMs, coding models hallucinate too. The wrong answers they give are only inches away from the right answers. In case of SQL, the code is not only presentable, but also executable, hence returning the wrong rows.

I'm clueless, and curious how users will deal with this.
  • 3 replies
Β·
New activity in onekq-ai/OneSQL-v0.1-Qwen-7B-GGUF 9 days ago
posted an update 10 days ago
view post
Post
2265
Introducing πŸŽ‰ OneSQL-v0.1πŸ₯³, our first text-to-SQL model based on Qwen2.5-Coder. This model has achieved an EX score of 63.33 on the BIRD leaderboard (https://bird-bench.github.io/).

The model family includes 7B and 32B,
onekq-ai/onesql-v01-qwen-67d8e3eb1611c5532bb90c5f
and can be also found on Ollama (https://ollama.com/onekq/OneSQL-v0.1-Qwen)

My goal is to make OneSQL the most usable open-weights model for text-to-SQL. I'm currently working on best practices to help users use this model the right away and avoid pitfalls. After that, I plan to train the next version to push for a higher EX score.

Enjoy this model and feel free to share comments/questions πŸ€—
  • 1 reply
Β·