Suggestion based on this model's concept
Hi IBM Team!
Great job on another new AI experiment!
I’ve been testing similar methods for rephrasing prompts, but your model seems like a big improvement.
I’d like to suggest some things to make it even more versatile or general use:
Expand beyond RAG use cases: Adjust the model to handle everyday tasks, not just retrieval-augmented scenarios. This would let people use it for general rewrites, like improving emails or instructions.
Single-input rewriting: Add a feature where users can paste a prompt (e.g. "explain quantum physics") and get a cleaner, optimized version in one step. No full conversation required.
Keep the model’s ability to understand user intent while relying on prior conversation history.
I'd love to hear what you think, if possible.
Hello, and thanks for the comments and suggestions!
Just wanted to point out that this adapter doesn't have to be used for RAG only. It was developed as a more general query rewrite capability that can accompany conversational interfaces to other systems. For example, although not shown in the model card, we did test it intensively on a use case involving conversational access to a database. There, it was quite important to have query rewrites that capture precisely the intent of the user.
No, we did not want to include single-input rewriting in this particular adapter. That type of rewriting is more open-ended and seems to target specific optimization scenarios, where some queries may lead to better performance than others. That type of query rewrite may also be dependent on the application. Our query rewrite, included in this adapter, is more basic. It simply does expansion of all the implicit references or shortcuts in the query based on the prior dialog, and nothing else. It is a minimal type of rewriting, just to make the question standalone (and useable without the prior part of the dialog). Therefore, it makes sense only for cases where there is a prior part of the dialog (and not a single-turn question). For what you're suggesting, a different more specialized adapter may make sense.
I hope this helps.