NisargBhavsar25/koel-benchmark
Viewer
•
Updated
•
18.5k
•
54
Nisarg Bhavsar
NisargBhavsar25
·
AI & ML interests
None yet
Recent Activity
updated
a dataset
6 days ago
NisargBhavsar25/koel-benchmark
published
a dataset
7 days ago
NisargBhavsar25/koel-benchmark
new activity
10 months ago
stepfun-ai/GOT-OCR2_0:T4 - bfloat 16 not support
Organizations
updated
a
dataset
6 days ago
published
a
dataset
7 days ago
T4 - bfloat 16 not support
10
#2 opened 10 months ago
by
SylvainV
liked
a
model
12 months ago
reacted to
gsarti's
post with ❤️
over 1 year ago
Post
2157
🔍 Today's pick in Interpretability & Analysis of LMs: Do language models plan ahead for future tokens? by W. Wu
@jxm
@lionellevine
This work aims to evaluate whether language models exhibit implicit planning during generation.
Authors propose two hypotheses that could result in planning-like behavior:
- Pre-caching: the model engages in computation that is functional to future, but not current, predictions.
- Breadcrumbs: Features contributing to the current prediction happen to also be the ones improving future ones.
To validate which behavior is observed in practice, authors note that off-diagonal gradients for weight matrices across the model are the ones responsible for pre-caching, and craft a variant of gradient descent (myopic descent) to remove such terms from the optimization procedure.
Using a synthetic dataset, authors demonstrate that pre-caching occurs in Transformers language models. However, for natural language settings the LM is observed to leverage breadcrumbs from previous passes even in the case of myopic training, rendering the latter hypothesis more plausible to account for model behavior.
📄 Paper: Do language models plan ahead for future tokens? (2404.00859)
🔍 All daily picks: https://huggingface.co/collections/gsarti/daily-picks-in-interpretability-and-analysis-ofc-lms-65ae3339949c5675d25de2f9
This work aims to evaluate whether language models exhibit implicit planning during generation.
Authors propose two hypotheses that could result in planning-like behavior:
- Pre-caching: the model engages in computation that is functional to future, but not current, predictions.
- Breadcrumbs: Features contributing to the current prediction happen to also be the ones improving future ones.
To validate which behavior is observed in practice, authors note that off-diagonal gradients for weight matrices across the model are the ones responsible for pre-caching, and craft a variant of gradient descent (myopic descent) to remove such terms from the optimization procedure.
Using a synthetic dataset, authors demonstrate that pre-caching occurs in Transformers language models. However, for natural language settings the LM is observed to leverage breadcrumbs from previous passes even in the case of myopic training, rendering the latter hypothesis more plausible to account for model behavior.
📄 Paper: Do language models plan ahead for future tokens? (2404.00859)
🔍 All daily picks: https://huggingface.co/collections/gsarti/daily-picks-in-interpretability-and-analysis-ofc-lms-65ae3339949c5675d25de2f9