Update README.md

README.md

@@ -196,9 +196,7 @@ $$\text{GRPO} = -\mathbb{E}_{(s,a)}\left[\frac{\pi(a|s)}{\pi_{\text{old}}(a|s)}
 
 1. **Concatenate** `prompt_ids + completion_ids`
 
-2. **Run forward pass through old policy** to compute
-
-   $$\pi_{\text{old}}(a|s)$$
+2. **Run forward pass through old policy** to compute \\(\pi_{\text{old}}(a|s)\\)
 
    
    - This actually happens only once at the first iteration when we create the rollout