Don't let the LLM speak, just probe it. - by James Padolsey
kept by eddie
By extracting an LLM's hidden state at the last prompt token and training a small MLP, you get a fast, calibrated classifier for any English criterion.