Black-box interpreters, which if we properly implement them, technically shouldn't need to have access to embeddings at all. We may need to revisit SHAP and LIME's design later.
However, we currently only preturb dense represetation. Thus we need to embed the tokens before preturb them.
We should investigate how to preturb discrete values for SHAP & LIME to make them truely black box.