SDA-3 protocol
This post introduces SDA-3, a protocol for inferring the structure of an LLM’s embedding space through observable outputs, without relying on access to internal weights or hidden states.
Tag
hidden-representations
Hidden Representations Without Hidden Layers
What can be inferred about a language model’s semantic structure when its hidden states, weights, and intermediate representations are inaccessible?