In new work from
@tomjiralerspong, we find that some claims in "Persona Vectors" from Anthropic likely fail to replicate on real chat data.
Thomas discusses failures in relying on synthetic data for experimentation, and provides recommendations for researchers.