Proving and Improving the Platonic Representation Hypothesis with JEPAs
Whether models trained on different modalities converge to the same representation of the world is central to AI. The Platonic Representation Hypothesis (PRH) conjectures that they do as they scale, but without a proof it offers neither a guarantee nor a recipe. We turn the hypothesis into a theorem. First, we prove a \emph{Platonic Representation Theorem}: Joint-Embedding Predictive Architectures (JEPAs) trained separately on any number of modalities learn the same representation up to one…
arXivLabs is a framework for developing and sharing arXiv features, emphasizing openness and user privacy.
arXivLabs allows collaborators to develop and share new arXiv features.
The platform values openness, community, and user data privacy.
arXiv only works with partners that align with these values.
Summarised automatically by AI from the original article by Hacker News. AI can make mistakes, so check the original for details.
arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website.
Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them.
Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
Read the full story on Hacker NewsThat's the opening of the story. The full piece is published by Hacker News.