Bhaskara Reddy Sannapureddy’s Post

View profile for Bhaskara Reddy Sannapureddy, graphic

Senior Project Manager|Infosys|B.E(Hons) BITS, Pilani & PGD in ML & AI at IIITB & Master of Science in ML & AI at LJMU, UK | (Building AI for World & Create AICX)(Learn, Unlearn, Relearn)

Explore The Geometry of Concepts in LLMs Studies the geometry of categorical concepts and how the hierarchical relations between them are encoded in LLMs. Finding from the paper: "Simple categorical concepts are represented as simplices, hierarchically related concepts are orthogonal in a sense we make precise, and (in consequence) complex concepts are represented as polytopes constructed from direct sums of simplices, reflecting the hierarchical structure." arxiv.org/abs/2406.01506 This paper sounds fascinating! The geometric representation of concepts in LLMs is a brilliant way to understand their inner workings.

  • No alternative text description for this image

To view or add a comment, sign in

Explore topics