Andrew ShieldsFeb 9
Contexts and the supposed irrelevance of meaning in Shannon’s "Mathematical Theory of Communication”. #111Words #CEShannon #Meaning #Context #InformationTheory https://111-words.ghost.io/contexts-and-the-supposed-irrelevance-of-meaning-in-shannons-mathematical-theory-of-communication/
Contexts and the supposed irrelevance of meaning in Shannon’s "Mathematical Theory of Communication"

Meaning may be "irrelevant" to C. E. Shannon's "Mathematical Theory of Communication", but context is not: the transmission of a message begins with an "information source" and arrives at a "destination." The distance between these two contexts, the source and the destination, creates the possibility of interference in the transmission

111 Words
Andrew ShieldsFeb 8
The irrelevance of content from Shannon’s theory of communication to Page Rank and Large Language Models. #111Words #CEShannon #Information #Google #PageRank #LargeLanguageModels #Content #Truth https://111-words.ghost.io/the-irrelevance-of-content-from-shannons-theory-of-communication-to-page-rank-and-large-language-models/
The irrelevance of content from Shannon’s theory of communication to Page Rank and Large Language Models

In his 1948 paper "A Mathematical Theory of Communication", C. E. Shannon put aside the issue of the meaning of what is communicated: "These semantic aspects of communication are irrelevant to the engineering problem." That is, Shannon's "information" is separated from content and hence also from truth. The irrelevance of

111 Words