Presentation is loading. Please wait.

Presentation is loading. Please wait.

Communication & Computing Madhu Sudan ( MSR New England ) Theories of.

Published byDouglas Griffith Modified over 9 years ago

Similar presentations

Presentation on theme: "Communication & Computing Madhu Sudan ( MSR New England ) Theories of."— Presentation transcript:

1 Communication & Computing Madhu Sudan ( MSR New England ) Theories of

2 of 19 Theory of Computing Turing ( 1936 ) Clean model of “universal” computer. One computer, that can be programmed (to do any computational task!) Separation of computing elements (ALU/CPU/Finite state control) from memory (RAM, tape) Needs reliable memory & reliable communication to/from memory. tape R/W head Finite state control 2

3 of 19 Theory of Communication Shannon (1948) Clean architecture for reliable communication. Needs reliable encoder + decoder (two reliable computers). Alice Bob Encoder Decoder 3

4 of 19 Role of theory? Theory layer Application 4

5 of 19 Deeply intertwined: Each needs the other! Theories & (till 1990s) technologies well-separated. Today technologies are coming together. Leads to a clash of the theories! 5 Communication vs. Computing

6 of 19 Computing principle: Give user a programming language/operating system and let them modify device freely. Communication principle: Design encoder/decoder jointly. Devices at both endpoints should be designed jointly. Do not let user program/alter their devices! 6 Clash of the Theories?

7 of 19 Consequences (without equations) Computing Option 1 Communication 7

8 of 19 Consequences (without equations) Communication Computing Option 2 8

9 of 19 Consequences (without equations) Communication Computing Option 3 9

10 of 19 Consequences in words Communicating computers are highly unstable and vulnerable. They spend lots of time updating software. Many are not programmable. Can computers communicate the way humans do? Long term issues: What are the long term prospects of our data? How will we preserve their meaning, when interpretation is changing? 10

11 of 19 A new theory? Communication Computing 11

12 of 19 New communication model A A Classical communication B B Uncertainty (about endpoints) 12

13 of 19 Aspects to study Understanding human-human communication: why is natural language so different? E.g., why is the dictionary so redundant and so ambiguous? Why are (grammatical) rules made to be broken? Semantic Communication. How can computers detect when bits are being misunderstood? How can they correct errors? What does “understanding” mean anyway? 13

14 of 19 Human-Human Communication Role of dictionary? [Juba,Kalai,Khanna,S.] 14

15 of 19 Human Communication - 2 Role of dictionary? [JKKS] Receiver/ context Sender/ context 15

16 of 19 Meaning of Bits 16

17 of 19 Semantic Communication Theorem 1: In sufficient diversity, can not communicate meaning! Main issue: generically, can not detect misunderstanding. If you can’t detect misunderstanding, shouldn’t be communicating. Why communicate at all? Computer scientist: To get *useful* data. Systems scientist: To exert remote control. Economist: To gain strategic advantage. Common theme: Communication must have a goal. Theorem 2: If we can sense progress towards the goal, then can learn meaning. Main insight: Absence of progress towards goal signals misunderstanding. Warning: Learning of meaning can be “exponentially slow” [Goldreich+Juba+S., Juba+S.] 17

18 of 19 Conclusions For Practice: Communication and computation can be bridged differently. Computers can communicate, and maintain reliability, but we have to be explicit about goals of communication, and be able to sense progress in achieving such goal. For Theory: Robust communication leads to new class of problems. Rich opportunity to bring together Math, CS, Information Theory, Economics, while learning from linguists, philosophers and communication (media) scholars. 18

19 Thank You 19

Download ppt "Communication & Computing Madhu Sudan ( MSR New England ) Theories of."

Similar presentations

Of 23 09/24/2013HLF: Reliable Meaningful Communication1 Reliable Meaningful Communication Madhu Sudan Microsoft, Cambridge, USA.

Of 23 09/24/2013HLF: Reliable Meaningful Communication1 Reliable Meaningful Communication Madhu Sudan Microsoft, Cambridge, USA.
Of 35 05/30/2012CSOI-Summer: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: Universal Semantic.

Of 35 05/30/2012CSOI-Summer: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: Universal Semantic.
Of 19 03/21/2012CISS: Beliefs in Communication1 Efficient Semantic Communication & Compatible Beliefs Madhu Sudan Microsoft, New England Based on joint.

Of 19 03/21/2012CISS: Beliefs in Communication1 Efficient Semantic Communication & Compatible Beliefs Madhu Sudan Microsoft, New England Based on joint.
Of 10 09/27/2011Communication, Computing & Technology: Communication, Computing, & Technology Madhu Sudan MSR New England.

Of 10 09/27/2011Communication, Computing & Technology: Communication, Computing, & Technology Madhu Sudan MSR New England.
Of 13 10/08/2013MSRNE 5 th Anniversary: Communication Amid Uncertainty1 Communication Amid Uncertainty Madhu Sudan Microsoft Research.

Of 13 10/08/2013MSRNE 5 th Anniversary: Communication Amid Uncertainty1 Communication Amid Uncertainty Madhu Sudan Microsoft Research.
Of 29 12/02/2013Purdue: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: -Universal Semantic.

Of 29 12/02/2013Purdue: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: -Universal Semantic.
Of 24 11/20/2012TIFR: Deterministic Communication Amid Uncertainty1 ( Deterministic ) Communication amid Uncertainty Madhu Sudan Microsoft, New England.

Of 24 11/20/2012TIFR: Deterministic Communication Amid Uncertainty1 ( Deterministic ) Communication amid Uncertainty Madhu Sudan Microsoft, New England.
Of 30 10/31/2013Cornell: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: -Universal Semantic.

Of 30 10/31/2013Cornell: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: -Universal Semantic.
Of 30 09/16/2013PACM: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: -Universal Semantic.

Of 30 09/16/2013PACM: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: -Universal Semantic.
Of 7 10/01/2013LIDS Lunch: Communication Amid Uncertainty1 Communication Amid Uncertainty Madhu Sudan Microsoft Research.

Of 7 10/01/2013LIDS Lunch: Communication Amid Uncertainty1 Communication Amid Uncertainty Madhu Sudan Microsoft Research.
Semantic Communication Madhu Sudan (based on joint work with Brendan Juba (MIT); and upcoming work with Oded Goldreich (Weizmann) & J. )

Semantic Communication Madhu Sudan (based on joint work with Brendan Juba (MIT); and upcoming work with Oded Goldreich (Weizmann) & J. )
Universal Communication Brendan Juba (MIT) With: Madhu Sudan (MIT)

Universal Communication Brendan Juba (MIT) With: Madhu Sudan (MIT)
Of 30 09/04/2012ITW 2012: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: Universal Semantic.

Of 30 09/04/2012ITW 2012: Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: Universal Semantic.
Of 29 May 2, 2011 Semantic Northwestern1 Universal Semantic Communication Madhu Sudan Microsoft Research Joint with Oded Goldreich (Weizmann)

Of 29 May 2, 2011 Semantic Northwestern1 Universal Semantic Communication Madhu Sudan Microsoft Research Joint with Oded Goldreich (Weizmann)
Of 27 01/06/2015CMI: Uncertain Communication1 Communication Amid Uncertainty Madhu Sudan Microsoft Research Based on Juba, S. (STOC 2008, ITCS 2011) Juba,

Of 27 01/06/2015CMI: Uncertain Communication1 Communication Amid Uncertainty Madhu Sudan Microsoft Research Based on Juba, S. (STOC 2008, ITCS 2011) Juba,
Of 13 October 6-7, 2010Emerging Frontiers of Information: Kickoff 1 Madhu Sudan Microsoft Research + MIT TexPoint fonts used in EMF. TexPoint fonts used.

Of 13 October 6-7, 2010Emerging Frontiers of Information: Kickoff 1 Madhu Sudan Microsoft Research + MIT TexPoint fonts used in EMF. TexPoint fonts used.
Of 14 01/03/2015ISCA-2015: Reliable Meaningful Communication1 Reliable Meaningful Communication Madhu Sudan Microsoft, Cambridge, USA.

Of 14 01/03/2015ISCA-2015: Reliable Meaningful Communication1 Reliable Meaningful Communication Madhu Sudan Microsoft, Cambridge, USA.
Multimedia Call: Lessons to be learned from research on instructed SLA by Carol chapelle Iowa State University Daniel, Rania, Alice.

Multimedia Call: Lessons to be learned from research on instructed SLA by Carol chapelle Iowa State University Daniel, Rania, Alice.
Of 10 Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: Universal Semantic.

Of 10 Uncertainty in Communication1 Communication amid Uncertainty Madhu Sudan Microsoft, Cambridge, USA Based on: Universal Semantic.
Of 12 03/22/2012CISS: Compression w. Uncertain Priors1 Compression under uncertain priors Madhu Sudan Microsoft, New England Based on joint works with:

Of 12 03/22/2012CISS: Compression w. Uncertain Priors1 Compression under uncertain priors Madhu Sudan Microsoft, New England Based on joint works with:

Similar presentations

Ads by Google