Presentation is loading. Please wait.

Presentation is loading. Please wait.

HTTP & REST Noah Mendelsohn Tufts University Web: COMP 150-IDS: Internet Scale.

Published byLewis Gilbert Modified over 9 years ago

Similar presentations

Presentation on theme: "HTTP & REST Noah Mendelsohn Tufts University Web: COMP 150-IDS: Internet Scale."— Presentation transcript:

1 HTTP & REST Noah Mendelsohn Tufts University Email: noah@cs.tufts.edunoah@cs.tufts.edu Web: http://www.cs.tufts.edu/~noah COMP 150-IDS: Internet Scale Distributed Systems (Spring 2015) Copyright 2012, 2103 & 2015

2 © 2010 Noah Mendelsohn Architecting a universal Web  Identification: URIs  Interaction: HTTP  Data formats: HTML, JPEG, GIF, etc.

3 © 2010 Noah Mendelsohn 3 Goals  Learn why traditional architectures would not have worked for the Web  Learn the basics of HTTP (review)  Explore some interesting characteristics of HTTP  Learn the REST distributed computing architecture

4 © 2010 Noah Mendelsohn Question: What would happen if we built the Web from RPC?

5 © 2010 Noah Mendelsohn Why not use RPC for the Web?  No uniform interface –You’d need an interface definition to follow a link  No global naming  Most RPC data types poorly tuned for documents –Int, float, struct not HTML, XML, mixed-content, etc. We’ll revisit the RPC/Web question later and add some more

6 © 2010 Noah Mendelsohn HTTP in Action (review from first week)

7 © 2010 Noah Mendelsohn What Happens When We Browse a Web Page?

8 © 2010 Noah Mendelsohn The user clicks on a link URI is http://webarch.noahdemo.com/demo1/test.html

9 © 2010 Noah Mendelsohn The http “scheme” tells client to send HTTP GET msg HTTP GET URI is http://webarch.noahdemo.com/demo1/test.html

10 © 2010 Noah Mendelsohn The server is identified by DNS name in the URI HTTP GET Host: webarch.noahdemo.com URI is http://webarch.noahdemo.com/demo1/test.html

11 © 2010 Noah Mendelsohn HTTP GET Host: webarch.noahdemo.com GET /demo1/test.html HTTP/1.0 Host: webarch.noahdemo.com User-Agent: Noahs Demo HttpClient v1.0 Accept: */* Accept-language: en-us URI is http://webarch.noahdemo.com/demo1/test.html demo1/test.html The client sends an HTTP GET

12 © 2010 Noah Mendelsohn HTTP GET Host: webarch.noahdemo.com GET /demo1/test.html HTTP/1.0 Host: webarch.noahdemo.com User-Agent: Noahs Demo HttpClient v1.0 Accept: */* Accept-language: en-us URI is http://webarch.noahdemo.com/demo1/test.html demo1/test.html The client sends an HTTP GET Note that HTTP is a text-based protocol …but it can carry binary entity bodies such as image/jpeg

13 © 2010 Noah Mendelsohn The server sends an HTTP Response HTTP GET HTTP RESPONSE Host: webarch.noahdemo.com demo1/test.html HTTP/1.1 200 OK Date: Tue, 28 Aug 2007 01:49:33 GMT Server: Apache Transfer-Encoding: chunked Content-Type: text/html Demo #1 A very simple Web page HTTP Status Code 200 Means Success!

14 © 2010 Noah Mendelsohn The server sends an HTTP Response HTTP GET HTTP RESPONSE Host: webarch.noahdemo.com demo1/test.html HTTP/1.1 200 OK Date: Tue, 28 Aug 2007 01:49:33 GMT Server: Apache Transfer-Encoding: chunked Content-Type: text/html Demo #1 A very simple Web page The “representation” returned is an HTML document

15 © 2010 Noah Mendelsohn Host: webarch.noahdemo.com demo1/test.html The server sends an HTTP Response HTTP GET HTTP RESPONSE HTTP/1.1 200 OK Date: Tue, 28 Aug 2007 01:49:33 GMT Server: Apache Transfer-Encoding: chunked Content-Type: text/html Demo #1 A very simple Web page The HTML for the page.

16 © 2010 Noah Mendelsohn HTTP Methods, Headers & Extensibility

17 © 2010 Noah Mendelsohn HTTP Requests always have a method HTTP REQUEST Host: webarch.noahdemo.com GET /demo1.html HTTP/1.0 Host: webarch.noahdemo.com User-Agent: Noahs Demo HttpClient v1.0 Accept: */* Accept-language: en-us URI is http://webarch.noahdemo.com/demo1/test.html GET

18 © 2010 Noah Mendelsohn HTTP Headers GET /demo1.html HTTP/1.0 Host: webarch.noahdemo.com User-Agent: Noahs Demo HttpClient v1.0 Accept: */* Accept-language: en-us Request headers HTTP/1.1 200 OK Date: Tue, 28 Aug 2007 01:49:33 GMT Server: Apache Transfer-Encoding: chunked Content-Type: text/html Demo #1 A very simple Web page Response headers

19 © 2010 Noah Mendelsohn HTTP Extension Points  HTTP –New headers (quite common) –New methods (rare) –New versions of HTTP itself (e.g. HTTP 1.1) (very rare) –New status codes (very rare)  Technologies used by HTTP –Media types (text/html, image/jpec, application/…something new?... –Languages (e.g. en-us) –Transfer encodings (e.g. gzip)

20 © 2010 Noah Mendelsohn HTTP Protocol for a Discoverable Web

21 © 2010 Noah Mendelsohn HTTP: the protocol for a discoverable Web  HTTP provides a uniform interface to all resources  You don’t have to know in advance what a resource is like to access it with HTTP…so, you or your software can explore the Web in ad-hoc ways  Self-describing: when a response comes back, you can figure out what it means  Using HTTP to access a resource doesn’t damage the resource  For all this to work, you must use HTTP…and you must use it properly!

22 © 2010 Noah Mendelsohn HTTP Requests always have a method HTTP REQUEST Host: webarch.noahdemo.com GET /demo1.html HTTP/1.0 Host: webarch.noahdemo.com User-Agent: Noahs Demo HttpClient v1.0 Accept: */* Accept-language: en-us URI is http://webarch.noahdemo.com/demo1/test.html GET

23 © 2010 Noah Mendelsohn HTTP Methods MethodMeaning GET Retrieve a representation of the resource but do not change anything! POST Update the resource or a dependent resource base on supplied representation HEAD Optimized GET – retrieves only headers, used for checking caches, etc. PUT Create or completely replace the resource base on supplied representation DELETE Delete the resource identified by the URI GET is very carefully defined to make the Web scalable and discoverable.

24 © 2010 Noah Mendelsohn HTTP Methods MethodMeaning GET Retrieve a representation of the resource but do not change anything! POST Update the resource or a dependent resource base on supplied representation HEAD Optimized GET – retrieves only headers, used for checking caches, etc. PUT Create or completely replace the resource base on supplied representation DELETE Delete the resource identified by the URI GET is very carefully defined to make the Web scalable and discoverable.

25 © 2010 Noah Mendelsohn HTTP GET Has A Very Particular Meaning HTTP GET Host: webarch.noahdemo.com GET /demo1.html HTTP/1.0 Host: webarch.noahdemo.com User-Agent: Noahs Demo HttpClient v1.0 Accept: */* Accept-language: en-us URI is http://webarch.noahdemo.com/demo1/test.html GET It’s always safe to try a GET on any URI. In fact, that’s why search engines like Google can safely crawl the Web!

26 © 2010 Noah Mendelsohn It’s always safe to try a GET on any URI. In fact, that’s why search engines like Google can safely crawl the Web! But GET is so convenient that some people use it in the wrong places…if you’re changing the state of a resource you must use PUT or POST! HTTP GET Has A Very Particular Meaning

27 © 2010 Noah Mendelsohn Demonstration #3: http://webarch.noahdemo.com/MisuseGet/ http://webarch.noahdemo.com/MisuseGet/

28 © 2010 Noah Mendelsohn Using HTTP Properly  If GET is used instead of POST, your applications may update accidentally  If too many applications misuse GET, then it will become impossible to explore the web –If you click a link, you might break something..you would have to ask about each link before clicking! –Search crawlers couldn’t be used…there would be no Google! Read TAG Finding “URIs, Addressability, and the use of HTTP GET and POST” http://www.w3.org/2001/tag/doc/whenToUseGet.html http://www.w3.org/2001/tag/doc/whenToUseGet.html

29 © 2010 Noah Mendelsohn Web Interaction: Highlights  HTTP: a uniform way to interact with resources  Promotes interoperability & discoverablility  Use HTTP properly: GET is special!  HTTP has features like content negotiation and headers that let you adapt content for your users

30 © 2010 Noah Mendelsohn The Self-Describing Web

31 © 2010 Noah Mendelsohn The Self-Describing Web  Everything you need to understand a response is in the response…  …to find the instructions, read RFC 3989…  …and follow your nose!

32 © 2010 Noah Mendelsohn Follow your nose  The Web community’s term for:  Going step by step through a Web response and the pertinent specifications…  …to figure out what the response means  All the specifications you need are found (transitively) from RFC 3986!  Thus there is a quite rigorous sense in which the Web is browsable and explorable Read TAG Finding “The Self-Describing Web” http://www.w3.org/2001/tag/doc/selfDescribingDocuments

33 © 2010 Noah Mendelsohn The server sends an HTTP Response HTTP GET HTTP RESPONSE Host: webarch.noahdemo.com demo1/test.html HTTP/1.1 200 OK Date: Tue, 28 Aug 2007 01:49:33 GMT Server: Apache Transfer-Encoding: chunked Content-Type: text/html Demo #1 A very simple Web page The “representation” returned is an HTML document

34 © 2010 Noah Mendelsohn Stateful and Stateless Protocols

35 © 2010 Noah Mendelsohn Stateful and Stateless Protocols  Stateful: server knows which step (state) has been reached  Stateless: –Client remembers the state, sends to server each time –Server processes each request independently  Can vary with level –Many systems like Web run stateless protocols (e.g. HTTP) over streams…at the packet level, TCP streams are stateful –HTTP itself is mostly stateless, but many HTTP requests (typically POSTs) update persistent state at the server

36 © 2010 Noah Mendelsohn Advantages of stateless protocols  Protocol usually simpler  Server processes each request independently  Load balancing and restart easier  Typically easier to scale and make fault-tolerant  Visibility: individual requests more self-describing

37 © 2010 Noah Mendelsohn Advantages of stateful protocols  Individual messages carry less data  Server does not have to re-establish context each time  There’s usually some changing state at the server at some level, except for completely static publishing systems

38 © 2010 Noah Mendelsohn HTTP is Stateless (usually)  HTTP is fundamentally stateless…response determined entirely from GET request & URI –(unless resource itself changes!!)  In practice: –Cookies stored in browser tied to session state and login status –OK: determine access rights from cookie –NOT OK: return different content based on cookie –WHY?: On the Web, we identify with URIs, not cookies!  Of course, the state of resources does change: –E.g. when we add something to a shopping cart 38

39 © 2010 Noah Mendelsohn REST

40 © 2010 Noah Mendelsohn REST – REpresenational State Transfer  What is REST? –A distributed system architecture –In practice: implemented using HTTP  Key features –States transferred using representations (HTTP requests/responses) –Server is stateless –URIs (and request data if provided) convey state to application  History –Described by Roy Fielding in his PhD thesis –Came after Tim BL invented the Web, but… –…Roy was very influential in development of formal specifications of and details of HTTP and URIs Fielding’s PhD Thesis: http://www.ics.uci.edu/~fielding/pubs/dissertation/fielding_dissertation.pdfhttp://www.ics.uci.edu/~fielding/pubs/dissertation/fielding_dissertation.pdf

41 © 2010 Noah Mendelsohn Building a REST application  All data communicated using HTTP GET / POST –Unit of interaction is document –Formats like JSON, XML, RDF, N3 used to convey data  State of navigation typically captured in URIs: –URI to start application –URI for 2 nd step –URI for 3 rd step –Captures client parameters & input in URIs (e.g. search parms, flight numbers)  States of a REST application are linkable, bookmarkable  Examples: –http://webarch.noahdemo.com/MisuseGet/http://webarch.noahdemo.com/MisuseGet/ –Google search –Google maps (AJAX example: uses REST recursively)

42 © 2010 Noah Mendelsohn A Complex REST Application Google Maps Warning: some details of Google’s implementation may have changed since this presentation was prepared

43 © 2010 Noah Mendelsohn AJAX Application – Google Maps Images retrieved in segments using ordinary Web HTTP Requests

44 © 2010 Noah Mendelsohn AJAX Application – Google Maps JavaScript at client tracks mouse and moves images for smooth panning… asynchronously requests new image tiles in background

45 © 2010 Noah Mendelsohn AJAX Application – Google Maps The Web is used to retrieve an ordinary file listing points of interest…. (used to be XML but could use JSON, other?) hotels in hawthorne pizza in atlanta Wellesley Inn 540 Saw Mill River Rd. Elmsford, NY 10523

46 © 2010 Noah Mendelsohn AJAX Application – Google Maps …Data used to drive formatting of points of interest hotels in hawthorne pizza in atlanta Wellesley Inn 540 Saw Mill River Rd. Elmsford, NY 10523

47 © 2010 Noah Mendelsohn AJAX Application – Google Maps …and XSLT in the browser converts that to HTML hotels in hawthorne pizza in atlanta Wellesley Inn 540 Saw Mill River Rd. Elmsford, NY 10523

48 © 2010 Noah Mendelsohn AJAX Application – Google Maps

49 © 2010 Noah Mendelsohn Question: What would happen if we built the Web from RPC? --- Revisited!

50 © 2010 Noah Mendelsohn Why not use RPC for the Web?  No uniform interface –You’d need an interface definition to follow a link  No global naming  Most RPC data types poorly tuned for documents

51 © 2010 Noah Mendelsohn Why not use RPC for the Web?  No uniform interface –You’d need an interface definition to follow a link  No global naming  Most RPC data types poorly tuned for documents  No safe methods

52 © 2010 Noah Mendelsohn Why not use RPC for the Web?  No uniform interface –You’d need an interface definition to follow a link  No global naming  Most RPC data types poorly tuned for documents  No safe methods  No content negotiation

53 © 2010 Noah Mendelsohn HTTP Content Negotiation

54 © 2010 Noah Mendelsohn Content negotiation for language HTTP GET Host: webarch.noahdemo.com GET /demo1/test.html HTTP/1.0 Host: webarch.noahdemo.com User-Agent: Noahs Demo HttpClient v1.0 Accept: */* Accept-language: en-us URI is http://webarch.noahdemo.com/demo1/test.html Accept-language: en-us I prefer English, please! But: it is OK to also provide individual URIs for each language version

55 © 2010 Noah Mendelsohn Content negotiation for device HTTP GET Host: webarch.noahdemo.com URI is http://webarch.noahdemo.com/demo1/test.html GET /demo1/test.html HTTP/1.0 Host: webarch.noahdemo.com User-Agent: Noahs Demo HttpClient v1.0 Accept: */* Accept-language: en-us User-Agent: Mozilla/4.0 Firefox

56 © 2010 Noah Mendelsohn Content negotiation for device Host: webarch.noahdemo.com GET /demo1/test.html HTTP/1.0 Host: webarch.noahdemo.com User-Agent: Noahs Demo HttpClient v1.0 Accept: */* Accept-language: en-us URI is http://webarch.noahdemo.com/demo1/test.html User-Agent: Cell Phone Browser V1.1 Cell phone browser HTTP GET

57 © 2010 Noah Mendelsohn Device independence The same URI works across devices… …you can see my reservation from your cell phone Even phone numbers are on the Web

58 © 2010 Noah Mendelsohn Summary

59 © 2010 Noah Mendelsohn Summary  HTTP and the REST model are designed to meet the unique needs of the Web  Document-oriented  Discoverable  Stateless  Extensible  Global scale  Supports unique features like content negotiation

Download ppt "HTTP & REST Noah Mendelsohn Tufts University Web: COMP 150-IDS: Internet Scale."

Similar presentations

REST Vs. SOAP.

REST Vs. SOAP.
HTTP HyperText Transfer Protocol. HTTP Uses TCP as its underlying transport protocol Uses port 80 Stateless protocol (i.e. HTTP Server maintains no information.

HTTP HyperText Transfer Protocol. HTTP Uses TCP as its underlying transport protocol Uses port 80 Stateless protocol (i.e. HTTP Server maintains no information.
16-Jun-15 HTTP Hypertext Transfer Protocol. 2 HTTP messages HTTP is the language that web clients and web servers use to talk to each other HTTP is largely.

16-Jun-15 HTTP Hypertext Transfer Protocol. 2 HTTP messages HTTP is the language that web clients and web servers use to talk to each other HTTP is largely.
HTTP Hypertext Transfer Protocol. HTTP messages HTTP is the language that web clients and web servers use to talk to each other –HTTP is largely “under.

HTTP Hypertext Transfer Protocol. HTTP messages HTTP is the language that web clients and web servers use to talk to each other –HTTP is largely “under.
How the web works: HTTP and CGI explained

How the web works: HTTP and CGI explained
HTTP Presented By: Holly Mortinson Amy Drout Kyle Balmer & Matt Conklin.

HTTP Presented By: Holly Mortinson Amy Drout Kyle Balmer & Matt Conklin.
Chapter 2 Application Layer Computer Networking: A Top Down Approach Featuring the Internet, 3 rd edition. Jim Kurose, Keith Ross Addison-Wesley, July.

Chapter 2 Application Layer Computer Networking: A Top Down Approach Featuring the Internet, 3 rd edition. Jim Kurose, Keith Ross Addison-Wesley, July.
Definitions, Definitions, Definitions Lead to Understanding.

Definitions, Definitions, Definitions Lead to Understanding.
HTTP Overview Vijayan Sugumaran School of Business Administration Oakland University.

HTTP Overview Vijayan Sugumaran School of Business Administration Oakland University.
1 The World Wide Web. 2  Web Fundamentals  Pages are defined by the Hypertext Markup Language (HTML) and contain text, graphics, audio, video and software.

1 The World Wide Web. 2  Web Fundamentals  Pages are defined by the Hypertext Markup Language (HTML) and contain text, graphics, audio, video and software.
2/9/2004 Web and HTTP February 9, 2004. 2/9/2004 Assignments Due – Reading and Warmup Work on Message of the Day.

2/9/2004 Web and HTTP February 9, /9/2004 Assignments Due – Reading and Warmup Work on Message of the Day.
Hypertext Transport Protocol CS - 328 Dick Steflik.

Hypertext Transport Protocol CS Dick Steflik.
Client, Server, HTTP, IP Address, Domain Name. Client-Server Model Client Bob Yahoo Server yahoo.com/finance.html A text file named finance.html.

Client, Server, HTTP, IP Address, Domain Name. Client-Server Model Client Bob Yahoo Server yahoo.com/finance.html A text file named finance.html.
CS 415 N-Tier Application Development By Umair Ashraf July 6,2013 National University of Computer and Emerging Sciences Lecture # 9 Introduction to Web.

CS 415 N-Tier Application Development By Umair Ashraf July 6,2013 National University of Computer and Emerging Sciences Lecture # 9 Introduction to Web.
Web Architecture Dr. Frank McCown Intro to Web Science Harding University This work is licensed under a Creative Commons Attribution-NonCommercial- ShareAlike.

Web Architecture Dr. Frank McCown Intro to Web Science Harding University This work is licensed under a Creative Commons Attribution-NonCommercial- ShareAlike.
Simple Web Services. Internet Basics The Internet is based on a communication protocol named TCP (Transmission Control Protocol) TCP allows programs running.

Simple Web Services. Internet Basics The Internet is based on a communication protocol named TCP (Transmission Control Protocol) TCP allows programs running.
FTP (File Transfer Protocol) & Telnet

FTP (File Transfer Protocol) & Telnet
Simple Web Services. Internet Basics The Internet is based on a communication protocol named TCP (Transmission Control Protocol) TCP allows programs running.

Simple Web Services. Internet Basics The Internet is based on a communication protocol named TCP (Transmission Control Protocol) TCP allows programs running.
HyperText Transfer Protocol (HTTP).  HTTP is the protocol that supports communication between web browsers and web servers.  A “Web Server” is a HTTP.

HyperText Transfer Protocol (HTTP).  HTTP is the protocol that supports communication between web browsers and web servers.  A “Web Server” is a HTTP.
CP476 Internet Computing Lecture 5 : HTTP, WWW and URL 1 Lecture 5. WWW, HTTP and URL Objective: to review the concepts of WWW to understand how HTTP works.

CP476 Internet Computing Lecture 5 : HTTP, WWW and URL 1 Lecture 5. WWW, HTTP and URL Objective: to review the concepts of WWW to understand how HTTP works.

Similar presentations

Ads by Google