2. XML Schema Part I Introduction

3. XML Schema XML itself does not restrict what elements existing in a document. In a given application, you want to fix a vocabulary -- what elements make sense, what their types are, etc. Use a Schema to define an XML dialect MusicXML, ChemXML, VoiceXML, ADXML, etc. Restrict documents to those tags. Schema can be used to validate a document -- ie to see if it obeys the rules of the dialect.

4. Schema determine … What sort of elements can appear in the document. What elements MUST appear Which elements can appear as part of another element What attributes can appear or must appear What kind of values can/must be in an attribute.

5. 0836217462 Being a Dog is a Full-Time Job Charles Schulz 1922-11-26 2000-02-12 Peppermint Patty 1966-08-22 bold,brash, and tomboyish Snoopy 1950-10-04 extroverted beagle Schroeder 1951-05-30 brought classical music to the Peanuts Strip Lucy 1952-03-03 bossy, crabby, and selfish We start with sample XML document and reverse engineer a schema as a simple example First identify the elements: author, book, born, character, dead, isbn, library, name, qualification, title Next categorize by content model Empty: contains nothing Simple: only text nodes Complex: only sub-elements Mixed: text nodes + sub-elements Note: content model independent of comments, attributes, or processing instructions!

6. Content models Simple content model: name, born, title, dead, isbn, qualification Complex content model: libarary, character, book, author

7. Content Types We further distinguish between complex and simple content Types: Simple Type: An element with only text nodes and no child elements or attributes Complex Type: All other cases We also say (and require) that all attributes themselves have simple type

8. Content Types Simple content type: name, born, dead, isbn, qualification Complex content type: library, character, book, author, title

9. Building the schema Schema are XML documents Schema are XML documents They must contain a schema root element as such They must contain a schema root element as such...... We will discuss details in a bit -- note for now that yellow part can be excluded for now.

10. Flat schema for library Start by defining all of the simple types (including attributes): http://www.w3.org/2001/XMLSchema …/…

11. Complex types with simple content Now to complex types: Being a Dog is … “the element named title has a complex type which is a simple content obtained by extending the predefined datatype xs:string by adding the attribute defined in this schema and having the name lang.”

12. Complex Types All other types are complex types with complex content. For example:

14. <xs:attribute name="lang" type="xs:language" > <xs:element name="qualification" type="xs:string" > Same schema but with everything defined locally!

15. Dissecting Schema

16. What’s in a Schema? A Schema is an XML document (a DTD is not) Because it is an XML document, it must have a root element The root element is Within the root element, there can be Any number and combination of Inclusions Imports Re-definitions Annotations Followed by any number and combinations of Simple and complex data type definitions Element and attribute definitions Model group definitions Annotations

17. Structure of a Schema.........

18. Simple Types

19. Elements What is an element with simple type? A simple element is an XML element that can contain only text. It cannot contain any other elements or attributes. Can also add restrictions (facets) to a data type in order to limit its content, and you can require the data to match a defined pattern.

20. Example Simple Element The syntax for defining a simple element is: where xxx is the name of the element and yyy is the data type of the element. Here are some XML elements: Refsnes 37 1968-03-27 And here are the corresponding simple element definitions:

21. Common XML Schema Data Types XML Schema has a lot of built-in data types. Here is a list of the most common types: XML Schema has a lot of built-in data types. Here is a list of the most common types: xs:string xs:string xs:decimal xs:decimal xs:integer xs:integer xs:boolean xs:boolean xs:date xs:date xs:time xs:time

22. Declare Default and Fixed Values for Simple Elements Simple elements can have a default value OR a fixed value set. A default value is automatically assigned to the element when no other value is specified. In the following example the default value is "red": A fixed value is also automatically assigned to the element. You cannot specify another value. In the following example the fixed value is "red":

23. Attributes (Another simple type) All attributes are declared as simple types. Only complex elements can have attributes!

24. What is an Attribute? Simple elements cannot have attributes. Simple elements cannot have attributes. If an element has attributes, it is considered to be of complex type. If an element has attributes, it is considered to be of complex type. But the attribute itself is always declared as a simple type. But the attribute itself is always declared as a simple type. This means that an element with attributes always has a complex type definition. This means that an element with attributes always has a complex type definition.

25. How to Define an Attribute The syntax for defining an attribute is: The syntax for defining an attribute is: where xxx is the name of the attribute and yyy is the data type of the attribute. Here are an XML element with an attribute: where xxx is the name of the attribute and yyy is the data type of the attribute. Here are an XML element with an attribute: Smith Smith And here are a corresponding simple attribute definition: And here are a corresponding simple attribute definition:

26. Declare Default and Fixed Values for Attributes Attributes can have a default value OR a fixed value specified. Attributes can have a default value OR a fixed value specified. A default value is automatically assigned to the attribute when no other value is specified. In the following example the default value is "EN": A default value is automatically assigned to the attribute when no other value is specified. In the following example the default value is "EN": A fixed value is also automatically assigned to the attribute. You cannot specify another value. In the following example the fixed value is "EN": A fixed value is also automatically assigned to the attribute. You cannot specify another value. In the following example the fixed value is "EN":

27. Creating Optional and Required Attributes All attributes are optional by default. To explicitly specify that the attribute is optional, use the "use" attribute: To make an attribute required:

28. Restrictions As we will see later, simple types can have ranges put on their values These are known as restrictions

29. Complex Types

30. Complex Elements A complex element is an XML element that contains other elements and/or attributes. There are four kinds of complex elements: empty elements elements that contain only other elements elements that contain only text elements that contain both other elements and text Note: Each of these elements may (or must) contain attributes as well!

31. Examples of Complex XML Elements A complex XML element, "product", which is empty: A complex XML element, "employee", which contains only other elements: John Smith A complex XML element, "food", which contains only text: Ice cream A complex XML element, "description", which contains both elements and text: It happened on 03.03.99..

32. An Example XML Schema <xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema" elementFormDefault="qualified" attributeFormDefault="unqualified"> <xs:element name="feature" type="xs:string" maxOccurs="unbounded"/>

33. Referencing XML Schema in XML documents

34. Sample Schema header The element may contain some attributes. A schema declaration often looks something like this:......

35. Schema headers, cont. The following fragment: xmlns:xs=http://www.w3.org/2001/XMLSchemahttp://www.w3.org/2001/XMLSchema indicates that the elements and data types used in the schema (schema, element, complexType, sequence, string, boolean, etc.) come from the "http://www.w3.org/2001/XMLSchema" namespace. It also specifies that the elements and data types that come from the "http://www.w3.org/2001/XMLSchema" namespace should be prefixed with xs: !!

36. Schema header, cont. This fragment: targetNamespace=http://www.w3schools.comhttp://www.w3schools.com indicates that the elements defined by this schema (note, to, from, heading, body.) come from the "http://www.w3schools.com" namespace. This fragment: xmlns=http://www.w3schools.comhttp://www.w3schools.com indicates that the default namespace is "http://www.w3schools.com". This fragment: elementFormDefault="qualified“ indicates that any elements used by the XML instance document which were declared in this schema must be namespace qualified.

37. Referencing schema in XML This XML document has a reference to an XML Schema: Tove Jani Reminder Don't forget me this weekend!

38. Referencing schema in xml, cont. The following fragment: xmlns=http://www.w3schools.comhttp://www.w3schools.com specifies the default namespace declaration. This declaration tells the schema-validator that all the elements used in this XML document are declared in the "http://www.w3schools.com" namespace.

39. … Once you have the XML Schema Instance namespace available: xmlns:xsi=http://www.w3.org/2001/XMLSchema-instancehttp://www.w3.org/2001/XMLSchema-instance you can use the schemaLocation attribute. This attribute has two values. The first value is the namespace to use. The second value is the location of the XML schema to use for that namespace: xsi:schemaLocation="http://www.w3schools.com note.xsd"

41. Using References

42. You don't have to have the content of an element defined in the nested fashion as just shown You can define the element globally and use a reference to it instead …

43. Rooms Schema using References <xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema" elementFormDefault="qualified" attributeFormDefault="unqualified"> <xs:element name="feature" type="xs:string" maxOccurs="unbounded"/>

44. Types Both elements and attributes have types, which are defined in the Schema. One can reuse types by giving them names. OR

45. Other XML Schema Features Foreign key facility (uses Xpath) Rich datatype facility Build up datatypes by inheritance Don’t need to list all of the attributes (can say "these attributes plus others"). Restrict strings using regular expressions Namespace aware. Can restrict location of an element based on a namespaces

46. Restrictions

47. Datatype Restrictions A DTD can only say that price can be any non-markup text. Like this translated to Schemas But in Schema you can do better: Or even, make your own restrictions

48. Restriction Ranges The restrictions must be "derived" from a base type, so it's object based Preceding "derived" from "integer" Has 2 restrictions (called "facets") The first says that it must be greater than 41 The second says that it must be less than 43 XML file is "42" 42

49. FacetDescription enumeration Defines a list of acceptable values fractionDigits The maximum number of decimal places allowed. >=0 length The exact number of characters or list items allowed. >=0 maxExclusive The upper bounds for numeric values (the value must be less than the value specified) maxInclusive The upper bounds for numeric values (the value must be less than or equal to the value specified) maxLength The maximum number of characters or list items allowed. >=0 minExclusive The lower bounds for numeric values (the value must be greater than the value specified) minInclusive The lower bounds for numeric values (the value must be greater than or equal to the value specified) minLength The minimum number of characters or list items allowed >=0 pattern The sequence of acceptable characters based on a regular expression totalDigits The exact number of digits allowed. >0 whiteSpace Specifies how white space (line feeds, tabs, spaces, and carriage returns) is handled

50. Enumeration Facet <xs:simpleType> </xs:restriction></xs:simpleType></xs:element>

51. Patterns (Regular Expressions) One interesting facet is the pattern, which allows restrictions based on a regular expression One interesting facet is the pattern, which allows restrictions based on a regular expression This regular expression specifies a normal word of one or more characters: This regular expression specifies a normal word of one or more characters: </xs:restriction></xs:simpleType></xs:element>

52. Patterns (Regular Expressions) Individual characters may be repeated a specific number of times in the regular expression. Individual characters may be repeated a specific number of times in the regular expression. The following regular expression restricts the string to exactly 8 alpha-numeric characters: The following regular expression restricts the string to exactly 8 alpha-numeric characters: <xs:simpleType> </xs:restriction></xs:simpleType></xs:element>

53. Whitespace facet The "whitespace" facet controls how white space in the element will be processed There are three possible values to the whitespace facet "preserve" causes the processor to keep all whitespace as-is "replace" causes the processor to replace all whitespace characters (tabs, carriage returns, line feeds, spaces) with space characters "collapse" causes the processor to replace all strings of whitespace characters (tabs, carriage returns, line feeds, spaces) with a single space character

54. Both elements and attributes have types, which are defined in the Schema. One can reuse types by giving them names. Addr.xsd: Types OR

55. Types The usage in the XML file is identical: 1108 E. 58th St. Ryerson 155 60637 1108 E. 58th St. Ryerson 155 60637

56. Type Extensions A third way of creating a complex type is to extend another complex type (like OO inheritance) A third way of creating a complex type is to extend another complex type (like OO inheritance) <xs:sequence> </xs:sequence></xs:complexType> <xs:complexContent> <xs:sequence> </xs:sequence></xs:extension></xs:complexContent></xs:complexType>

57. Type Extensions (use) To use a type that is an extension of another, it is as though it were all defined in a single type King Arthur Round Table Camelot England

58. Simple Content in Complex Type If a type contains only simple content (text and attributes), a element can be put inside the must have either a or a This example is from the (Bridge of Death) Episode Dialog: <xs:attribute name="speaker" type="xs:string" use="required"/>

59. Model Groups Model Groups are used to define an element that has mixed content (elements and text mixed) element content Model Groups can be all the elements specified must all be there, but in any order choice any of the elements specified may or may not be there sequence all of the elements specified must appear in the specified order

60. "All" Model Group The following schema specifies 3 elements and mixed content The following XML file is valid in the above schema Title: The Holy Grail Published: Moose Author: Monty Python

61. Attributes Attributes <xs:attribute name="speaker" type="xs:string" use="required"/> … The attribute declaration is part of the type of the element.

62. Attributes If an attribute type is more complicated than a basic type, then we spell out the type in a type declaration.

63. Optional and Required Attributes All attributes are optional by default. To explicitly specify that the attribute is optional, use the "use" attribute: To make an attribute required:

64. Other XML Schema Features Foreign key facility (uses Xpath) Rich datatype facility Build up datatypes by inheritance Don’t need to list all of the attributes (can say “these attributes plus others). Restrict strings using regular expressions Namespace aware. Can restrict location of an element based on a namespaces

65. XML Schema Status Became a W3C recommendation Spring 2001 World domination expected imminently. Supported in Xalan. Supported in XML spy and other editor/validators. On the other hand: More complex than DTDs. Ultra verbose.

66. Validating a Schema By using Xeena or XMLspy or XML Notepad. When publishing hand-written XML docs, this is the way to go. By using a Java program that performs validation. When validating on-the-fly, must do it this way

67. Some guidelines for Schema design

68. Designing a Schema Analogous to database schema design --- look for intuitive names Can start with an E-R diagram, and then convert Attributes to Attributes Subobjects to Subelements Relationships to IDREFS Normalization? Still makes sense to avoid repetition whenever possible– If you have an Enrolment document, only list Ids of students, not their names. Store names in a separate document Leave it to tools to connect them

69. Designing a Schema (cont.) Difficulties: Many more degrees of freedom than with database schemas: e.g. one can associate information with something by including it as an attribute or a subelement. Martin Sheen … 4145 ELEMENTS are more extensible – use when there is a possibility that more substructure will be added. ATTRIBUTES are easier to search on.

70. “Rules” for Designing a Schema Never leave structure out. The following is definitely a bad idea: Martin Sheen 1222 Alameda Drive, Carmel, CA 40145 Better would be: Or: Martin Sheen 1222 Alameda Drive Carmel CA 40145

71. More“Rules” for Designing a Schema When to use Elements (instead of attributes) Do not put large text blocks inside an attribute (Bad Idea) <book type=“memoir” content=“Bravely bold Sir Robin rode forth from Camelot. He was not afraid to die, O brave Sir Robin. He was not at all afraid to be killed in nasty ways, Brave, brave, brave, brave Sir Robin! He was not in the least bit scared to be mashed into a pulp, Or to have his eyes gouged out and his elbows broken, To have his kneecaps split and his body burned away And his limbs all hacked and mangled, brave Sir Robin! His head smashed in and his heart cut out And his liver removed and his bowels unplugged…”> Elements are more flexible, so use an Element if you think you might have to add more substructure later on.

72. More “Rules” for Designing Schemas More on when to use Elements (instead of Attributes) Use an embedded element when the information you are recording is a constituent part of the parent element one's head and one's height are both inherent to a human being, you can't be a conventionally structured human being without having a head and having a height One's head is a constituent part and one's height isn't -- you can cut off my head, but not my height use embedded elements for complex structure validation (obvious) use embedded elements when you need to show order (attributes are not ordered)

73. More “Rules” for Designing Schemas When to use Attributes instead of Elements use an attribute when the information is inherent to the parent but not a constituent part (height instead of head) use attributes to stress the one-to-one relationship among pieces of information to stress that the element represents a tuple of information dangerous rule, though Leads to the extreme formulation that a element can have a TITLE= attribute And then to the conclusion that it really ought to have a CONTENT= attribute too Then you find yourself writing the entire document as an empty element with an attribute value as long as the Quest for the Holy Grail use attributes for simple datatype validation (obviously)

74. Structuring a DTD or document with Entities The previous constructs are enough to create a full DTD. However, if there are many elements, this would lead to huge dtd files. Need a facility to Reuse the same description of an element more than once. Abbreviate commonly used definitions. Import definitions from other files. Import data that could never fit into one file (e.g. binary) You do this using Entities. An entity is a subunit of an xml document that is given a fixed abbreviation. An entity declaration declares the abbreviation. An entity reference &entname; %entname; is a use (or reference) of the abbreviation.

75. Bookings XML Schema Note that there are four global types in this document!

76. Bookings, cont.

77. Bookings, cont.

78. An Example Bookings Document Reverse engineer a reasonable schema for the following sample xml file 2003 April 1 Democratic Party Green Room Republican Party Red Room