Semantic Understanding An Approach Based on Information-Extraction Ontologies David W. Embley Brigham Young University

Presentation Outline  Grand Challenge  Meaning, Knowledge, Information, Data  Fun and Games with Data  Information Extraction Ontologies  Applications  Limitations and Pragmatics  Summary and Challenges

Grand Challenge Semantic Understanding Can we quantify & specify the nature of this grand challenge?

Grand Challenge Semantic Understanding “If ever there were a technology that could generate trillions of dollars in savings worldwide …, it would be the technology that makes business information systems interoperable.” (Jeffrey T. Pollock, VP of Technology Strategy, Modulant Solutions)

Grand Challenge Semantic Understanding “The Semantic Web: … content that is meaningful to computers [and that] will unleash a revolution of new possibilities … Properly designed, the Semantic Web can assist the evolution of human knowledge …” (Tim Berners-Lee, …, Weaving the Web)

Grand Challenge Semantic Understanding “20 th Century: Data Processing “21 st Century: Data Exchange “The issue now is mutual understanding.” (Stefano Spaccapietra, Editor in Chief, Journal on Data Semantics)

Grand Challenge Semantic Understanding “The Grand Challenge [of semantic understanding] has become mission critical. Current solutions … won’t scale. Businesses need economic growth dependent on the web working and scaling (cost: $1 trillion/year).” (Michael Brodie, Chief Scientist, Verizon Communications)

What is Semantic Understanding? Understanding: “To grasp or comprehend [what’s] intended or expressed.’’ Semantics: “The meaning or the interpretation of a word, sentence, or other language form.” - Dictionary.com

Can We Achieve Semantic Understanding? “A computer doesn’t truly ‘understand’ anything.” But computers can manipulate terms “in ways that are useful and meaningful to the human user.” - Tim Berners-Lee Key Point: it only has to be good enough. And that’s our challenge and our opportunity! …

Presentation Outline  Grand Challenge  Meaning, Knowledge, Information, Data  Fun and Games with Data  Information Extraction Ontologies  Applications  Limitations and Pragmatics  Summary and Challenges

Information Value Chain Meaning Knowledge Information Data Translating data into meaning

Foundational Definitions  Meaning: knowledge that is relevant or activates  Knowledge: information with a degree of certainty or community agreement  Information: data in a conceptual framework  Data: attribute-value pairs - Adapted from [Meadow92]

Foundational Definitions  Meaning: knowledge that is relevant or activates  Knowledge: information with a degree of certainty or community agreement (ontology)  Information: data in a conceptual framework  Data: attribute-value pairs - Adapted from [Meadow92]

Foundational Definitions  Meaning: knowledge that is relevant or activates  Knowledge: information with a degree of certainty or community agreement (ontology)  Information: data in a conceptual framework  Data: attribute-value pairs - Adapted from [Meadow92]

Foundational Definitions  Meaning: knowledge that is relevant or activates  Knowledge: information with a degree of certainty or community agreement (ontology)  Information: data in a conceptual framework  Data: attribute-value pairs - Adapted from [Meadow92]

Data  Attribute-Value Pairs Fundamental for information Thus, fundamental for knowledge & meaning

Data  Attribute-Value Pairs Fundamental for information Thus, fundamental for knowledge & meaning  Data Frame Extensive knowledge about a data item ̶ Everyday data: currency, dates, time, weights & measures ̶ Textual appearance, units, context, operators, I/O conversion Abstract data type with an extended framework

Presentation Outline  Grand Challenge  Meaning, Knowledge, Information, Data  Fun and Games with Data  Information Extraction Ontologies  Applications  Limitations and Pragmatics  Summary and Challenges

? Olympus C-750 Ultra Zoom Sensor Resolution:4.2 megapixels Optical Zoom:10 x Digital Zoom:4 x Installed Memory:16 MB Lens Aperture:F/8-2.8/3.7 Focal Length min:6.3 mm Focal Length max:63.0 mm

? Olympus C-750 Ultra Zoom Sensor Resolution:4.2 megapixels Optical Zoom:10 x Digital Zoom:4 x Installed Memory:16 MB Lens Aperture:F/8-2.8/3.7 Focal Length min:6.3 mm Focal Length max:63.0 mm

? Olympus C-750 Ultra Zoom Sensor Resolution:4.2 megapixels Optical Zoom:10 x Digital Zoom:4 x Installed Memory:16 MB Lens Aperture:F/8-2.8/3.7 Focal Length min:6.3 mm Focal Length max:63.0 mm

? Olympus C-750 Ultra Zoom Sensor Resolution4.2 megapixels Optical Zoom10 x Digital Zoom4 x Installed Memory16 MB Lens ApertureF/8-2.8/3.7 Focal Length min6.3 mm Focal Length max63.0 mm

Digital Camera Olympus C-750 Ultra Zoom Sensor Resolution:4.2 megapixels Optical Zoom:10 x Digital Zoom:4 x Installed Memory:16 MB Lens Aperture:F/8-2.8/3.7 Focal Length min:6.3 mm Focal Length max:63.0 mm

? Year 2002 MakeFord ModelThunderbird Mileage5,500 miles FeaturesRed ABS 6 CD changer keyless entry Price$33,000 Phone(916)

? Year 2002 MakeFord ModelThunderbird Mileage5,500 miles FeaturesRed ABS 6 CD changer keyless entry Price$33,000 Phone(916)

? Year 2002 MakeFord ModelThunderbird Mileage5,500 miles FeaturesRed ABS 6 CD changer keyless entry Price$33,000 Phone(916)

? Year 2002 MakeFord ModelThunderbird Mileage5,500 miles FeaturesRed ABS 6 CD changer keyless entry Price$33,000 Phone(916)

Car Advertisement Year 2002 MakeFord ModelThunderbird Mileage5,500 miles FeaturesRed ABS 6 CD changer keyless entry Price$33,000 Phone(916)

? Flight # Class From Time/Date To Time/Date Stops Delta 16 Coach JFK 6:05 pm CDG 7:35 am Delta 119 Coach CDG 10:20 am JFK 1:00 pm

? Flight # Class From Time/Date To Time/Date Stops Delta 16 Coach JFK 6:05 pm CDG 7:35 am Delta 119 Coach CDG 10:20 am JFK 1:00 pm

Airline Itinerary Flight # Class From Time/Date To Time/Date Stops Delta 16 Coach JFK 6:05 pm CDG 7:35 am Delta 119 Coach CDG 10:20 am JFK 1:00 pm

? Monday, October 13th Group AWLTGFGAPts. USA Sweden North Korea Nigeria Group BWLTGFGAPts. Brazil …

? Monday, October 13th Group AWLTGFGAPts. USA Sweden North Korea Nigeria Group BWLTGFGAPts. Brazil …

World Cup Soccer Monday, October 13th Group AWLTGFGAPts. USA Sweden North Korea Nigeria Group BWLTGFGAPts. Brazil …

? Calories250 cal Distance2.50 miles Time23.35 minutes Incline1.5 degrees Speed5.2 mph Heart Rate125 bpm

? Calories250 cal Distance2.50 miles Time23.35 minutes Incline1.5 degrees Speed5.2 mph Heart Rate125 bpm

? Calories250 cal Distance2.50 miles Time23.35 minutes Incline1.5 degrees Speed5.2 mph Heart Rate125 bpm

Treadmill Workout Calories250 cal Distance2.50 miles Time23.35 minutes Incline1.5 degrees Speed5.2 mph Heart Rate125 bpm

? PlaceBonnie Lake CountyDuchesne StateUtah TypeLake Elevation10,000 feet USGS QuadMirror Lake Latitude40.711ºN Longitude ºW

? PlaceBonnie Lake CountyDuchesne StateUtah TypeLake Elevation10,000 feet USGS QuadMirror Lake Latitude40.711ºN Longitude ºW

? PlaceBonnie Lake CountyDuchesne StateUtah TypeLake Elevation10,000 feet USGS QuadMirror Lake Latitude40.711ºN Longitude ºW

Maps PlaceBonnie Lake CountyDuchesne StateUtah TypeLake Elevation10,100 feet USGS QuadMirror Lake Latitude40.711ºN Longitude ºW

Presentation Outline  Grand Challenge  Meaning, Knowledge, Information, Data  Fun and Games with Data  Information Extraction Ontologies  Applications  Limitations and Pragmatics  Summary and Challenges

Information Extraction Ontologies SourceTarget Information Extraction Information Exchange

What is an Extraction Ontology?  Augmented Conceptual-Model Instance Object & relationship sets Constraints Data frame value recognizers  Robust Wrapper (Ontology-Based Wrapper) Extracts information Works even when site changes or when new sites come on-line

CarAds Extraction Ontology [1-9]\d{0,2}[kK] … \bmiles\b … [1-9]\d{0,2}[kK] … \bmiles\b …

Extraction Ontologies: An Example of Semantic Understanding  “Intelligent” Symbol Manipulation  Gives the “Illusion of Understanding”  Obtains Meaningful and Useful Results

Presentation Outline  Grand Challenge  Meaning, Knowledge, Information, Data  Fun and Games with Data  Information Extraction Ontologies  Applications  Limitations and Pragmatics  Summary and Challenges

A Variety of Applications  Information Extraction  Semantic Web Page Annotation  Free-Form Semantic Web Queries  Task Ontologies for Free-Form Service Requests  High-Precision Classification  Schema Mapping for Ontology Alignment  Accessing the Hidden Web  Ontology Generation  Challenging Applications (e.g. BioInformatics)

Application #1 Information Extraction

'97 CHEVY Cavalier, Red, 5 spd, only 7,000 miles. Previous owner heart broken! Asking only $11,995. #1415. JERRY SEINER MIDVALE, or Constant/Keyword Recognition Descriptor/String/Position(start/end) Year|97|2|3 Make|CHEV|5|8 Make|CHEVY|5|9 Model|Cavalier|11|18 Feature|Red|21|23 Feature|5 spd|26|30 Mileage|7,000|38|42 KEYWORD(Mileage)|miles|44|48 Price|11,995|100|105 Mileage|11,995|100|105 PhoneNr| |136|143 PhoneNr| |148|155

Heuristics  Keyword proximity  Subsumed and overlapping constants  Functional relationships  Nonfunctional relationships  First occurrence without constraint violation

Year|97|2|3 Make|CHEV|5|8 Make|CHEVY|5|9 Model|Cavalier|11|18 Feature|Red|21|23 Feature|5 spd|26|30 Mileage|7,000|38|42 KEYWORD(Mileage)|miles|44|48 Price|11,995|100|105 Mileage|11,995|100|105 PhoneNr| |136|143 PhoneNr| |148|155 Keyword Proximity   '97 CHEVY Cavalier, Red, 5 spd, only 7,000 miles on her. Previous owner heart broken! Asking only $11,995. #1415. JERRY SEINER MIDVALE, or

Subsumed/Overlapping Constants '97 CHEVY Cavalier, Red, 5 spd, only 7,000 miles. Previous owner heart broken! Asking only $11,995. #1415. JERRY SEINER MIDVALE, or Year|97|2|3 Make|CHEV|5|8 Make|CHEVY|5|9 Model|Cavalier|11|18 Feature|Red|21|23 Feature|5 spd|26|30 Mileage|7,000|38|42 KEYWORD(Mileage)|miles|44|48 Price|11,995|100|105 Mileage|11,995|100|105 PhoneNr| |136|143 PhoneNr| |148|155

Year|97|2|3 Make|CHEV|5|8 Make|CHEVY|5|9 Model|Cavalier|11|18 Feature|Red|21|23 Feature|5 spd|26|30 Mileage|7,000|38|42 KEYWORD(Mileage)|miles|44|48 Price|11,995|100|105 Mileage|11,995|100|105 PhoneNr| |136|143 PhoneNr| |148|155 Functional Relationships '97 CHEVY Cavalier, Red, 5 spd, only 7,000 miles on her. Previous owner heart broken! Asking only $11,995. #1415. JERRY SEINER MIDVALE, or

Nonfunctional Relationships '97 CHEVY Cavalier, Red, 5 spd, only 7,000 miles on her. Previous owner heart broken! Asking only $11,995. #1415. JERRY SEINER MIDVALE, or Year|97|2|3 Make|CHEV|5|8 Make|CHEVY|5|9 Model|Cavalier|11|18 Feature|Red|21|23 Feature|5 spd|26|30 Mileage|7,000|38|42 KEYWORD(Mileage)|miles|44|48 Price|11,995|100|105 Mileage|11,995|100|105 PhoneNr| |136|143 PhoneNr| |148|155

First Occurrence without Constraint Violation '97 CHEVY Cavalier, Red, 5 spd, only 7,000 miles on her. Previous owner heart broken! Asking only $11,995. #1415. JERRY SEINER MIDVALE, or Year|97|2|3 Make|CHEV|5|8 Make|CHEVY|5|9 Model|Cavalier|11|18 Feature|Red|21|23 Feature|5 spd|26|30 Mileage|7,000|38|42 KEYWORD(Mileage)|miles|44|48 Price|11,995|100|105 Mileage|11,995|100|105 PhoneNr| |136|143 PhoneNr| |148|155

Year|97|2|3 Make|CHEV|5|8 Make|CHEVY|5|9 Model|Cavalier|11|18 Feature|Red|21|23 Feature|5 spd|26|30 Mileage|7,000|38|42 KEYWORD(Mileage)|miles|44|48 Price|11,995|100|105 Mileage|11,995|100|105 PhoneNr| |136|143 PhoneNr| |148|155 Database-Instance Generator insert into Car values(1001, “97”, “CHEVY”, “Cavalier”, “7,000”, “11,995”, “ ”) insert into CarFeature values(1001, “Red”) insert into CarFeature values(1001, “5 spd”)

Application #2 Semantic Web Page Annotation

Annotated Web Page

OWL CarAds …… …… Mileage …… …… 2 …… ……. ……

Application #3 Free-Form Semantic Web Queries

Step 1. Parse Query “Find me the and of all s – I want a ”pricemileagere d Nissan1998or newer >= Operator

Step 2. Find Corresponding Ontology Similarity value: 6 Similarity value: 2 >= Operator “Find me the price and mileage of all red Nissans – I want a 1998 or newer”

Step 3. Formulate XQuery Expression Conjunctive queries run over selected ontology’s extracted values 7 Nissan MakeIns YearIns red ColorIns

 Value-phrase-matching words determine conditions  Conditions: Color = “red” Make = “Nissan” Year >= 1998 >= Operator Step 3. Formulate XQuery Expression

1: for $doc in document("file:///c:/ontos/owlLib/Car.OWL")/rdf:RDF 2: for $Record in $doc/owl:Thing 3: 4: let $id := "CarIns") 5: let $Color := $id)]/car:ColorValue/text() 6: let $Make := $id)]/car:MakeValue/text() 7: let $Year := $id)]/car:YearValue/text() 8: let $Price := $id)]/car:PriceValue/text() 9: let $Mileage := $id)]/car:MileageValue/text() 10: 11: where($Color="red" or empty($Color)) and 12: ($Make="Nissan" or empty($Make)) and 13: ($Year>="1998" or empty($Year)) 14: return 15: {$Price} 16: {$Mileage} 17: {$Color} 18: {$Make} 19: {$Year} 20: For each owl:Thing Get the instance ID and extracted values Check conditions Return values Step 3. Formulate XQuery Expression

Step 4. Run XQuery Expression Over Ontology’s Extracted Data  Uses Qexo 1.7, GNU’s XQuery engine for Java  Use XSLT to transform results to HTML table

Application #4 Task Ontologies for Free-Form Service Requests

Example: Appointment Request

Example: Car Purchase Request

Example: Apartment Request

Application #5 High-Precision Classification

An Extraction Ontology Solution

Document 1: Car Ads Document 2: Items for Sale or Rent Density Heuristic

Document 1: Car Ads Year: 3 Make: 2 Model: 3 Mileage: 1 Price: 1 Feature: 15 PhoneNr: 3 Expected Values Heuristic Document 2: Items for Sale or Rent Year: 1 Make: 0 Model: 0 Mileage: 1 Price: 0 Feature: 0 PhoneNr: 4

Vector Space of Expected Values OV______ D1D2 Year Make Model Mileage Price Feature PhoneNr D1: D2: ov D1 D2

Grouping Heuristic Year Make Model Price Year Model Year Make Model Mileage … Document 1: Car Ads { { { Year Mileage … Mileage Year Price … Document 2: Items for Sale or Rent { {

Grouping Car Ads Year Make Model Price Year Model Year Make Model Mileage Year Model Mileage Price Year … Grouping: Sale Items Year Mileage Mileage Year Price Year Price Year Price … Grouping: Expected Number in Group = floor(∑ Ave ) = 4 (for our example) Sum of Distinct 1-Max Object Sets in each Group Number of Groups * Expected Number in a Group 1-Max *4 = *4 = 0.500

Application #6 Schema Mapping for Ontology Alignment

Problem: Different Schemas Target Database Schema {Car, Year, Make, Model, Mileage, Price, PhoneNr}, {PhoneNr, Extension}, {Car, Feature} Different Source Table Schemas {Run #, Yr, Make, Model, Tran, Color, Dr} {Make, Model, Year, Colour, Price, Auto, Air Cond., AM/FM, CD} {Vehicle, Distance, Price, Mileage} {Year, Make, Model, Trim, Invoice/Retail, Engine, Fuel Economy}

Solution: Remove Internal Factoring Discover Nesting: Make, (Model, (Year, Colour, Price, Auto, Air Cond, AM/FM, CD)*)* Unnest: μ (Model, Year, Colour, Price, Auto, Air Cond, AM/FM, CD)* μ (Year, Colour, Price, Auto, Air Cond, AM/FM, CD)* Table Legend ACURA

Solution: Replace Boolean Values Legend ACURA β CD Table Yes, CD Yes, β Auto β Air Cond β AM/FM Yes, AM/FM Air Cond. Auto

Solution: Form Attribute-Value Pairs Legend ACURA CD AM/FM Air Cond. Auto,,,,,,,,

Solution: Adjust Attribute-Value Pairs Legend ACURA CD AM/FM Air Cond. Auto,,,,,,,

Solution: Do Extraction Legend ACURA CD AM/FM Air Cond. Auto

Solution: Infer Mappings Legend ACURA CD AM/FM Air Cond. Auto {Car, Year, Make, Model, Mileage, Price, PhoneNr}, {PhoneNr, Extension}, {Car, Feature} Each row is a car. π Model μ (Year, Colour, Price, Auto, Air Cond, AM/FM, CD)* Table π Make μ (Model, Year, Colour, Price, Auto, Air Cond, AM/FM, CD)* μ (Year, Colour, Price, Auto, Air Cond, AM/FM, CD)* Table π Year Table Note: Mappings produce sets for attributes. Joining to form records is trivial because we have OIDs for table rows (e.g. for each Car).

Solution: Infer Mappings Legend ACURA CD AM/FM Air Cond. Auto {Car, Year, Make, Model, Mileage, Price, PhoneNr}, {PhoneNr, Extension}, {Car, Feature} π Model μ (Year, Colour, Price, Auto, Air Cond, AM/FM, CD)* Table

Solution: Do Extraction Legend ACURA CD AM/FM Air Cond. Auto {Car, Year, Make, Model, Mileage, Price, PhoneNr}, {PhoneNr, Extension}, {Car, Feature} π Price Table

Solution: Do Extraction Legend ACURA CD AM/FM Air Cond. Auto {Car, Year, Make, Model, Mileage, Price, PhoneNr}, {PhoneNr, Extension}, {Car, Feature} Yes, ρ Colour←Feature π Colour Table U ρ Auto ← Feature π Auto β Auto Table U ρ Air Cond. ← Feature π Air Cond. β Air Cond. Table U ρ AM/FM ← Feature π AM/FM β AM/FM Table U ρ CD ← Feature π CD β CD Table Yes,

Application #7 Accessing the Hidden Web

Obtaining Data Behind Forms Web information is stored in databases Databases are accessed through forms Forms are designed in various ways

Hidden Web Extraction System Input Analyzer Retrieved Page(s) User Query Site Form Output Analyzer Extracted Information Application Extraction Ontology “Find green cars costing no more than $9000.”

Application #8 Ontology Generation

TANGO: Table Analysis for Generating Ontologies  Recognize and normalize table information  Construct mini-ontologies from tables  Discover inter-ontology mappings  Merge mini-ontologies into a growing ontology

Recognize Table Information Religion Population Albanian Roman Shi’a Sunni Country (July 2001 est.) Orthodox Muslim Catholic Muslim Muslim other Afganistan 26,813,057 15% 84% 1% Albania 3,510,484 20% 70% 10%

Construct Mini-Ontology Religion Population Albanian Roman Shi’a Sunni Country (July 2001 est.) Orthodox Muslim Catholic Muslim Muslim other Afganistan 26,813,057 15% 84% 1% Albania 3,510,484 20% 70% 10%

Discover Mappings

Merge

Application #9 Challenging Applications (e.g. BioInformatics)

Large Extraction Ontologies

Complex Semi-Structured Pages

Additional Analysis Opportunities  Sibling Page Comparison  Semi-automatic Lexicon Update  Seed Ontology Recognition

Sibling Page Comparison

Attributes

Sibling Page Comparison

Semi-automatic Lexicon Update Additional Protein Names Additional Source Species or Organisms

nucleu s; zinc ion binding; nucleic acid binding; zinc ion binding; nucleic acid binding; linear; NP_079345; 9606; Eukaryota; Metazoa; Chorata; Craniata; Vertebrata; Euteleostomi; Mammalia; Eutheria; Primates; Catarrhini; Hominidae; Homo; NP_079345; Homo sapiens; human; GTTTTTGTGTT……….ATAAGTGCATTAAC GGCCCACATG; FLJ14299 msdspagsnprtpessgs gsgg………tagpyyspy alygqrlasasalgyq; hypothetical protein FLJ14299; 8; eight; “8:?p\s?12”; “8:?p11.2”; “8:?p11.23”; : “37,?612,?680”; “37,?610,?585”; Seed Ontology Recognition

Presentation Outline  Grand Challenge  Meaning, Knowledge, Information, Data  Fun and Games with Data  Information Extraction Ontologies  Applications  Limitations and Pragmatics  Summary and Challenges

Limitations and Pragmatics  Data-Rich, Narrow Domain  Ambiguities ~ Context Assumptions  Incompleteness ~ Implicit Information  Common Sense Requirements  Knowledge Prerequisites  …

Busiest Airport? Chicago - 928,735 Landings (Nat. Air Traffic Controllers Assoc.) - 931,000 Landings (Federal Aviation Admin.) Atlanta - 58,875,694 Passengers (Sep., latest numbers available) Memphis - 2,494,190 Metric Tons (Airports Council Int’l.)

Busiest Airport? Chicago - 928,735 Landings (Nat. Air Traffic Controllers Assoc.) - 931,000 Landings (Federal Aviation Admin.) Atlanta - 58,875,694 Passengers (Sep., latest numbers available) Memphis - 2,494,190 Metric Tons (Airports Council Int’l.)

Busiest Airport? Chicago - 928,735 Landings (Nat. Air Traffic Controllers Assoc.) - 931,000 Landings (Federal Aviation Admin.) Atlanta - 58,875,694 Passengers (Sep., latest numbers available) Memphis - 2,494,190 Metric Tons (Airports Council Int’l.)

Busiest Airport? Chicago - 928,735 Landings (Nat. Air Traffic Controllers Assoc.) - 931,000 Landings (Federal Aviation Admin.) Atlanta - 58,875,694 Passengers (Sep., latest numbers available) Memphis - 2,494,190 Metric Tons (Airports Council Int’l.) Ambiguous Whom do we trust? (How do they count?)

Busiest Airport? Chicago - 928,735 Landings (Nat. Air Traffic Controllers Assoc.) - 931,000 Landings (Federal Aviation Admin.) Atlanta - 58,875,694 Passengers (Sep., latest numbers available) Memphis - 2,494,190 Metric Tons (Airports Council Int’l.) Important qualification

Dow Jones Industrial Average High Low Last Chg 30 Indus Transp Utils Stocks , Graphics, Icons, …

Dow Jones Industrial Average High Low Last Chg 30 Indus Transp Utils Stocks , Reported on same date Weekly Daily Implicit information: weekly stated in upper corner of page; daily not stated.

Presentation Outline  Grand Challenge  Meaning, Knowledge, Information, Data  Fun and Games with Data  Information Extraction Ontologies  Applications  Limitations and Pragmatics  Summary and Challenges

Some Key Ideas  Data, Information, and Knowledge  Data Frames Knowledge about everyday data items Recognizers for data in context  Ontologies Resilient Extraction Ontologies Shared Conceptualizations  Limitations and Pragmatics

Some Research Issues  Building a library of open source data recognizers  Precisely finding and gathering relevant information Subparts of larger data Scattered data (linked, factored, implied) Data behind forms in the hidden web  Improving concept matching Heuristic orchestration Application of NLP techniques Calculations, unit conversions, data normalization, …  Achieving the potential of the presented applications