Redefining Perspectives A thought leadership forum for technologists interested in defining a new future June - 2015 COPYRIGHT ©2015 SAPIENT CORPORATION.

Slides:



Advertisements
Similar presentations
Dr. Leo Obrst MITRE Information Semantics Information Discovery & Understanding Command & Control Center February 6, 2014February 6, 2014February 6, 2014.
Advertisements

Classification & Your Intranet: From Chaos to Control Susan Stearns Inmagic, Inc. E-Libraries E204 May, 2003.
Presentation by Priyanka Sawarkar
CH-4 Ontologies, Querying and Data Integration. Introduction to RDF(S) RDF stands for Resource Description Framework. RDF is a standard for describing.
Lukas Blunschi Claudio Jossen Donald Kossmann Magdalini Mori Kurt Stockinger.
OMG Architecture Ecosystem SIG Federal CIO Council Data Architecture Subcommittee May 2011 Cory Casanave.
Financial Industry Semantics and Ontologies The Universal Strategy: Knowledge Driven Finance Financial Times, London 30 October 2014.
Text mining Extract from various presentations: Temis, URI-INIST-CNRS, Aster Data …
How to survive the document & data tsunami? Lambda Verdonckt Business Analyst TenForce.
Information and Business Work
224 Schilling Circle Suite 240 Hunt Valley, MD (410) Ontology-Driven Information Management Standards-Based Collaborative.
Third-generation information architecture November 4, 2008.
Semantic Web and Web Mining: Networking with Industry and Academia İsmail Hakkı Toroslu IST EVENT 2006.
Enterprise Search With SharePoint Portal Server V2 Steve Tullis, Program Manager, Business Portal Group 3/5/2003.
ReQuest (Validating Semantic Searches) Norman Piedade de Noronha 16 th July, 2004.
Chapter 14 The Second Component: The Database.
Improving Business Performance by using XBRL Mr. Christian Barrios Marchant Member of the Executive Board of SOFTWARE AG Responsible for Region South West.
Implementing Metadata Marjorie M K Hlava, President Access Innovations, Inc. Albuquerque, NM
Cloud based linked data platform for Structural Engineering Experiment Xiaohui Zhang
1 Semantic Data Management Xavier Lopez, Ph.D., Director, Spatial & Semantic Technologies.
ASIDIC Spring Conference ‘Smart Content’ Uncovering the Value and Benefits of Semantic Technology Richard C. Fusco Director, Content Strategy – McGraw-Hill.
Semantic Web Technologies Lecture # 2 Faculty of Computer Science, IBA.
MDC Open Information Model West Virginia University CS486 Presentation Feb 18, 2000 Lijian Liu (OIM:
Amarnath Gupta Univ. of California San Diego. An Abstract Question There is no concrete answer …but …
What Can Do for You! Fabian Christ
Efficient BI Solution Presented by: Leo Khaskin, PowerCubes Lab Value of Information as Business Asset.
Copyright Antidot™ 1 Linked Enterprise Data LEVERAGING THE SEMANTIC WEB STACK IN A CORPORATE ENVIRONMENT ISWC 2012 – BOSTON FABRICE LACROIX –
Landing the Raven: Positioning the Knowledge Discovery System in the Enterprise Wendi Pohs, Iris Associates
Semantic Web outlook and trends May The Past 24 Odd Years 1984 Lenat’s Cyc vision 1989 TBL’s Web vision 1991 DARPA Knowledge Sharing Effort 1996.
Survey of Semantic Annotation Platforms
XML in Development of Distributed Systems Tooling Programming Runtime.
Digital Enterprise Research Institute HADA – An Access Controlled Application for Publishing and Discovering Linked Government Data Owen Sacco.
Delivering business value through Context Driven Content Management Karsten Fogh Ho-Lanng, CTO.
Yogesh Gautam B.Sc., MCA, Ph.D. (Computer Science) MBA, PGP Cyber Law.
PLoS ONE Application Journal Publishing System (JPS) First application built on Topaz application framework Web 2.0 –Uses a template engine to display.
Metadata. Generally speaking, metadata are data and information that describe and model data and information For example, a database schema is the metadata.
Revelytix SICoP Presentation DRM 3.0 with WordNet Senses in a Semantic Wiki Michael Lang February 6, 2007.
Data Mining By Dave Maung.
From Objects to Assets: The Fungibility of Knowledge Christopher W. Higgins, Esq.
BAA - Big Mechanism using SIRA Technology Chuck Rehberg CTO at Trigent Software and Chief Scientist at Semantic Insights™
6.1 © 2010 by Prentice Hall 6 Chapter Foundations of Business Intelligence: Databases and Information Management.
Oracle Database 11g Semantics Overview Xavier Lopez, Ph.D., Dir. Of Product Mgt., Spatial & Semantic Technologies Souripriya Das, Ph.D., Consultant Member.
Semantic Visualization What do we mean when we talk about visualization? - Understanding data - Showing the relationships between elements of data Overviews.
© 2007 IBM Corporation IBM Information Management Accelerate information on demand with dynamic warehousing April 2007.
User Profiling using Semantic Web Group members: Ashwin Somaiah Asha Stephen Charlie Sudharshan Reddy.
Text Analytics Workshop Tom Reamy Chief Knowledge Architect KAPS Group Knowledge Architecture Professional Services
WEB 2.0 PATTERNS Carolina Marin. Content  Introduction  The Participation-Collaboration Pattern  The Collaborative Tagging Pattern.
Of 33 lecture 1: introduction. of 33 the semantic web vision today’s web (1) web content – for human consumption (no structural information) people search.
WEB PAGE CONTENTS VERIFICATION AGAINST TAGS USING DATA MINING TOOL IKNOW VІI scientific and practical seminar with international participation "Economic.
Knowledge Modeling and Discovery. About Thetus Thetus develops knowledge modeling and discovery infrastructure software for customers who: Have high-value.
1 Open Ontology Repository initiative - Planning Meeting - Thu Co-conveners: PeterYim, LeoObrst & MikeDean ref.:
Achieving Semantic Interoperability at the World Bank Designing the Information Architecture and Programmatically Processing Information Denise Bedford.
IoT Meets Big Data Standardization Considerations
Semantic Search - Potential and Opportunities. © 2014 SAPIENT CORPORATION | CONFIDENTIAL 2 Search – Where we were!
Selected Semantic Web UMBC CoBrA – Context Broker Architecture  Using OWL to define ontologies for context modeling and reasoning  Taking.
Semantic Wiki: Automating the Read, Write, and Reporting functions Chuck Rehberg, Semantic Insights.
Chapter 8: Web Analytics, Web Mining, and Social Analytics
1© Copyright 2012 EMC Corporation. All rights reserved. Turning Big Data into Competitive Advantage “Big data will represent a hugely disruptive force.
Semantic Web. P2 Introduction Information management facilities not keeping pace with the capacity of our information storage. –Information Overload –haphazardly.
OMG Architecture Ecosystem SIG Enterprise Data World 2011.
Unifying a Taxonomy to Reduce Customer Pain with Content Silos
Taxonomies, Lexicons and Organizing Knowledge
Pilot project training
Knowledge Based Workflow Building Architecture
Service-enabling in Financial Domain
TDM=Text Mining “automated processing of large amounts of structured digital textual content for purposes of information retrieval, extraction, interpretation.
Semantic Information Modeling for Federation
Building and Integrating a Chatbot in 30 minutes
Anatomy of a modern data-driven content product
Jonathan Griffin, Managing Director, IFIS Publishing &
Presentation transcript:

Redefining Perspectives A thought leadership forum for technologists interested in defining a new future June COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL

Session 2 Semantic Search – the technology and its application in financial markets COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL

Search 3 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL

Search 4 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL Keyword based Search Engine User “Give me what I Said”

ENTERPRISE ECOSYSTEM Search – Enterprise Ecosystem 5 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL 60% of Enterprise Data are Unstructured Structured Data Trading Reference Security Search Silos Keyword Based Search Semi Structured Data Wiki Vendor Data Reports “Give me what I asked” Unstructured Data Research Company Filings Feeds Data Search Silos Custom Search Application

Semantic Search – Making Results Relevant 6 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL Context & Intent based, Meaning & Relationships among words

Semantic Search – Making Results Relevant 7 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL Disambiguate “Give me what I Want; Not just what I Say”

Search – Enterprise Semantic Ecosystem 8 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL Enterprise Semantic Search Knowledge Discovery Enterprise ContentEnterprise Semantic Search Linked Data DBPedia Freebase Internal Knowledge Base Enterprise Data Models Content Extraction Context Mapping Contextual Meaning Inferencing Structured Unstructured Semi-Structured

We’ll focus on… We will consider a Financial Domain Investment Bank Use Case How Semantic Search Platform is built technically in-line with the use case COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL

The Use Case – Investment Research 10 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL A typical Research team in an Investment Bank performs the following: Manually gather research information Analyze gathered documents to find requested information Challenges: High volume of research corpus Manual Analysis results in Inaccuracy Longer Response Time Time to Market Lower ROI  Automate Routine Requests  Faster response. But limited benefit.  Problem still remains for Complex Information Requests  Outsourcing Research Team  Potential Cost Savings  Problem not solved but moved to a different place. QoS risks.  Ontology Based Semantic Search  Faster Response  More Relevant and Contextual Search Results  Knowledge Discovery through Inferencing  Domain and technology expertise required Current Scenario OptionsPros/Cons

The Use Case – Investment Research 11 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL Build a Semantic Search platform that leverages latest advancements in Search and Natural Language Processing to make Investment Research Experience significantly more efficient and effective Maximize ROI on Market Research Spending Get Insight to Timely Industry Information Find and Discover Actionable Knowledge Perform Informed Investment Decisions

The Use Cases – Potential Search Queries 12 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL ‘HSBC Holdings Plc’ ‘Asset Write down’ Asia Interest rate risk private banks Western Europe Documents about banks based out of Paris and talk about interest rates volatility in Western Europe Companies in Eastern Europe whose turnover is greater than $100 million and face challenge of nationalization Show me documents about Retail Banks in South Asia whose P/E ratio is greater than 20.0 Do a proximity search on ‘Regulatory Change’ with reference to ‘Retail Banking’ Looking for documents published by HSBC and authored by Ronit Ghose

Enabling Semantic Search - Approaches 1.Lexicon and Ontological Based Search 2.Statistical Analysis and/or Pattern Matching Search 13 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL

Enabling Semantic Search – 4 Pillars 14 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL Reasoning Engines Natural Language Processing Ontology Semantic Analysis

Enabling Semantic Search – Core Concepts 15 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL Model defined using constructs for: Concepts – classes Relationships – properties (object and data) Rules – axioms and constraints Instances of concepts – individuals (data) Uses W3C standards RDF/S and OWL Relationships Concepts/Classes Instances What is Ontology ? It’s an Knowledge Model, assembly of concepts in which all possible relationships that might exist among concepts are explicitly mapped. it captures knowledge so that, Questions can be answered New Insights can be generated

Enabling Semantic Search – Core Concepts 16 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL Data stored in Triples Expressed as Subject : Predicate : Object Internal Knowledge Base DISCOVER NEW INSIGHTS Pranab MukherjeeNew DelhiIndia Lives inIs in Lives in Get me documents about Retail Banks in Eastern Europe which have net profit great than $10 million and are facing challenges of nationalization

Putting It All Together - Application Process Flow 17 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL Content Providers Content Extraction & Standardization Standardized Document Step 1 Content Ingestion Classification Ontology Tagging Meta Data Document Store XML and Triple Storage Indexing & Querying Step 2 Content Delivery Search Engagement Step 3

Components – Content Extraction & Standardization 18 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL Unstructured Content Text Extraction & Standardization Metadata Extracted Textual Content Extract Meaning from Unstructured Data Transform into Structured Data for Auto Tagging

Components – Content Ingestion 19 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL Ontology Management A tool that supports lists, controlled vocabularies, taxonomies, thesauri or ontologies: Concepts/Terms Taxonomy Associative Relationships Synonyms

Components – Content Ingestion 20 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL Content Classification Analyze document Add metadata ‘tags’ that describe that documents which are sourced from Ontology Example : Classification Results

Components – Data Store & Search Engine 21 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL

Typical Architecture 22 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL CORE PLATFORM STORAGE LAYER PRESENTATION LAYER Free-Text Search Ontology Driven Search Graph SearchCollaborationEngagement CORE SERVICES Logging Caching Security Monitoring Indexes Content Store Triples Inferencing SPARQL XQUERY Classification Server Ontology Server RuleSets Inference Engine ONTOLOGY MGMT Ontology Creation RuleSets Entity Extraction Inferencing CONTENT DELIVERY Query pre- processor Query Builder Inference Engine Results post- processor CONTENT INGESTION Import Classification/ Indexing Standardization / Structuring Storage

Semantic Search – Opportunities & Beyond 23 COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL Augmented Reality Other Possibilities? football-concept.jpg content/uploads/2015/01/original_aefd15169aaebd3f037b5ed672db6de1.png

QuestionAnswer Thank you COPYRIGHT ©2015 SAPIENT CORPORATION | CONFIDENTIAL