User Experience Takes user input, displays results Search Engine Builds index, returns results Content Processing Retrieves content, prepares for indexing How does search technology work? 1.Scale 2.Interaction management 3.Document pipeline 4.Search on structured data 5.Relevance 6.Advanced linguistics ContentSearch

User Experience Search Engine Content Processing Scale FAST ESP is designed for extreme scale across 3 dimensions. Guaranteed sub-second response times at thousands of queries per secondGuaranteed sub-second response times at thousands of queries per second Fine tuning for index freshnessFine tuning for index freshness Best for content volume less than 20-30M docs.Best for content volume less than 20-30M docs. Designed for content volume up to 10 billion docs or 40 petabytesDesigned for content volume up to 10 billion docs or 40 petabytes Query Volume Content Volume FAST ESP Linear Scaling Architecture  Search engine instances are grouped in clusters.  Rows are used for query scaling.  Columns are used for content volume scaling.

User Experience Search Engine Content Processing Interaction Management FAST ESP enables a "conversational search experience." SharePoint search scopesSharePoint search scopes Standard Search CenterStandard Search Center Search web partsSearch web parts Search tabsSearch tabs OpenSearch federationOpenSearch federation Best betsBest bets Keyword synonymsKeyword synonyms NavigatorsNavigators TaxonomyTaxonomy Unsupervised clusteringUnsupervised clustering PersonalizationPersonalization RecommendationsRecommendations Geospatial searchGeospatial search Deep federationDeep federation CollectionsCollections Search profilesSearch profiles Search business centerSearch business center FAST ESP scope searchFAST ESP scope search Sophisticated content retrieval and document processingSophisticated content retrieval and document processing

User Experience Search Engine Content Processing Content Retrieval & Document Pipeline FAST ESP offers sophisticated document processing capabilities. Crawl rulesCrawl rules Crawl schedulesCrawl schedules Index schemasIndex schemas Index profilesIndex profiles FAST ESP scope searchFAST ESP scope search Full-featured content crawlerFull-featured content crawler Support for content pushSupport for content push Document processing engine & flexible document pipelineDocument processing engine & flexible document pipeline Entity extractionEntity extraction pipeline modules1000+ pipeline modules Format Conversion FAST ESP – Document Pipeline Content processing & refinement … Language Detection Entity Extraction Custom Plug-in Sentiment Analysis

User Experience Search Engine Content Processing Search on Structured Data FAST ESP is ideal for ad-hoc, search-based queries on structured data. Predictable, sub-second response times for ad-hoc queries on structured dataPredictable, sub-second response times for ad-hoc queries on structured data Exact counts on navigatorsExact counts on navigators Advanced sortingAdvanced sorting Advanced rankingAdvanced ranking Many connectors for structured data sourcesMany connectors for structured data sources Data cleansing capabilitiesData cleansing capabilities ETL integrationETL integration FAST ESP scope searchFAST ESP scope search Basic sortingBasic sorting Basic rankingBasic ranking “No-code” approach to structured data connectors using the BDC“No-code” approach to structured data connectors using the BDC

User Experience Search Engine Content Processing Relevance FAST ESP offers many options for tuning relevance. Basic sortingBasic sorting Basic rankingBasic ranking Sort by social distance for people search resultsSort by social distance for people search results TeasersTeasers Strong out-of-the-box relevance for internal appsStrong out-of-the-box relevance for internal apps Authoritative sitesAuthoritative sites Property weightingProperty weighting Keyword query language and SQL query languageKeyword query language and SQL query language Basic linguistic processing, including language detection, stemming, & word breakingBasic linguistic processing, including language detection, stemming, & word breaking Query analysis using query pipelineQuery analysis using query pipeline Navigators, taxonomies & clustering facilitate “conversation”Navigators, taxonomies & clustering facilitate “conversation” User profilesUser profiles Advanced linguistic processingAdvanced linguistic processing Advanced sortingAdvanced sorting Advanced rankingAdvanced ranking TeasersTeasers Sophisticated 4-factor ranking model based on freshness, authority, quality, and proximity & contentSophisticated 4-factor ranking model based on freshness, authority, quality, and proximity & content Expressive queries with FAST Query Language (FQL)Expressive queries with FAST Query Language (FQL) XRANKXRANK Document processing engine & document pipelinesDocument processing engine & document pipelines Advanced linguistic processingAdvanced linguistic processing

User Experience Search Engine Content Processing Advanced Linguistics FAST ESP offers sophisticated linguistic s for improved relevancy. Basic thesaurus based on XML entries in flat fileBasic thesaurus based on XML entries in flat file Basic “Did you mean?” based on index entriesBasic “Did you mean?” based on index entries Elimination of noise wordsElimination of noise words 36 languages36 languages Basic linguistic processing, including language detection, stemming, & word breakingBasic linguistic processing, including language detection, stemming, & word breaking Advanced support for Chinese, Japanese, and KoreanAdvanced support for Chinese, Japanese, and Korean Offensive content filterOffensive content filter Entity extractionEntity extraction Relationship extractionRelationship extraction Dictionary & configurable thesaurusDictionary & configurable thesaurus Advanced lemmatizationAdvanced lemmatization Spell checking & advanced phrase recognitionSpell checking & advanced phrase recognition Anti-phrasingAnti-phrasing Auto completionAuto completion 77 languages77 languages Linguistics StudioLinguistics Studio