1. #SummitNow Querying for Metadata 7 th November 2013 Andy Hind, Alfresco

2. #SummitNow What’s in the box?

3. #SummitNow Where is the box?

4. #SummitNow The bottom of the box … Java Search APISearch sub-systemQuery languages AFTS / CMIS QLAbstract formIndex EngineSOLR/Lucene/NothingLucene/Xpath/…

5. #SummitNow The new tool in the box … Java Search APISearch sub-systemQuery languages AFTS / CMIS QLAbstract formDB EngineDBIndex EngineSOLR/Lucene/NothingLucene/Xpath/…

6. #SummitNow A choice … Java Search APISearch sub-systemQuery languages AFTS / CMIS QLAbstract formDB EngineDBIndex EngineSOLR/Lucene/NothingLucene/Xpath/… 12

7. #SummitNow Consistency SOLR DB

8. #SummitNow CMIS QL SELECT FROM JOIN ORDER BY WHERE

9. #SummitNow CMIS QL: SOLR vs DB SOLR Full textORdecimalbooleanIN_TREE() DB

10. #SummitNow Virtual tables cmis:document … … cmis:folder … … cmis:secondary … …

11. #SummitNow Columns/data types Supported String <= 1024 integer id datetime Unsupported boolean decimal uri Html String > 1024

12. #SummitNow Logical Operators GoodANDBadNOTANY NOT ANY UglyOR

13. #SummitNow Predicates Comparison.. ANY =<><<=>>=

14. #SummitNow Predicates (NOT) IN LIKE IS (NOT) NULL IN_FOLDER() ANY … (NOT) IN CONTAINS() SCORE() IN_TREE()

15. #SummitNow Ordering

16. #SummitNow An Example … select * from cmis:document where cmis:name like '%e%' and cmis:createdBy in ('System', 'admin') and cmis:creationDate TIMESTAMP '2010-01-01T00:00:00.000Z' and cmis:contentStreamLength > 2 and cmis:contentStreamFileName LIKE '_%' order by cmis:contentStreamLength DESC, cmis:creationDate ASC, cmis:name DESC

17. #SummitNow CMIS QL: SOLR vs DB SOLR Full textORdecimalbooleanIN_TREE() DB

18. #SummitNow SOLR DB

19. #SummitNow Permissions In Query HIDDEN After Query

20. #SummitNow Localisation Localised order DB Collation d:mltext Case sensitivity

21. #SummitNow Why I get up in the morning …

22. #SummitNow Alfresco FTS + DB? PATHOR Implicit OR

23. #SummitNow Is it for you? SOLRDB …OREventualFTS….RestrictedNow

24. #SummitNow Optional patch system.metadata-query-indexes.ignoredtrueUpgradeNo MDQfalseUpgradeOptional patchDB +25%MDQignoredNew InstallMDQ

25. #SummitNow Upgrade 4.0.2 -> 4.2 10M InnoDB

26. #SummitNow Configuration solr.query.fts.queryConsistencysolr.query.cmis.queryConsistency EVENTUAL TRANSACTIONAL TRANSACTIONAL_IF_POSSIBLE

27. #SummitNow

28. Is this a box of worms? Performance Large result sets (~100k) Left outer join ORDER BY DB ≈ SOLR

29. #SummitNow Do share queries use the DB? NO Context +PATH Implicit OR

30. #SummitNow The mystery box … UPPER() LOWER() FTS Syntax name:woof db-cmis Admin console

31. #SummitNow

32. Summary SOLR Full textORFloat/doubleBoolean String > 1024Structure DB

33. #SummitNow Future IN_TREE()SOLR 4+ Permission evaluation PerformanceMore DBsSimple ORDate mathSchemaHybrid

34. #SummitNow