An Approach to Operationalize Regulative Norms in Multiagent Systems Carolina Howard Felicíssimo LES / PUC-Rio Advisor: Prof. Carlos José Pereira de Lucena Co-Advisor: Prof. Jean-Pierre Briot

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Agenda 1.Introduction 2.Background and Related Research –Engineering of Multiagent Systems –Norm Enforcement 3.Dynamic Contextual Regulation Information Provision 4.Contextual Norm Enforcement

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Agenda 1.Introduction 2.Background and Related Research 3.Contextual Norm Information Provision 4.Contextual Norm Enforcement 5.Applications of DynaCROM –Market Based Control –TV Broadcasting 6.Comparison with Related Work –OMNI –ISLANDER and AMELI –Moise + and S-Moise + –XMLaw 7.Dynamic Contextual Protocol Information Provision 8.Conclusion –Thesis Contributions –Future Work

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Network Link Introduction - Heterogeneous agents will be able to acquire resources or services not found locally. - Information Systems: goal-oriented problem-solving entities [Jennings et al., 1998] - Web -> Semantic Web [Berners-Lee et al., 2001] Open MAS Network Link Open MAS Berners-Lee, T.; Hendler, J.; Lassila, O. The Semantic Web, Scientific Ameri-can. 284(5), p. 34–43, May Jennings, N.; Sycara, K.; Wooldridge, M. A Roadmap of Agent Research and Development. JAMAS, 1998, 1, p. 7–38.

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Introduction Network Link Open MAS Network Link Normative Open MAS Normative Open MAS Norms

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Background and Related Research Engineering of Multiagent Systems –Modeling of Multiagent Systems –Implementation of Multiagent Systems Norm Enforcement

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Background and Related Research Engineering of Multiagent Systems –Modeling of Multiagent Systems Electronic Agent-Based Organizations –OMNI (Organizational Model for Normative Institutions) [Vázquez-Salceda et al., 2005] –MOISE + [Hannoun et al., 2000] Electronic Agent-Based Institutions (An organization restricted through the definitions of all the following: related roles, common language, valid interactions and set of norms) –ISLANDER [Esteva, 2003] Vázquez-Salceda, J.; Dignum, V.; Dignum, F. Organizing Multiagent Systems. JAAMAS, 2005, 11 (3), p. 307–360. Hannoun, M.; et al. MOISE: An organizational model for multi-agent systems. IBERAMIA/SBIA’2000, LNAI 1952, p. 152–161. Esteva, M. Electronic Institutions: from specification to development. PhD thesis, Technical University of Catalonia, 2003.

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Background and Related Research Current Modeling Solutions for MAS Engineering: rq.i. Explicitly Supports the Organizational Normative Dimension? rq.ii. Has the Conceptual Model an Implemented Solution for It? rq.iii. Supports the Management of Norms to be done at System Runtime? rq.iv. Provides the way for Norm Representation with a Common Understanding for Heterogeneous Agents? rq.v. Has an Editor, preferably a Graphical one, to Writte its Specifications? rq.vi. Has a Semi-/Automatic Solution for the Verification of its Specifications? rq.irq.iirq.iiirq.ivrq.vrq.vi OMNI V X– V XX M OISE + VVVV XX ISLANDERX VVVVV

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Background and Related Research Engineering of Multiagent Systems –Implementation of Multiagent Systems The JADE Agent Platform [ ] The Agent Society Framework [Silva et al., 2004] Silva, V. T. da; Cortês, M. I.; de Lucena, C. J. P. An Object-Oriented Framework for Implementing Agent Societies. PUC-Rio Technical Report, Current Implementation Solutions for MAS Engineering: rq.i. Permits the Mobility Property of Agents? rq.ii. Supports the Direct Implementation of Agent Societies? rq.iii. Is a Well-Known Platform for MAS Implementation? rq.irq.iirq.iii JADE V X V ASFX V X

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Background and Related Research Norm Enforcement –Moses [Minsky and Ungureanu, 2000] –AMELI [Esteva et al., 2004] –S-MOISE + [Hübner et al., 2006] –SCAAR [Chopinaud et al., 2006] –M-Law [Paes et al., 2007] Hübner, J.F.; Sichman, J.S.; Boissier, O. S-MOISE+: a middleware for developing organised multi-agent systems. OOOP’2005, LNCS 3913, Chopinaud, C.; et al. Prevention of harmful behaviors within cognitive and autonomous agents. ECAI’06, p. 205–209, Paes, R. et al. Enhancing the Environment with a Law-Governed Service for Monitoring and Enforcing Behavior in Open Multi-Agent Systems. LNAI 4389, 2007, p. 221–238. Esteva, M; et al. AMELI: An Agent-based Middleware for Electronic Institutions. AAMAS, 2004, p. 236–243. Minsky, N.; Ungureanu, V. Law-Governed Interaction: A Coordination & Control Mechanism for Heterogeneous Distributed Systems. TOSEM, 9(3), p. 273–305, 2000.

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Background and Related Research Current Norm Enforcement Solutions: rq.i. Explicitly Supports the Implementation of an Organizational Normative Dimension? rq.ii. Has a Manager/Governor/Police Agent for Norm Enforcement? rq.iii. Directly Enforces Prohibition Norms? rq.iv. Makes Distinction Between the Implementation of an Organization Entity and a Group of Roles? I.e., is the Organization Concept an Explicit Entity in the Implementation? rq.v. Can the Structure of the System (in any Dimension, e.g. the Normative one) Evolve at MAS Execution Time? rq.vi. Has the Implementation a Conceptual Model to Guide its Specifications? rq.irq.iirq.iiirq.ivrq.vrq.vi MosesX V XX–X AMELIX V XXX V S-M OISE + VV XX VV SCAARXX V ––X M-LawX V X–– V

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Contextual Norm Information Provision DynaCROM –A Methodology for System Developers –An Information Mechanism for Application Agents

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Contextual Norm Information Provision The DynaCROM Methodology for System Developers: –Includes the Phases of Contextualization, Concretization, Representation and Compositions of Norms. A(n Abstract) Payment Norm for Effecting a Negotiation: Negotiations are obliged to be paid by using the national currency of the seller’s country. A Concrete Environment Norm for Effecting a Negotiation: Negotiations are obliged to be paid (i) in USA, with American dollars (USD); and, (ii) in Japan, with Japanese Yen (JPY).

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Contextual Norm Information Provision

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Contextual Norm Information Provision

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Contextual Norm Information Provision (1)[DynaCROMRule_EnvWithOEnvNorms: (2) hasNorm(?Env,?OEnvNorms) (3) <- hasNorm(?OEnv,?OEnvNorms), (4) belongsTo(?Env,?OEnv)] Missouri USA OblToPayWithNationalCurrency

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Contextual Norm Information Provision

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Contextual Norm Enforcement A Posteriori Norm Enforcement A Priori Norm Enforcement Norm Enforcement Based on the Agents’ External Behavior Norm Enforcement Based on the Agents’ Internal Behavior DynaCROM: An Input Mechanism for Norm Enforcement Solutions

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Contextual Norm Enforcement DynaCROM as an Input Mechanism for Norm Enforcement Solutions Agent Contexts abcd abcdabcd abcd obligation Applicable Norms Agent Actions abcd abcdabcd abcd obligation Concretized Agent’s Contextual Norms Agent Contexts Norm Enforcement An Enforcer Concretizing Agent’s Contextual Norms abcd abcdabcd abcd abcd abcdabcd DynaCROM abcd abcdabcd abcd abcd abcdabcd Violated Norms abcd abcdabcd abcd abcd abcdabcd Violated Norms

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Contextual Norm Enforcement Norm Enforcement Based on the Agents’ External Behavior MissourianManufacturer JapaneseSupplier SupplierPolice ManufacturerPolice CFP(computer,100) PROPOSE(JPY, ) getDynaCROMInfo(NationalCurrency) INFORM(Nok,NationalCurrency) PROPOSE(JPY, ) X

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Contextual Norm Enforcement - MOSES (1) public void sent(…){ (2) if (message.startsWith(“PROPOSE")){… (3) doForward(); (4) return; (5) }} (6) public void arrived(…){ (7) if (message.startsWith("PROPOSE")){… (8) doAdd(“proposedCurrency(“ + getMessageContent(message) + ")"); (9) if “OblToPayWithNationalCurrency” isIn domainEnv.hasNorm{… (10) doImposeObligation("checkNationalCurrency",1,"sec")}; … (11) return; (12) }} (13) public void obligationDue(Term obligationTerm){ (14) if (obligationTerm.equals("checkNationalCurrency")){… (15) if (proposedCurrency.equals(getDynaCROMInfo(NationalCurrency ) )){ (16) doForward(); (17) doDeliver(CS.toString(),“INFORM(Ok)", sourceAddress); …} (18) else{ (19) doDeliver(CS.toString(),“INFORM(Nok,NationalCurrency)", sourceAddress); …} (20) …}}

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Contextual Norm Enforcement - SCAAR Norm Enforcement Based on the Agents’ Internal Behavior (1) SCAARNorm_OblToPayWithNationalCurrency: (2) [OBLIGED (agt DO pay(agtCurrency) AND (agtCurrency == domainEnv.hasCurrency)) (3) IF (agt BE in Environment AND (agtEnv == domainEnv) (4) AND (“OblToPayWithNationalCurrency” isIn (domainEnv.hasNorm)))] MissourianManufacturer JapaneseSupplier CFP(computer,100) PROPOSE(JPY, ) getDynaCROMInfo(NationalCurrency, msg.sender) X

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Applications of DynaCROM Market Based Control DescriptionBase price ( in USD)Supplier CPU750Pintel CPU650IMD Motherboard350Macrostar Motherboard300Basus Memory100Macrostar Memory100Basus Hard disk250Macrostar Hard disk250Basus OrganizationCountryState PintelUSAMissouri IMDUSAVirginia BasusJapanOsaka BasusUSAUSACalifornia MacrostarChinaShanghai MacrostarJapanJapanHiroshima

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Applications of DynaCROM – Market Based Control Concrete Interaction Norms for Providing Discounts: (a) Pintel and Macrostar suppliers are permitted to offer 15% discount if their products are bought in bundles; and, (b) IMD and Basus suppliers are permitted to offer 10% discount if their products are bought in bundles. A Concrete Role Norm for Accepting Placed Orders: (a) IMD suppliers are obliged to request a down payment of 10% for accepting placed orders. A Concrete Political Norm for Making Deals: American and Japanese organizations are prohibited from dealing with each other when their countries are undergoing political crisis. A Concrete Economical Norm for Operating in the Market: Chinese organizations are obliged to fix their prices for, at least, six months when their competing Japanese organizations are not operating in the market.

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Applications of DynaCROM TV Broadcasting

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Applications of DynaCROM – TV Broadcasting

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Applications of DynaCROM – TV Broadcasting (1) SCAARNorm_OblToPresentTVRatingInfo: (2) [OBLIGED (agt DO screenATVProg(agtTVProg) AND ((agtTVProg.TVRatingInfo) isIn ((domainTVBT.hasTVContentRatingSystem).hasTVContentRating))) (3) IF (agt BE in TVBroadcaster AND (agtTVBT == domainTVBT) (4) AND (“OblToPresentTVRatingInfo” isIn (domainTVBT.hasNorm)))] (2)…((agtTVProg.TVRatingInfo) isIn ((GTV).hasTVContentRatingSystem).hasTVContentRating))) … ((NineCRS).hasTVContentRating) … (NotSuitableForPeopleUnder15,NotSuitableForPeopleUnder18) …] (1)[DynaCROMRule_TVBroadCWithContentRatSystem: (2) hasTVContentRatingSystem(?TVBroadcaster,?TVCorpCRS) (3) <- hasTVContentRatingSystem(?TVCorp,?TVCorpCRS), (4) isMemberOf(?TVBroadcaster,?TVCorp)]

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio DynaCIP DynaCIP (Dynamic Contextual Protocol Information Provision) [DynaCIPRule_RoleWithOrgProtocols: hasProtocol(?Role,?OrgProtocols) <- hasProtocol(?Org,?OrgProtocols), isPlayedIn(?Role,?Org)] [DynaCIPRule_OrgWithEnvProtocols: hasProtocol(?Org,?OrgEnvProtocols) <- hasProtocol(?OrgEnv,?OrgEnvProtocols), isIn(?Org,?OrgEnv)]

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Conclusion Three main assumptions underlie this research: –Monolithic Architectures (based on Objects) -> Distributed Ones (based on Agents); –With the Advent of the Semantic Web -> Agents will be able to process information from different sources; -> Agents will be able to obtain resources and/or services not found locally. -> Systems will be open. –Openness without control leads to chaotic scenarios -> Normative MAS.

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Conclusion – Thesis Contributions A Top-Down Classification for Contextual Norms –Facilitates the tasks of elucidation, organization and management of norm information; A Contextual Normative Ontology –Explicitly represent the semantics of classified norms in a meaningful way (i.e., with a common understanding) for heterogeneous agents; A Norm Composition Process, based on Ontology-Driven Rules –Makes it easy to update the system regulation by evolving norms in a unique resource (an ontology) and by customizing particular rules for different compositions of contextual norms; A Solution for Informing and/or Enforcing Contextual Norms.

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Conclusion – Thesis Contributions Current Modeling Solutions for MAS Engineering: rq.i. Explicitly Supports the Organizational Normative Dimension? rq.ii. Has the Conceptual Model an Implemented Solution for It? rq.iii. Supports the Management of Norms to be done at System Runtime? rq.iv. Provides the way for Norm Representation with a Common Understanding for Heterogeneous Agents? rq.v. Has an Editor, preferably a Graphical one, for its Specifications? rq.vi. Has a Semi-/Automatic Solution for the Verification of its Specifications? rq.irq.iirq.iiirq.ivrq.vrq.vi OMNIVX–VXX MOISE+VVVVXX ISLANDERXVVVVV DynaCROM VVVVV X

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Conclusion – Thesis Contributions Current Norm Enforcement Solutions: rq.i. Explicitly Supports the Implementation of an Organizational Normative Dimension? rq.ii. Has a Manager/Governor/Police Agent for Norm Enforcement? rq.iii. Directly Enforces Prohibition Norms? rq.iv. Makes Distinction Between the Implementation of an Organization Entity and a Group of Roles? I.e., is the Organization Concept an Explicit Entity in the Implementation? rq.v. Can the Structure of the System (in any Dimension, e.g. the Normative one) Evolve at MAS Execution Time? rq.vi. Has the Implementation a Conceptual Model to Guide its Specifications? rq.i rq.iirq.iii rq.ivrq.vrq.vi DynaCROM_Moses V VX VVV DynaCROM_SCAAR V XV VVV

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Conclusion – Future Work DynaCROM does not encompass a Formal Method amenable to rigorous verification of the system developer’s specifications; DynaCROM is currently dealing with Regulative Norms. DynaCROM can also deal with constitutive, procedural and conditional norms; DynaCROM does not consider Time Restrictions in norms; DynaCROM can support the Implementation of the Legis Superior and Legis Specialis Strategies for conflict resolution; DynaCROM is not currently dealing with possible conflicts that exist among norms from different normative contexts; JADE behaviors are never interrupted -> DynaCROM should have a mechanism to Limit the Execution Time of JADE Behaviors.

August 13, /35 Carolina Howard Felicíssimo © LES/PUC-Rio Thesis Publications Two Book Chapters: –Post Proceedings of LNCS 4898, p. 19–36, 2008; –Post Proceedings of LNCS 4386, p. 147–162, Full Paper in Two Conferences: –23rd Annual ACM Symposium on Applied Computing (ACM SAC 2008); –4th International Conference on Intelligent Environments (IE'08). Full Paper in Seven Workshops: Two Short Papers in a Symposium: –AAAI Fall Symposium: Roles, an Interdisciplinary Perspective: Ontologies, Programming Languages, and Multiagent Systems

Thanks.