Nardine Osman

Researcher

Artificial Intelligence Research Institute (IIIA),
Spanish National Research Council (CSIC)

  • Campus UAB, 08193 Bellaterra, Spain
  • nardine@iiia.csic.es
  • +34 93 580 9570
  • PhD in Informatics
    2008 – The University of Edinburgh, UK
  • MSc in Informatics
    2003 – The University of Edinburgh, UK
  • BEng in Computer & Communications Eng.
    2001 – American University of Beirut, Lebanon
All Projects Scientific
Management Scientific
Contributions Books &
Book Chapters Journal
Articles

Projects

International Projects Participated In

  • OPRM: Open Peer Review Module

    Funding body: European Commission, funded through the OpenAIRE Open Peer Review Tenders call
    Funding amount: € 25,000
    Project number: OPRM
    Project duration: 01 August 2015 – 31 January 2016
    Coordinator: Pandelis Perakakis (Open Scholar)
    Partners: Open Scholar (UK), Artificial Intelligence Research Institute / IIIA-CSIC (Spain), DIGITAL.CSIC (Spain), e-IEO (Spain), SECABA Lab (Spain), Arvo Consultores y Tecnología (Spain)

  • PRAISE: Practice and peRformance Analysis Inspiring Social Education

    Funding body: European Commission, funded under the Seventh Framework Programme
    Funding amount: € 2.3 million
    Project number: FP7-318770
    Project duration: 01 October 2012 – 30 September 2015
    Coordinator: Carles Sierra (IIIA-CSIC)
    Partners: Artificial Intelligence Research Institute / IIIA-CSIC (Spain), Goldsmiths' College (UK), Sony Computer Science Laboratory (France), Vrije Universiteit Brussel (Brussels)

  • ACE: Autonomic software engineering for online Cultural Experiences

    Funding body: European Commission, funded under the FP7 ERA-Net funding scheme (CHIST-ERA 2010)
    Funding amount: € 500,000
    Project number: ACE
    Project duration: 01 September 2011 – 31 August 2013
    Coordinator: Carles Sierra (IIIA-CSIC)
    Partners: Artificial Intelligence Research Institute / IIIA-CSIC (Spain), Goldsmiths' College (UK), Toulouse Institute of Computer Science Research / IRIT-CNRS (France)

  • Liquid Publications: Innovating the scientific knowledge object lifecycle

    Funding body: European Commission, funded under the Seventh Framework Programme
    Funding amount: € 1.77 million
    Project number: FP7-213360
    Project duration: 01 May 2008 – 30 April 2011
    Coordinator: Fabio Casati (University of Trento)
    Partners: National Center for Scientific Research / CNRS (France), University of Fribourg (Switzerland), Artificial Intelligence Research Institute / IIIA-CSIC (Spain), Springer-Verlag (Germany), University of Trento (Italy)

  • OpenKnowledge

    Funding body: European Commission, funded under the Sixth Framework Programme
    Funding amount: € 3.88 million
    Project number: FP6-027253
    Project duration: 01 January 2006 – 31 December 2008
    Coordinator: David Robertson (University of Edinburgh)
    Partners: University of Edinburgh (UK), Artificial Intelligence Research Institute / IIIA-CSIC (Spain), Open University (UK), University of Southampton (UK), University of Trento (Italy), Vrije Universiteit Amsterdam (Netherlands)
British National Projects Participated In

  • AKT: Advanced Knowledge Technologies

    Funding body: Engineering and Physical Sciences Research Council (EPSRC), UK
    Funding amount: £ 7.53 million
    Project number: GR/N15764/01
    Project duration: 01 October 2000 – 30 June 2007
    Coordinator: Nigel Shadbolt (University of Southampton)
    Partners: University of Aberdeen (UK), University of Edinburgh (UK), Open University (UK), University of Sheffield (UK), University of Southampton (UK)
Spanish National Projects Participated In

  • EVOLVE: Self-evolving software-mediated communities

    Funding body: The Spanish National Research Council (CSIC), Spain, funded by a non-competitive contract
    Funding amount: € 237,138
    Project number: 201550E076
    Project duration: 01 September 2015 – 31 August 2018
    Coordinator: Carles Sierra (IIIA-CSIC)
    Partners: Artificial Intelligence Research Institute / IIIA-CSIC (Spain)

  • AC: Agreement Computing

    Funding body: Ministry of Economy and Competitiveness, Spain, funded under CONVOCATORIA 2015 - EXCELENCIA
    Funding amount: € 51,500
    Project number: TIN2015-68950-REDC
    Project duration: 19 December 2015 – 29 December 2017
    Coordinator: Carles Sierra (IIIA-CSIC)
    Partners: Artificial Intelligence Research Institute / IIIA-CSIC (Spain), Universidad Rey Juan Carlos (Spain), Universitat Politècnica de València (Spain)

  • uHelp: uHelp Dinamizacion

    Funding body: Ministry of Economy and Competitiveness, Spain, funded under CONVOCATORIA 2015 - EUROPA INVESTIGACIÓN
    Funding amount: € 24,900
    Project number: EUIN2015-62530
    Project duration: 01 September 2015 – 31 August 2017
    Coordinator: Carles Sierra (IIIA-CSIC)
    Partners: Artificial Intelligence Research Institute / IIIA-CSIC (Spain)

  • CollectiveMind: A cognitive approach for modelling and reasoning over shared experiences

    Funding body: Ministry of Economy and Competitiveness, Spain, funded under CONVOCATORIA 2013 - EXPLORA
    Funding amount: € 90,750
    Project number: TEC2013-49430-EXP
    Project duration: 01 September 2014 – 31 January 2017
    Coordinator: Carles Sierra (IIIA-CSIC)
    Partners: Artificial Intelligence Research Institute / IIIA-CSIC (Spain)

  • AT: Agreement Technologies

    Funding body: Ministry of Science and Innovation, Spain, funded under CONSOLIDER - INGENIO 2010
    Funding amount: € 5.5 million
    Project number: CSD 2007-00022
    Project duration: 01 September 2007 – 31 December 2014
    Coordinator: Carles Sierra (IIIA-CSIC)
    Partners: Artificial Intelligence Research Institute / IIIA-CSIC (Spain), Universidad Rey Juan Carlos (Spain), Universitat Politecnica de Valencia (Spain)

  • CBIT: Community-Building Information Technology

    Funding body: Ministry of Science and Innovation, Spain, funded under CONVOCATORIA 2010
    Funding amount: € 60,984
    Project number: TIN2010-16306
    Project duration: 01 January 2011 – 31 December 2013
    Coordinator: Marco Schorlemmer (IIIA-CSIC)
    Partners: Artificial Intelligence Research Institute / IIIA-CSIC (Spain)
Industry Projects Participated In

  • GEAR: Strategic Management of High Performance Sales Teams

    Funding body: ACCIO, Catalan Government, Spain
    Funding amount: € 110,000
    Project number: INNOEMPRESA IEDES12/1/0025
    Project duration: 06 May 2012 – 09 May 2013
    Coordinator: Carles Sierra (IIIA-CSIC)
    Partners: Artificial Intelligence Research Institute / IIIA-CSIC (Spain), and Enzyme Advising Group (Spain)

Scientific Management

Scientific Coordinator (EU Proposals)

  1. Collective Mind proposal [scored=4.55/5.00 , to be re-submitted on 25/09/2017 to the H2020 FET Open call]
  2. uHelp proposal [submitted to the EU H2020-ICT-11-2017 call , awaiting decision]
  3. RESPECT proposal [submitted to the EU H2020-ICT-35-2016 call , awaiting decision]

Lead Investigator

  1. Collective Mind project [Spanish Funded]
  2. Open Peer Review Module for Repositories project [EC funded]
  3. Liquid Publications project [EC funded]

Group Leader

  1. Currently leading the work on evolving norms — the EVOLVE project [Spanish Funded]
  2. Currently leading the work on designing the uHelp app and algorithms — the uHelp project [Spanish Funded]
  3. Lead IIIA's work on reputation — the PRAISE Project [EC Funded]
  4. Lead IIIA's work on the evolution of charters — the CBIT Project [Spanish funded]
  5. Lead IIIA's work on shared experiences & collective intentionality — the ACE Project [EC funded]

Proposal Writing

  1. Lead the writing of the Collective Mind proposal [scored=4.55/5.00 , to be re-submitted Sept. 2017 to H2020-FET-Open]
  2. Lead the writing of the uHelp proposal [submitted to the EU H2020-ICT-11-2017 call , awaiting decision]
  3. Lead the writing of the RESPECT proposal [submitted to the EU H2020-ICT-35-2016 call , awaiting decision]
  4. Lead the writing of the PRAISE proposal [EU call, accepted & completed ]
  5. Lead the writing of the Pragmatic Web proposal [EU call, rejected ]
  6. Lead the writing of the Collective Mind proposal [Spanish call, accepted & completed ]
  7. Substantially contributed to the writing of the ECOSustain proposal [EU call, rejected ]

Scientific Contributions

ARM

Academic reputation model: calculating the reputation of researchers & research work based on peer reviews (instead of citations).
Projects: OPRM
Publications:
  • Nardine Osman and Carles Sierra. ARM: an academic reputation model. Engineering Applications of Artificial Intelligence. Elsevier, Under review.
  • Pandelis Perakakis, Agnes Ponsati, Isabel Bernal, Carles Sierra, Nardine Osman, Concha Mosquera de Arancibia, and Emilio Lorenzo. OPRM: Challenges to including open peer review in open access repositories. Code4Lib Journal, 35, January 2017.
  • Nardine Osman and Carles Sierra. Reputation in the academic world. In Gal A. Kaminka, Maria Fox, Paolo Bouquet, Eyke Hüllermeier, Virginia Dignum, Frank Dignum, and Frank van Harmelen, editors, Proceedings of the 22nd European Conference on Artificial Intelligence (ECAI 2016), volume 285 of Frontiers in Artificial Intelligence and Applications, pages 1614–1615. IOS Press, 2016.
  • Nardine Osman and Carles Sierra. Reputation in the academic world. In Rubén Fuentes-Fernández and Marin Lujak, editors, Proceedings of the 1st International Workshop on Ambient Intelligence for Large Premises (AmILP 2016), co-located with the 22nd European Conference on Artificial Intelligence (ECAI 2016), CEUR Workshop Proceedings. CEUR-WS.org, 2016.
  • Nardine Osman and Carles Sierra. Reputation in the academic world. In Jie Zhang, Robin Cohen, and Murat Sensoy, editors, Proceedings of the 18th International Workshop on Trust in Agent Societies, co-located with the 15th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2016), volume 1578 of CEUR Workshop Proceedings, pages 1–17. CEUR-WS.org, 2016.
Applications:
  • A pilot is running on the Digital.CSIC repository
  • A pilot is running on the e-IEO repository
  • A pilot is being tested with the conference management system, ConfMaster.net , with the IJCAI 2017 conference
Other:
  • Technology readiness level 6 (TRL 6) – "system prototype demonstration in operational environment"
  • Code available online

uHelp

An app for finding volunteers within one's social network to help with daily activities (e.g. caring for a child, picking up the grocery).
Projects: CBIT, uHelp
Publications:
  • Nardine Osman, Andrew Koster, Marco Schorlemmer, Carles Sierra, and Jordi Sabater-Mir. The uHelp application. In Nardine Osman, editor, Electronic Institutions and their Applications. Springer, In Press.
  • Nardine Osman, Bruno Rosell, Carles Sierra, Marco Schorlemmer, Jordi Sabater-Mir, and Lissette Lemus. uHelp: intelligent volunteer search for mutual help communities. Engineering Applications of Artificial Intelligence. Elsevier, Under review.
  • Andrew Koster, Jordi Madrenas, Nardine Osman, Marco Schorlemmer, Jordi Sabater-Mir, Carles Sierra, Angela Fabregues, Dave de Jonge, Josep Puyol-Gruart, and Pere Garcia-Calveés. u-Help: supporting helpful communities with information technology. In Proceedings of the 12th International Conference on Autonomous Agents and Multi-agent Systems (AAMAS 2013), pages 1109–1110, Richland, SC, May 2013. International Foundation for Autonomous Agents and Multiagent Systems.
  • Andrew Koster, Jordi Madrenas-Ciurana, Nardine Osman, Marco Schorlemmer, Jordi Sabater-Mir, Carles Sierra, Dave de Jonge, Angela Fabregues, Josep Puyol-Gruart, and Pere Garcia-Calveés. u-Help: supporting helpful communities with information technology. In Sascha Ossowski, Francesca Toni, and George Vouros, editors, Proceedings of the 1st International Conference on Agreement Technologies (AT 2012), volume 918, pages 378–392. CEUR Workshop Proceedings, October 2012.
Applications:
  • A pilot has been tested with a community of single mothers, from the Federació Catalana de Famílies Monoparentals
  • Additional pilots are planned for in the RESPECT and uHelp European projects (under review), where uHelp will be applied to domains focusing on providing support for the elderly, refugees, and additional single parent communities
Other:
  • Technology readiness level 6 (TRL 6) – "system prototype demonstration in operational environment"
  • App available on Apple Store and Google Play
  • Copyrighted

PeerLearn

A web platform for specifying & executing pedagogical workflows (lesson plans) using P2P Electronic Institutions, integrating a number of services, such as COMAS, which automates the assessment process in classrooms by relying on peer assessments.
Projects: PRAISE
Publications:
  • Dave de Jonge, Bruno Rosell, Patricia Gutierrez, Nardine Osman, and Carles Sierra. The PeerLearn application. In Nardine Osman, editor, Electronic Institutions and their Applications. Springer, In Press.
  • Ismel Brito, Patricia Gutierrez, Katina Hazelden, Dave de Jonge, Lisette Lemus, Nardine Osman, Bruno Rosell, Carles Sierra, and Carme Roig. Collaborative peer assessment using PeerLearn. In Luc Steels, editor, Music Learning with Massive Open Online Courses (MOOCs), volume 6 of The Future of Learning, chapter 10, pages 145–174. IOS Press, 2015.
Applications:
  • A prototype has been tested with an English classroom at the INS Torres i Bages school in Hospitalet, Barcelona
  • A prototype has been tested with music professors and students at the Catalonia College of Music, ESMUC, Barcelona
  • A related mobile app is being finalised (by Angela Fabregues), and will be tested with the same English classroom at the INS Torres i Bages school in Hospitalet, Barcelona. The app allows teachers to upload assignments, students to upload their work and assess each other, and the integrated COMAS algorithm computes and suggests (to the teacher) students' marks.
Other:
  • Technology readiness level 5 (TRL 5) – "technology validated in relevant environment"
  • PeerFlow is accessible online

PAAS

The second automated assessments model for online learning, improving on COMAS (below).
Projects: PRAISE
Publications:
  • Nardine Osman, Ewa Andrejczuk, Juan Antonio Rodriguez-Aguilar, and Carles Sierra. Collaborative assessments in on-line classrooms. In Fernando Koch, Andrew Koster, Tiago Primo, and Christian Guttmann, editors, Advances in Social Computing and Digital Education, volume 677 of CCIS. Springer, 2017.
  • Patricia Gutierrez, Nardine Osman, Carme Roig, and Carles Sierra. Personalised automated assessments. In Catholijn M. Jonker, Stacy Marsella, John Thangarajah, and Karl Tuyls, editors, Proceedings of the 15th International Conference on Autonomous Agents & Multiagent Systems (AAMAS 2016), pages 1115–1123. ACM, 2016.
  • Patricia Gutierrez, Nardine Osman, and Carles Sierra. Personalised automated assessments. In Nardine Osman and Matthew Yee-King, editors, Proceedings of the First International Workshop on AI and Feedback, AInF 2015, co-located with the 24th International Joint Conference on Artificial Intelligence (IJCAI 2015), volume 1407 of CEUR Workshop Proceedings, pages 40–46. CEUR-WS.org, 2015.
Applications:
  • A prototype has been tested with an English classroom at the INS Torres i Bages school in Hospitalet, Barcelona (using the same data as in COMAS below)
Other:
  • Technology readiness level 5 (TRL 5) – "technology demonstrated in relevant environment"

COMAS

The first automated assessments model for online learning.
Projects: PRAISE
Publications:
  • Patricia Gutierrez, Nardine Osman, Carme Roig, and Carles Sierra. Trust-based community assessment. Pattern Recognition Letters, 67(P1):49–58, December 2015.
  • Patricia Gutierrez, Nardine Osman, and Carles Sierra. Collaborative assessment. In Lledoó Museros Cabedo, Oriol Pujol, and Núria Agell, editors, Artificial Intelligence Research and Development – Recent Advances and Applications, (CCIA 2014), volume 269 of Frontiers in Artificial Intelligence and Applications, pages 136–145. IOS Press, 2014.
  • Patricia Gutierrez, Nardine Osman, and Carles Sierra. Collaborative assessment. In Sergio Gutiérrez Santos and Olga C. Santos, editors, Proceedings of the Workshops held at Educational Data Mining 2014, co-located with 7th International Conference on Educational Data Mining (EDM 2014), volume 1183 of CEUR Workshop Proceedings. CEUR-WS.org, 2014.
Applications:
  • A prototype has been tested with an English classroom at the INS Torres i Bages school in Hospitalet, Barcelona (using the same data as in PAAS above)
  • A prototype has also been developed as a service and integrated into the PeerLearn system (above), also tested with the English classroom at the INS Torres i Bages school in Hospitalet, Barcelona
Other:
  • Technology readiness level 5 (TRL 5) – "technology demonstrated in relevant environment"
  • Copyrighted

Consuasor

A trust model for finding trustworthy advice and advisers.
Projects: PRAISE
Publications:
  • Nardine Osman, Patricia Gutierrez, and Carles Sierra. Trustworthy advice. Knowledge-Based Systems, 82(C):41–59, July 2015.
  • Nardine Osman, Patricia Gutierrez, and Carles Sierra. Trustworthy advice. In Torsten Schaub, Gerhard Friedrich, and Barry O'Sullivan, editors, Proceedings of the 21st European Conference on Artificial Intelligence (ECAI 2014), volume 263 of Frontiers in Artificial Intelligence and Applications, pages 1073–1074. IOS Press, 2014.
Other:
  • Technology readiness level 4 (TRL 4) – "technology validated in lab"

WeCurate

An app for curating content together.
Projects: ACE
Publications:
  • Matthew Yee-King, Dave de Jonge, Roberto Confalonieri, Nardine Osman, Mark d'Inverno, Carles Sierra, Leila Amgoud, and Katina Hazelden. The WeCurate application. In Nardine Osman, editor, Electronic Institutions and their Applications. Springer, In Press.
  • Roberto Confalonieri, Matthew Yee-King, Katina Hazelden, Mark d'Inverno, Dave de Jonge, Nardine Osman, Carles Sierra, Leila Agmoud, and Henri Prade. Engineering multiuser museum interactives for shared cultural experiences. Engineering Applications of Artificial Intelligence, 46(PA):180–195, November 2015.
  • Matthew Yee-King, Roberto Confalonieri, Dave de Jonge, Katina Hazelden, Carles Sierra, Mark d'Inverno, Leila Amgoud, and Nardine Osman. Multiuser museum interactives for shared cultural experiences: an agent-based approach. In Proceedings of the 12th International Conference on Autonomous Agents and Multi-agent Systems (AAMAS 2013), pages 917–924, Richland, SC, May 2013. International Foundation for Autonomous Agents and Multiagent Systems.
  • Katina Hazelden, Matthew Yee-King, Roberto Confalonieri, Carles Sierra, Fiammetta Ghedini, Dave de Jonge, Nardine Osman, and Mark d'Inverno. WeCurate: multiuser museum interactives for shared cultural experiences. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, Extended Abstracts (CHI 2013), pages 571–576, New York, NY, USA, April–May 2013. ACM.
  • Leila Amgoud, Roberto Confalonieri, Dave Jonge, Mark d'Inverno, Katina Hazelden, Nardine Osman, Henri Prade, Carles Sierra, and Matthew Yee-King. Sharing online cultural experiences: an argument-based approach. In Vicenç Torra, Yasuo Narukawa, Beatriz López, and Mateu Villaret, editors, Proceedings of the 9th International Conference on Modeling Decisions for Artificial Intelligence (MDAI 2012), volume 7647 of Lecture Notes in Computer Science, pages 282–293, Berlin, Heidelberg, Germany, November 2012. Springer-Verlag.
  • Leila Amgoud, Roberto Confalonieri, Dave de Jonge, Mark D'Inverno, Katina Hazelden, Nardine Osman, Henri Prade, Carles Sierra, and Matthew Yee-King. WeCurate: designing for synchronised browsing and social negotiation. In Sascha Ossowski, Francesca Toni, and George Vouros, editors, Proceedings of the 1st International Conference on Agreement Technologies (AT 2012), volume 918, pages 168–179. CEUR Workshop Proceedings, October 2012.
  • Matthew Yee-King, Roberto Confalonieri, Dave de Jonge, Nardine Osman, Katina Hazelden, Leila Amgoud, Henri Prade, Carles Sierra, and Mark d'Inverno. Towards community browsing for shared experiences: the WeBrowse system. In Sascha Ossowski, Francesca Toni, and George Vouros, editors, Proceedings of the 1st International Conference on Agreement Technologies (AT 2012), volume 918, pages 201–202. CEUR Workshop Proceedings, October 2012.
Applications:
  • A prototype has been tested in a 5-day trial at the Horniman Museum, London
  • A prototype has been presented to the public to play with at "La Fiesta de la Ciencia y la Tecnología 2013", Barcelona
Other:
  • Technology readiness level 5 (TRL 5) – "technology validated in relevant environment"

X-BDI

An experience-based logic for collective intentionality.
Projects: ACE
Publications:
  • Nardine Osman, Mark d'Inverno, Carles Sierra, Leila Amgoud, Henri Prade, Matthew Yee-King, Roberto Confalonieri, Dave de Jonge, and Katina Hazelden. An experience-based BDI logic: motivating shared experiences and intentionality. In Proceedings of the 39th Annual Conference of the IEEE Industrial Electronics Society (IECON 2013), pages 6654–6659. IEEE, November 2013. Best Paper Award in session on "Cognitive Architectures and Multi-Agent Systems".
  • Leila Amgoud, Mark d'Inverno, Nardine Osman, Henri Prade, and Carles Sierra. Experiences – a forgotten component of epistemic states. In Sascha Ossowski, Francesca Toni, and George Vouros, editors, Proceedings of the 1st International Conference on Agreement Technologies (AT 2012), volume 918, pages 220–230. CEUR Workshop Proceedings, October 2012.
Applications:
  • Planned work in the Collective Mind European project (scored=4.55/5.00 , to be re-submitted on 25/09/2017 to the H2020 FET Open call), where an X-BDI based collective mind learns and reasons about the needs of the individuals and the collective, and acts proactively to enhance collective well-being.
Other:
  • Technology readiness level 3 (TRL 3) – "experimental proof of concept"

OpinioNet

A trust model based on propagating opinions in structural graphs.
Projects: Liquid Publications
Publications:
  • Nardine Osman, Carles Sierra, Jordi Sabater-Mir, Joseph R. Wakeling, Judith Simon, Gloria Origgi, and Roberto Casati. LiquidPublications and its technical and legal challenges. In Danièle Bourcier, Pompeu Casanovas, Mélanie Dulong de Rosnay, and Catharina Maracke, editors, Intelligent Multimedia: Managing Creative Works in a Digital World, volume 8 of Legal Information and Communication Technologies, pages 321–336. European Publishing Academic Press, Florence, Italy, May 2010.
  • Aliaksandr Birukou, Joseph R. Wakeling, Claudio Bartolini, Fabio Casati, Maurizio Marchese, Katsiaryna Mirylenka, Nardine Osman, Azzurra Ragone, Carles Sierra, and Aalam Wassef. Alternatives to peer review: novel approaches for research evaluation. Frontiers in Computational Neuroscience, 5(56), December 2011.
  • Nardine Osman, Carles Sierra, and Jordi Sabater-Mir. Propagation of opinions in structural graphs. In Helder Coelho, Rudi Studer, and Michael Wooldridge, editors, Proceedings of the 19th European Conference on Artificial Intelligence (ECAI 2010), volume 215 of Frontiers in Artificial Intelligence and Applications, pages 595–600, Amsterdam, The Netherlands, August 2010. IOS Press.
  • Nardine Osman, Jordi Sabater-Mir, and Carles Sierra. Simulating research behaviour. In Daniel Villatoro, Jordi Sabater-Mir, and Jaime S. Sichman, editors, Multi-Agent-Based Simulation XII: 12th International Workshop (MABS 2011), Revised Selected Papers, volume 7124 of Lecture Notes in Computer Science, pages 15–30, Berlin, Heidelberg, May 2012. Springer-Verlag.
  • Nardine Osman, Carles Sierra, and Angela Fabregues. A propagation and aggregation algorithm for inferring opinions in structural graphs. In the 13th International Workshop on Trust In Agent Societies, at the 9th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS 2010), May 2010.
Applications:
  • Provided inspiration for the ARM model (above)
  • Used in uHelp (above) for calculating semantic similarity in meronomies
  • Used in Consuasor (above) to compute plan empowerment in meronomies
Other:
  • Technology readiness level 4 (TRL 4) – "technology validated in lab"

MORE

A reputation model based on mutual opinions.
Projects: Agreement Technologies
Publications:
  • Nardine Osman, Alessandro Provetti, Valerio Riggi, and Carles Sierra. MORE: merged opinions reputation model. In Nils Bulling, editor, Proceedings of the 12th European Conference on Multi-Agent Systems (EUMAS 2014), volume 8953 of Lecture Notes in Computer Science, pages 67–81, Berlin, Heidelberg, Germany, 2015. Springer.
Applications:
  • A proof of concept has been tested with football data
  • A proof of concept has been tested with chess data
Other:
  • Technology readiness level 4 (TRL 4) – "technology validated in lab"

TrustIt

A trust model for finding suitable collaborators, based on learning from similar past experiences.
Projects: OpenKnowledge, Agreement Technologies, GEAR
Publications:
  • Nardine Osman, Carles Sierra, Fiona McNeill, Juan Pane, and John Debenham. Trust and matching algorithms for selecting suitable agents. ACM Transactions on Intelligent Systems and Technology, 5(1):Article 16, pp. 16:1–16:39, January 2014.
Applications:
  • The final product is used in the iKey Performance app of Enzyme Advising Group
Other:
  • Technology readiness level 9 (TRL 9) – "actual system proven in operational environment"
  • Copyrighted

MCID

A runtime model checker for verifying interactions in distributed open systems.
Projects: PhD thesis, AKT
Publications:
  • Nardine Osman and David Robertson. Dynamic verification of trust in distributed open systems. In Manuela M. Veloso, editor, Proceedings of the 20th International Joint Conference on Artificial Intelligence (IJCAI 2007), pages 1440–1445, Menlo Park, CA, USA, January 2007. AAAI Press.
  • Nardine Osman, David Robertson, and Christopher Walton. Run-time model checking of interaction and deontic models for multi-agent systems. In Hideyuki Nakashima, Michael P. Wellman, Gerhard Weiss, and Peter Stone, editors, Proceedings of the 5th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS 2006), pages 238–240, New York, NY, USA, May 2006. ACM.
  • Nardine Osman, David Robertson, and Christopher Walton. Dynamic model checking for multi-agent systems. In Matteo Baldoni and Ulle Endriss, editors, Declarative Agent Languages and Technologies IV: 4th International Workshop (DALT 2006), Selected, Revised and Invited Papers, volume 4327 of Lecture Notes in Computer Science, pages 43–60, Berlin, Heidelberg, May 2006. Springer-Verlag. Invited Paper.
  • Nardine Osman, David Robertson, and Christopher Walton. Run-time model checking of interaction and deontic models for multi-agent systems. In Marie-Pierre Gleizes, Gal A. Kaminka, Ann Nowé, Sascha Ossowski, Karl Tuyls, and Katja Verbeeck, editors, Proceedings of the 3rd European Workshop on Multi-Agent Systems (EUMAS 2005), pages 248–259, Brussels, December 2005. Koninklijke Vlaamse Academie van Belie voor Wetenschappen en Kunsten.
Applications:
  • Currently working with Areti Mantaki from the SOCIAM project (a large British funded project on "social machines") to apply MCID to healthcare
Other:
  • Technology readiness level 4 (TRL 4) – "technology validated in lab"

Books & Book Chapters

Books
  1. Natalia Criado Pacheco, Carlos Carrascosa, Nardine Osman, and Vicente Julián Inglada. Multi-Agent Systems and Agreement Technologies: 14th European Conference, EUMAS 2016, and Fourth International Conference, AT 2016, Valencia, Spain, December 15–16, 2016, volume 10207 of Lecture Notes in Artificial Intelligence. Springer, In Press.
  2. Nardine Osman. Electronic Institutions and their Applications. Springer, In Press.
  3. Nardine Osman and Carles Sierra. Autonomous Agents and Multiagent Systems: AAMAS 2016 Workshops, Best Papers, Singapore, Singapore, May 9–10, 2016, Revised Selected Papers, volume 10002 of Lecture Notes in Computer Science. Springer, 2016.
  4. Nardine Osman and Carles Sierra. Autonomous Agents and Multiagent Systems: AAMAS 2016 Workshops, Visionary Papers, Singapore, Singapore, May 9–10, 2016, Revised Selected Papers, volume 10003 of Lecture Notes in Computer Science. Springer, 2016.
  5. Nardine Osman and Matthew Yee-King. AI and Feedback: Proceedings of AInF 2015, co-located with the 24th International Joint Conference on Artificial Intelligence (IJCAI 2015), Buenos Aires, Argentina, July 26, 2015, volume 1407 of CEUR Workshop Proceedings. CEUR-WS.org, 2015.
Book Chapters
  1. Nardine Osman and Carles Sierra. Agreement Computing and Self-Evolution In Pompeu Casanovas and José-Juan Moreso, editors, Anchoring Institutions. Democracy and Regulations in a Global and Half-automated World. Law, Governance, and Technology Series. Dordrecht, Berlin: Springer Verlag, In Press.
  2. Nardine Osman, Andrew Koster, Marco Schorlemmer, Carles Sierra, and Jordi Sabater-Mir. The uHelp application. In Nardine Osman, editor, Electronic Institutions and their Applications. Springer, In Press.
  3. Matthew Yee-King, Dave de Jonge, Roberto Confalonieri, Nardine Osman, Mark d'Inverno, Carles Sierra, Leila Amgoud, and Katina Hazelden. The WeCurate application. In Nardine Osman, editor, Electronic Institutions and their Applications. Springer, In Press.
  4. Dave de Jonge, Bruno Rosell, Patricia Gutierrez, Nardine Osman, and Carles Sierra. The PeerLearn application. In Nardine Osman, editor, Electronic Institutions and their Applications. Springer, In Press.
  5. Nardine Osman, Ewa Andrejczuk, Juan Antonio Rodriguez-Aguilar, and Carles Sierra. Collaborative assessments in on-line classrooms. In Fernando Koch, Andrew Koster, Tiago Primo, and Christian Guttmann, editors, Advances in Social Computing and Digital Education, volume 677 of CCIS. Springer, 2017.
  6. Ismel Brito, Patricia Gutierrez, Katina Hazelden, Dave de Jonge, Lisette Lemus, Nardine Osman, Bruno Rosell, Carles Sierra, and Carme Roig. Collaborative peer assessment using PeerLearn. In Luc Steels, editor, Music Learning with Massive Open Online Courses (MOOCs), volume 6 of The Future of Learning, chapter 10, pages 145–174. IOS Press, 2015.
  7. Nardine Osman, Carles Sierra, Jordi Sabater-Mir, Joseph R. Wakeling, Judith Simon, Gloria Origgi, and Roberto Casati. LiquidPublications and its technical and legal challenges. In Danièle Bourcier, Pompeu Casanovas, Mélanie Dulong de Rosnay, and Catharina Maracke, editors, Intelligent Multimedia: Managing Creative Works in a Digital World, volume 8 of Legal Information and Communication Technologies, pages 321–336. European Publishing Academic Press, Florence, Italy, May 2010.
  8. David Robertson, Adam Barker, Paolo Besana, Alan Bundy, Yun Heh Chen-Burger, David Dupplaw, Fausto Giunchiglia, Frank Harmelen, Fadzil Hassan, Spyros Kotoulas, David Lambert, Guo Li, Jarred Mcginnis, Fiona Mcneill, Nardine Osman, Adrian Perreau Pinninck, Ronny Siebes, Carles Sierra, and Chris Walton. Models of interaction as a grounding for peer to peer knowledge sharing. In Tharam S. Dillon, Elizabeth Chang, Robert Meersman, and Katia Sycara, editors, Advances in Web Semantics I: Ontologies, Web Services and Applied Semantic Web, volume 4891 of Lecture Notes in Computer Science, pages 81–129. Springer-Verlag, Berlin, Heidelberg, 2009.

Journal Articles

  1. Nardine Osman and Carles Sierra. ARM: an academic reputation model. Engineering Applications of Artificial Intelligence. Elsevier, Under review. ISI Impact Factor: 2.604, Quartile: First in AI
  2. Nardine Osman, Bruno Rosell, Carles Sierra, Marco Schorlemmer, Jordi Sabater-Mir, and Lissette Lemus. uHelp: intelligent volunteer search for mutual help communities. Engineering Applications of Artificial Intelligence. Elsevier, Under review. ISI Impact Factor: 2.604, Quartile: First in AI
  3. Pandelis Perakakis, Agnes Ponsati, Isabel Bernal, Carles Sierra, Nardine Osman, Concha Mosquera de Arancibia, and Emilio Lorenzo. OPRM: Challenges to including open peer review in open access repositories. Code4Lib Journal, 35, January 2017. Impact Factor: N/A, Quartile: N/A (This is an open access journal)
  4. Roberto Confalonieri, Matthew Yee-King, Katina Hazelden, Mark d'Inverno, Dave de Jonge, Nardine Osman, Carles Sierra, Leila Agmoud, and Henri Prade. Engineering multiuser museum interactives for shared cultural experiences. Engineering Applications of Artificial Intelligence, 46(PA):180–195, November 2015. ISI Impact Factor: 2.604, Quartile: First in AI
  5. Patricia Gutierrez, Nardine Osman, Carme Roig, and Carles Sierra. Trust-based community assessment. Pattern Recognition Letters, 67(P1):49–58, December 2015. ISI Impact Factor: 2.002, Quartile: Second in AI
  6. Nardine Osman, Patricia Gutierrez, and Carles Sierra. Trustworthy advice. Knowledge-Based Systems, 82(C):41–59, July 2015. ISI Impact Factor: 3.433, Quartile: First in AI
  7. Holger Billhardt, Alberto Fernández, Lissette Lemus, Marin Lujak, Nardine Osman, Sascha Ossowski, and Carles Sierra. Dynamic coordination in fleet management systems: Toward smart cyber fleets. Intelligent Systems, IEEE, 29(3):70–76, May 2014. ISI Impact Factor: 3.053, Quartile: First in AI
  8. Nardine Osman, Carles Sierra, Fiona McNeill, Juan Pane, and John Debenham. Trust and matching algorithms for selecting suitable agents. ACM Transactions on Intelligent Systems and Technology, 5(1):Article 16, pp. 16:1–16:39, January 2014. ISI Impact Factor: 2.207, Quartile: First in AI
  9. Ismel Brito, Nardine Osman, Jordi Sabater-Mir, and Carles Sierra. CHARMS: A charter management system. Automating the integration of electronic institutions and humans. Applied Artificial Intelligence, 26:306–330, May 2012. ISI Impact Factor: 0.606, Quartile: Fourth in AI
  10. Aliaksandr Birukou, Joseph R. Wakeling, Claudio Bartolini, Fabio Casati, Maurizio Marchese, Katsiaryna Mirylenka, Nardine Osman, Azzurra Ragone, Carles Sierra, and Aalam Wassef. Alternatives to peer review: novel approaches for research evaluation. Frontiers in Computational Neuroscience, 5(56), December 2011. ISI Impact Factor: 2.515, Quartile: First in Mathematical & Computational Biology
  11. Maurizio Marchese, Lorenzino Vaccari, Gaia Trecarichi, Nardine Osman, Fiona McNeill, and Paolo Besana. An interaction-centric approach to support peer coordination in distributed emergency response management. Intelligent Decision Technologies, 3:19–34, January 2009. SCOPUS Impact Factor: 4, Quartile: Fourth in AI
All Conference & Workshop Papers Scientific
Reports Thesis
Supervision Patentable
Research Research
Stays & Visits

Conference & Workshop Papers

Conference Papers
  1. Patricia Gutierrez, Nardine Osman, Carme Roig, and Carles Sierra. Personalised automated assessments. In Catholijn M. Jonker, Stacy Marsella, John Thangarajah, and Karl Tuyls, editors, Proceedings of the 15th International Conference on Autonomous Agents & Multiagent Systems (AAMAS 2016), pages 1115–1123. ACM, 2016.
  2. Nardine Osman and Carles Sierra. Reputation in the academic world. In Gal A. Kaminka, Maria Fox, Paolo Bouquet, Eyke Hüllermeier, Virginia Dignum, Frank Dignum, and Frank van Harmelen, editors, Proceedings of the 22nd European Conference on Artificial Intelligence (ECAI 2016), volume 285 of Frontiers in Artificial Intelligence and Applications, pages 1614–1615. IOS Press, 2016.
  3. Patricia Gutierrez, Nardine Osman, and Carles Sierra. Automating personalized learning through motivation. In Michael Rovatsos, George Vouros, and Vicente Julian, editors, Multi-Agent Systems and Agreement Technologies: 13th European Conference, EUMAS 2015, and Third International Conference, AT 2015, Revised Selected Papers, pages 449–454. Springer, 2016.
  4. Nardine Osman, Patricia Gutierrez, and Carles Sierra. Trustworthy advice. In Torsten Schaub, Gerhard Friedrich, and Barry O'Sullivan, editors, Proceedings of the 21st European Conference on Artificial Intelligence (ECAI 2014), volume 263 of Frontiers in Artificial Intelligence and Applications, pages 1073–1074. IOS Press, 2014.
  5. Patricia Gutierrez, Nardine Osman, and Carles Sierra. Collaborative assessment. In Lledoó Museros Cabedo, Oriol Pujol, and Núria Agell, editors, Artificial Intelligence Research and Development – Recent Advances and Applications, (CCIA 2014), volume 269 of Frontiers in Artificial Intelligence and Applications, pages 136–145. IOS Press, 2014.
  6. Nardine Osman and Carles Sierra. A roadmap for self-evolving communities. In Andreas Herzig and Emiliano Lorini, editors, Proceedings of the European Conference on Social Intelligence (ECSI 2014), volume 1283 of CEUR Workshop Proceedings, pages 305–316. CEUR-WS.org, 2014.
  7. Nardine Osman, Alessandro Provetti, Valerio Riggi, and Carles Sierra. MORE: merged opinions reputation model. In Nils Bulling, editor, Proceedings of the 12th European Conference on Multi-Agent Systems (EUMAS 2014), volume 8953 of Lecture Notes in Computer Science, pages 67–81, Berlin, Heidelberg, Germany, 2015. Springer.
  8. Nardine Osman, Mark d'Inverno, Carles Sierra, Leila Amgoud, Henri Prade, Matthew Yee-King, Roberto Confalonieri, Dave de Jonge, and Katina Hazelden. An experience-based BDI logic: motivating shared experiences and intentionality. In Proceedings of the 39th Annual Conference of the IEEE Industrial Electronics Society (IECON 2013), pages 6654–6659. IEEE, November 2013. Best Paper Award in session on "Cognitive Architectures and Multi-Agent Systems".
  9. Matthew Yee-King, Roberto Confalonieri, Dave de Jonge, Katina Hazelden, Carles Sierra, Mark d'Inverno, Leila Amgoud, and Nardine Osman. Multiuser museum interactives for shared cultural experiences: an agent-based approach. In Proceedings of the 12th International Conference on Autonomous Agents and Multi-agent Systems (AAMAS 2013), pages 917–924, Richland, SC, May 2013. International Foundation for Autonomous Agents and Multiagent Systems.
  10. Andrew Koster, Jordi Madrenas, Nardine Osman, Marco Schorlemmer, Jordi Sabater-Mir, Carles Sierra, Angela Fabregues, Dave de Jonge, Josep Puyol-Gruart, and Pere Garcia-Calveés. u-Help: supporting helpful communities with information technology. In Proceedings of the 12th International Conference on Autonomous Agents and Multi-agent Systems (AAMAS 2013), pages 1109–1110, Richland, SC, May 2013. International Foundation for Autonomous Agents and Multiagent Systems.
  11. Katina Hazelden, Matthew Yee-King, Roberto Confalonieri, Carles Sierra, Fiammetta Ghedini, Dave de Jonge, Nardine Osman, and Mark d'Inverno. WeCurate: multiuser museum interactives for shared cultural experiences. In Proceedings of the ACM SIGCHI Conference on Human Factors in Computing Systems, Extended Abstracts (CHI 2013), pages 571–576, New York, NY, USA, April–May 2013. ACM.
  12. Carlos Chesnñevar, Ana Maguitman, Elsa Estevez, Nardine Osman, and Carles Sierra. E2 participation: electronically empowering citizens for social innovation through agreement technologies. In Proceedings of the 14th Annual International Conference on Digital Government Research (DG.O 2013), pages 279–280, New York, NY, USA, 2013. ACM.
  13. Leila Amgoud, Roberto Confalonieri, Dave Jonge, Mark d'Inverno, Katina Hazelden, Nardine Osman, Henri Prade, Carles Sierra, and Matthew Yee-King. Sharing online cultural experiences: an argument-based approach. In Vicenç Torra, Yasuo Narukawa, Beatriz López, and Mateu Villaret, editors, Proceedings of the 9th International Conference on Modeling Decisions for Artificial Intelligence (MDAI 2012), volume 7647 of Lecture Notes in Computer Science, pages 282–293, Berlin, Heidelberg, Germany, November 2012. Springer-Verlag.
  14. Andrew Koster, Jordi Madrenas-Ciurana, Nardine Osman, Marco Schorlemmer, Jordi Sabater-Mir, Carles Sierra, Dave de Jonge, Angela Fabregues, Josep Puyol-Gruart, and Pere Garcia-Calveés. u-Help: supporting helpful communities with information technology. In Sascha Ossowski, Francesca Toni, and George Vouros, editors, Proceedings of the 1st International Conference on Agreement Technologies (AT 2012), volume 918, pages 378–392. CEUR Workshop Proceedings, October 2012.
  15. Leila Amgoud, Roberto Confalonieri, Dave de Jonge, Mark D'Inverno, Katina Hazelden, Nardine Osman, Henri Prade, Carles Sierra, and Matthew Yee-King. WeCurate: designing for synchronised browsing and social negotiation. In Sascha Ossowski, Francesca Toni, and George Vouros, editors, Proceedings of the 1st International Conference on Agreement Technologies (AT 2012), volume 918, pages 168–179. CEUR Workshop Proceedings, October 2012.
  16. Matthew Yee-King, Roberto Confalonieri, Dave de Jonge, Nardine Osman, Katina Hazelden, Leila Amgoud, Henri Prade, Carles Sierra, and Mark d'Inverno. Towards community browsing for shared experiences: the WeBrowse system. In Sascha Ossowski, Francesca Toni, and George Vouros, editors, Proceedings of the 1st International Conference on Agreement Technologies (AT 2012), volume 918, pages 201–202. CEUR Workshop Proceedings, October 2012.
  17. Leila Amgoud, Mark d'Inverno, Nardine Osman, Henri Prade, and Carles Sierra. Experiences – a forgotten component of epistemic states. In Sascha Ossowski, Francesca Toni, and George Vouros, editors, Proceedings of the 1st International Conference on Agreement Technologies (AT 2012), volume 918, pages 220–230. CEUR Workshop Proceedings, October 2012.
  18. Nardine Osman, Carles Sierra, and Jordi Sabater-Mir. Propagation of opinions in structural graphs. In Helder Coelho, Rudi Studer, and Michael Wooldridge, editors, Proceedings of the 19th European Conference on Artificial Intelligence (ECAI 2010), volume 215 of Frontiers in Artificial Intelligence and Applications, pages 595–600, Amsterdam, The Netherlands, August 2010. IOS Press.
  19. Nardine Osman and David Robertson. Dynamic verification of trust in distributed open systems. In Manuela M. Veloso, editor, Proceedings of the 20th International Joint Conference on Artificial Intelligence (IJCAI 2007), pages 1440–1445, Menlo Park, CA, USA, January 2007. AAAI Press.
  20. Nardine Osman, David Robertson, and Christopher Walton. Run-time model checking of interaction and deontic models for multi-agent systems. In Hideyuki Nakashima, Michael P. Wellman, Gerhard Weiss, and Peter Stone, editors, Proceedings of the 5th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS 2006), pages 238–240, New York, NY, USA, May 2006. ACM.
Workshop Papers
  1. Nardine Osman and Carles Sierra. Reputation in the academic world. In Rubén Fuentes-Fernández and Marin Lujak, editors, Proceedings of the 1st International Workshop on Ambient Intelligence for Large Premises (AmILP 2016), co-located with the 22nd European Conference on Artificial Intelligence (ECAI 2016), CEUR Workshop Proceedings. CEUR-WS.org, 2016.
  2. Nardine Osman and Carles Sierra. Reputation in the academic world. In Jie Zhang, Robin Cohen, and Murat Sensoy, editors, Proceedings of the 18th International Workshop on Trust in Agent Societies, co-located with the 15th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2016), volume 1578 of CEUR Workshop Proceedings, pages 1–17. CEUR-WS.org, 2016.
  3. Patricia Gutierrez, Nardine Osman, and Carles Sierra. Personalised automated assessments. In Nardine Osman and Matthew Yee-King, editors, Proceedings of the First International Workshop on AI and Feedback, AInF 2015, co-located with the 24th International Joint Conference on Artificial Intelligence (IJCAI 2015), volume 1407 of CEUR Workshop Proceedings, pages 40–46. CEUR-WS.org, 2015.
  4. Patricia Gutierrez, Nardine Osman, and Carles Sierra. Collaborative assessment. In Sergio Gutiérrez Santos and Olga C. Santos, editors, Proceedings of the Workshops held at Educational Data Mining 2014, co-located with 7th International Conference on Educational Data Mining (EDM 2014), volume 1183 of CEUR Workshop Proceedings. CEUR-WS.org, 2014.
  5. Nardine Osman, Carles Sierra, and Marco Schorlemmer. Charters for self-evolving communities. In Emiliano Lorini, editor, Proceedings of the 11th European Workshop on Multi-Agent Systems (EUMAS 2013), volume 1113, pages 112–123. CEUR Workshop Proceedings, December 2013.
  6. Nardine Osman, Jordi Sabater-Mir, and Carles Sierra. Simulating research behaviour. In Daniel Villatoro, Jordi Sabater-Mir, and Jaime S. Sichman, editors, Multi-Agent-Based Simulation XII: 12th International Workshop (MABS 2011), Revised Selected Papers, volume 7124 of Lecture Notes in Computer Science, pages 15–30, Berlin, Heidelberg, May 2012. Springer-Verlag.
  7. Nardine Osman, Carles Sierra, and Angela Fabregues. A propagation and aggregation algorithm for inferring opinions in structural graphs. In the 13th International Workshop on Trust In Agent Societies, at the 9th International Joint Conference on Autonomous Agents and Multiagent Systems (AAMAS 2010), May 2010.
  8. Nardine Osman. A contextualised trust model for distributed open systems. In Babak Akhgar, editor, Proceedings of the 15th International Workshops on Conceptual Structures (ICCS 2007), pages 3–8, London, UK, July 2007. Springer-Verlag.
  9. Nardine Osman, David Robertson, and Christopher Walton. Dynamic model checking for multi-agent systems. In Matteo Baldoni and Ulle Endriss, editors, Declarative Agent Languages and Technologies IV: 4th International Workshop (DALT 2006), Selected, Revised and Invited Papers, volume 4327 of Lecture Notes in Computer Science, pages 43–60, Berlin, Heidelberg, May 2006. Springer-Verlag. Invited Paper.
  10. Nardine Osman, David Robertson, and Christopher Walton. Run-time model checking of interaction and deontic models for multi-agent systems. In Marie-Pierre Gleizes, Gal A. Kaminka, Ann Nowé, Sascha Ossowski, Karl Tuyls, and Katja Verbeeck, editors, Proceedings of the 3rd European Workshop on Multi-Agent Systems (EUMAS 2005), pages 248–259, Brussels, December 2005. Koninklijke Vlaamse Academie van Belie voor Wetenschappen en Kunsten.

Scientific Reports

Project Deliverables
  1. Pandelis Perakakis, Agnes Ponsati, Isabel Bernal, Concha Mosquerade Arancibia, Carles Sierra, Nardine Osman, and Emilio Lorenzo. OPRM Final Report. Deliverable, OPRM Project. 2016.
  2. Nardine Osman and Carles Sierra. Open Peer Review: Notes on Reputations. Technical report, OPRM Project. 2015.
  3. Dave de Jonge, Nardine Osman, Bruno Rosell i Gui, and Carles Sierra. Electronic institutions for community building (v2). Deliverable D3.2, PRAISE Project. 2014.
  4. Patricia Gutierrez, Nardine Osman, and Carles Sierra. Trust and reputation in online social learning communities (v2). Deliverable D3.4, PRAISE Project. 2014.
  5. Dave de Jonge, Nardine Osman, Bruno Rosell i Gui, and Carles Sierra. Electronic institutions for community building (v1). Deliverable D3.1, PRAISE Project. 2013.
  6. Nardine Osman, Patricia Gutierrez, and Carles Sierra. Trust and reputation in online social learning communities (v1). Deliverable D3.3, PRAISE Project. 2013.
  7. Nardine Osman. Charters. Deliverable, CBIT Project. 2012.
  8. Joseph Rushton Wakeling, Aalam Wassef, Judith Simon, Gloria Origgi, Cristhian Parra, Ismel Brito Rodriguez, Nardine Osman, Jordi Sabater-Mir, and Carles Sierra. Processes, roles and licensing models for SKO lifecycle management. Deliverable D2.1, Liquid Publications Project. 2011.
  9. Marcos Baez, Aliaksandr Birukou, Fabio Casati, Ronald Chenu, Muhammad Imran, Maurizio Marchese, Matus Medo, Daniil Mirylenka, Nardine Osman, and Cristhian Parra. Design of the Liquid Publications Integrated Platform. Deliverable D5.1, Liquid Publications Project. 2011.
  10. John Debenham, Nardine Osman, Jordi Sabater-Mir, and Carles Sierra. Reputation Model. Deliverable D5.2.2, Agreement Technologies Project. 2010.
  11. Nardine Osman, Jordi Sabater-Mir, Carles Sierra, Adrián Perreau de Pinninck Bas, Muhammad Imran, Maurizio Marchese, Azzurra Ragone. Credit Attribution for Liquid Publications. Deliverable D4.1, Liquid Publications Project. 2010.
  12. UNITN, IIIA-CSIC, CNRS. Design of the SKO structural model and evolution. Deliverable D1.2, Liquid Publications Project. 2009.
  13. UNITN, IIIA-CSIC, CNRS, UNIFR, SPRINGER. State of the Art. Deliverable D1.1, Liquid Publications Project. 2009.
  14. Nardine Osman, Jordi Sabater-Mir, and Carles Sierra. Critical analysis of the current trust models and requirement analysis for an integrated model. Deliverable D5.2.1, Agreement Technologies Project. 2008.
  15. Maurizio Marchese, Lorenzino Vaccari, Gaia Trecarichi, Pavel Shvaiko, Juan Pane, Nardine Osman, and Fiona McNeill. Interaction Models for eResponse. Deliverable D6.7, OpenKnowledge Project. 2008.
  16. Nardine Osman. Automated Trust Model for P2P Systems. Technical Report, OpenKnowledge Project. 2008.
  17. Fausto Giunchiglia, Carles Sierra, Fiona McNeill, Nardine Osman, and Ronny Siebes. Good Enough Answer Algorithms. Deliverable D4.5, OpenKnowledge Project. 2007.
  18. Paolo Besana, Phil Graham, David Lambert, Nardine Osman, and David Robertson. Initial Test Rigs. Deliverable D7.1, OpenKnowledge Project. 2006.
Other
  1. Nardine Osman. Runtime Verification of Deontic and Trust Models in Multiagent Interactions. Doctoral thesis, School of Informatics, University of Edinburgh, Edinburgh, UK. April 2008.
  2. Nardine Osman. Addressing Constraint Failures in Distributed Dialogue Protocols. Masters thesis, School of Informatics, University of Edinburgh, Edinburgh, UK. September 2003.

Thesis Supervision

PhD Theses

  • Adan Beltran

    Duration: November 2016 — to date
    Thesis title: Specifying evolving norms in a controlled natural language
    Description: If we want humans to become more active in the design and development of their technologies, having control on how their technologies function and what values they abide to, we need humans to be able to specify the norms of interaction in a controlled natural language.

  • Manuel Bolaños

    Duration: November 2016 — to date
    Thesis title: Automating personalised learning through motivation
    Description: Instead of focusing solely on competence, this work aims at personalising the learning experience of a student by automatically selecting the exercises that (in addition to matching student's competences) maintain the student's motivation at a certain (high) level.
MSc Thesis

  • Ahmad Mel

    Duration: April 2015 — September 2015
    Thesis title: A mobile app for online learning
    Description: A mobile app that allows teachers to upload assignments, students to upload their work and assess each other, and the integrated COMAS algorithm that computes and suggests (to the teacher) students' marks.

Patentable Research

Copyrighted Algorithms

  • uHelp

    Copyright Title: uHelp: supporting helpful communities with information technologies
    Copyright Authors: Carles Sierra, Nardine Osman, Bruno Rosell, Lissette Lemus, Marco Schorlemmer, Jordi Sabater-Mir, Josep Puyol Gruart, and Pere García i Calvés
    Copyright Holder: The Spanish National Research Council (CSIC)
    Registration Number: 3734/2016
    Date of resistration: 08/11/2016

  • COMAS

    Copyright Title: Collaborative Assessment: a software component for collaborative assessments
    Copyright Authors: Patricia Gutierrez, Nardine Osman, and Carles Sierra
    Copyright Holder: The Spanish National Research Council (CSIC)
    Registration Number: 527/2016
    Date of resistration: 18/02/2016

  • TrustIt

    Copyright Title: TrustIt: a trust component based on information theory
    Copyright Authors: Carles Sierra, Nardine Osman, Jordi Madrenas-Ciurana, Angels Fabregues, and Bruno Rosell i Gui
    Copyright Holder: The Spanish National Research Council (CSIC)
    Registration Number: 607/2014
    Date of resistration: 28/03/2014
Other algorithms considered for copyright

TrustIt

A copyright is interesting here, as ARM is starting to be used in real life settings (e.g. Digital.CSIC , e-IEO , and ConfMaster.Net with the IJCAI 2017 conference ).
Although all other software and algorithms are copyrightable: PeerLearn, PAAS, Consuasor, WeCurate, OpinioNet, MORE, & MCID.

Stays, Visits & Other International Collaboration

Research Stays & Visits

IIIA-CSIC

Title: Research Associate
Address: Barcelona, Spain
Duration: 2008 — 2016

ISTC-CNR

Title: Visiting Researcher
Address: Rome, Italy
Duration: June 2009

The University of Edinburgh

Title: Research Assisstant
Address: Edinburgh, UK
Duration: 2006 — 2007
International Collaboration

The map below presents the grographical distribution of the researchers most collaborated with.

All Scientific
Advice Implementing
Quality Sys. ​ Processes, ​ Sys. & Methods Prototypes
& Pilots Dissemination
Activities Scientific
Management Other
Merits

Scientific Advice

Advice on Academic Reputation

Advice Published

  1. Nardine Osman and Carles Sierra. ARM: an academic reputation model. Engineering Applications of Artificial Intelligence. Elsevier, Under review.
  2. Nardine Osman and Carles Sierra. Reputation in the academic world. In Gal A. Kaminka, Maria Fox, Paolo Bouquet, Eyke Hüllermeier, Virginia Dignum, Frank Dignum, and Frank van Harmelen, editors, Proceedings of the 22nd European Conference on Artificial Intelligence (ECAI 2016), volume 285 of Frontiers in Artificial Intelligence and Applications, pages 1614–1615. IOS Press, 2016.
  3. Nardine Osman and Carles Sierra. Reputation in the academic world. In Jie Zhang, Robin Cohen, and Murat Sensoy, editors, Proceedings of the 18th International Workshop on Trust in Agent Societies, co-located with the 15th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2016), volume 1578 of CEUR Workshop Proceedings, pages 1–17. CEUR-WS.org, 2016.

Advice Delivered to & Adopted by the CSIC, e-IEO & ConfMaster.net

  1. The Spanish National Research Council (CSIC), following our advice, implemented and integrated the ARM model into their repository, the Digital.CSIC
  2. The Spanish Institute of Oceanography (IEO), following our advice, implemented and integrated the ARM model into their repository, the e-IEO
  3. The conference management system ConfMaster.net, following our advice, implemented the ARM model in their system to test it with the IJCAI 2017 conference

A Dagstuhl Perspectives Workshop

A Dagstuhl Perspectives Workshop is currently being drafted, in collaboration with Ivan Markovsky (to be submitted on 01 November 2017).

The objectives of this Dagstuhl Workshop are:

  1. to discuss and list the pitfalls of existing approaches for academic assessment (usually citation-based, e.g. h-index, impact factor) and their impact on science and productivity,
  2. to propose and discuss alternative assessment systems for academia and research, such as our ARM model, that could help address the pitfalls above,
  3. to agree on the requirements of this much needed assessment system and the approach for implementing it,
  4. to study and agree on an effective plan of work for the development as well as the adoption & uptake of the new assessment system by academic/research institutes, and
  5. to get the commitment of prominent researchers in the field to ensure the execution of the agreed upon plan.

Implementing Quality Systems

Assessing the Quality of Researchers and Research Work

The ARM model that assesses the quality of researchers and research work has been implemented and integrated with:
  1. The repisotory of the Spanish National Research Council (CSIC), Digital.CSIC
  2. The repisotory of the Spanish Institute of Oceanography (IEO), e-IEO
  3. The conference management system ConfMaster.net, as a testbed

Processes, Systems & Methods

A summary of processes, systems, and methods is presented below.
Please note that the details of these have already been presented in detail under "Scientific Contributions" in Part 1.


ARM: Academic reputation model: calculating the reputation of researchers & research work based on peer reviews (instead of citations).
uHelp: An app for finding volunteers within one's social network to help with daily activities (e.g. caring for a child, picking up the grocery).
PeerLearn: A web platform for specifying & executing pedagogical workflows (lesson plans) using P2P Electronic Institutions, integrating a number of services, such as COMAS, which automates the assessment process in classrooms by relying on peer assessments.
PAAS: The second automated assessments model for online learning, improving on COMAS (below).
COMAS: The first automated assessments model for online learning.
Consuasor: A trust model for finding trustworthy advice and advisers.
WeCurate: An app for curating content together.
X-BDI: An experience-based logic for collective intentionality..
OpinioNet: A trust model based on propagating opinions in structural graphs.
MORE: A reputation model based on mutual opinions.
TrustIt: A trust model for finding suitable collaborators, based on learning from similar past experiences..
MCID: A runtime model checker for verifying interactions in distributed open systems.

Prototypes & Pilots

The technology readiness levels (TRLs) of all scientific contributions are presented in the figure below.
The scientific contributions have been presented in detail in Part 1. In this section, however, we re-present those that are at a prototype or pilot level (highlighted in red in the figure below).

ARM

Academic reputation model: calculating the reputation of researchers & research work based on peer reviews (instead of citations).
Applications:
  • A pilot is running on the Digital.CSIC repository
  • A pilot is running on the e-IEO repository
  • A pilot is being tested with the conference management system, ConfMaster.net , with the IJCAI 2017 conference
Other:
  • Technology readiness level 6 (TRL 6) – "system prototype demonstration in operational environment"
  • Code available online

uHelp

An app for finding volunteers within one's social network to help with daily activities (e.g. caring for a child, picking up the grocery).
Applications:
  • A pilot has been tested with a community of single mothers, from the Federació Catalana de Famílies Monoparentals
  • Additional pilots are planned for in the RESPECT and uHelp European projects (under review), where uHelp will be applied to domains focusing on providing support for the elderly, refugees, and additional single parent communities
Other:
  • Technology readiness level 6 (TRL 6) – "system prototype demonstration in operational environment"
  • App available on Apple Store and Google Play
  • Copyrighted

PeerLearn

A web platform for specifying & executing pedagogical workflows (lesson plans) using P2P Electronic Institutions, integrating a number of services, such as COMAS, which automates the assessment process in classrooms by relying on peer assessments.
Applications:
  • A prototype has been tested with an English classroom at the INS Torres i Bages school in Hospitalet, Barcelona
  • A prototype has been tested with music professors and students at the Catalonia College of Music, ESMUC, Barcelona
  • A related mobile app is being finalised (by Angela Fabregues), and will be tested with the same English classroom at the INS Torres i Bages school in Hospitalet, Barcelona. The app allows teachers to upload assignments, students to upload their work and assess each other, and the integrated COMAS algorithm computes and suggests (to the teacher) students' marks.
Other:
  • Technology readiness level 5 (TRL 5) – "technology validated in relevant environment"
  • PeerFlow is accessible online

PAAS

The second automated assessments model for online learning, improving on COMAS (below).
Applications:
  • A prototype has been tested with an English classroom at the INS Torres i Bages school in Hospitalet, Barcelona (using the same data as in COMAS below)
Other:
  • Technology readiness level 5 (TRL 5) – "technology demonstrated in relevant environment"

COMAS

The first automated assessments model for online learning.
Applications:
  • A prototype has been tested with an English classroom at the INS Torres i Bages school in Hospitalet, Barcelona (using the same data as in PAAS above)
  • A prototype has also been developed as a service and integrated into the PeerLearn system (above), also tested with the English classroom at the INS Torres i Bages school in Hospitalet, Barcelona
Other:
  • Technology readiness level 5 (TRL 5) – "technology demonstrated in relevant environment"
  • Copyrighted

WeCurate

An app for curating content together.
Applications:
  • A prototype has been tested in a 5-day trial at the Horniman Museum, London
  • A prototype has been presented to the public to play with at "La Fiesta de la Ciencia y la Tecnología 2013", Barcelona
Other:
  • Technology readiness level 5 (TRL 5) – "technology validated in relevant environment"

TrustIt

A trust model for finding suitable collaborators, based on learning from similar past experiences.
Applications:
  • The final product is used in the iKey Performance app of Enzyme Advising Group
Other:
  • Technology readiness level 9 (TRL 9) – "actual system proven in operational environment"
  • Copyrighted

Dissemination Activities

CCCB, Barcelona

Dates: 04 July 2017
Talk Title: uHelp: enabling self-supportive communities that are attentive to the vulnerable
Event Title: The humanitarian crisis in Europe, as experienced by refugees
About: The Centre de Cultura Contemporània de Barcelona (CCCB) is a multidisciplinary institution with a programme that features exhibitions, debates, festivals, concerts, film, courses, workshops etc.
Role: Currently co-preparing the slides of the talk (with Lissette Lemus), and will be involved in the dissemination event

OuiShare Fest, Barcelona

Dates: 26—27 October 2016
Talk Title: Artificial Intelligence
Event Title: Collaborative economy: the next wave
About: OuiShare Fest is an international interdisciplinary event that gathers creative leaders, entrepreneurs, movement builders, purpose-driven organizations and communities from across sectors and countries who want to drive systemic and meaningful change.
Role: Co-prepared the slides of the talk (with Lissette Lemus), and was involved in the dissemination event

Catalan Federation of Monoparental Families, Barcelona

Dates: 24 November 2015 & 19 February 2016
Event Title: Introducing uHelp
About: The uHelp team members (Carles Sierra, Nardine Osman, Lissette Lemus, and Bruno Rosell) met, on two occasions, with a selected number of single parents from the Catalan Federation of Monoparental Families. In the first meeting, the uHelp concept was introduced, and the mothers were asked for feedback. This feedback was then taken into accound when developing the product. In the second meeting, the uHelp team had a hands-on workshop with the selected mothers to introduce the app.
Role: Helped with introducing the uHelp concept, soliciting user requirements, and then introducing the app and its features in the second meeting.

La Fiesta de la Ciencia y la Tecnología, Barcelona

Dates: 15—16 June 2013
Event Title: IIIA-CSIC: WeCurate, ACE Project
About: The Science, Technology and Innovation Festival is organized by the Barcelona City Council Culture Institute with the aim of bringing science to the people, providing information on the work carried out by the scientists and engineers in Barcelona's universities, research and technology centres and businesses.
Role: Along with other ACE members, was at the festival to introduce the WeCurate app and explain its objectives and features to the public (many of which were youngsters).
P.S. Other invited talks, within the scientific community, are listed under "Other Merits".

Scientific Management

Proposal Reviewer

  • The Croatian Science Foundation (HRZZ), Croatia
    The "Installation Research Projects, 2013" call
    February 2014

Editorial Board

  • Journal of Artificial Intelligence Research (JAIR)
    July 2016 – to date

Chair

  • Conference Chair: Agreement Technologies conference (AT 2016)
  • Workshops Co-chair: Workshops of the 15th conference on Autonomous Agents and Multiagent Systems (AAMAS 2016 Workshops)

Workshop Organiser

  • 1st international workshop on AI and Feedback, at the 24th International Joint Conference on Artificial Intelligence (AInF @ IJCAI 2015)

Senior Program Committee

  • 26th International Joint Conferences on Artificial Intelligence (IJCAI 2017)

Scientific Committee

  • 17th European Agent Systems Summer School (EASSS 2015)

Program Committee

Conferences:
  • 22nd & 24th International Joint Conferences on Artificial Intelligence (IJCAI 2011 , 2015 )
  • 9th & 14th International Conference on Autonomous Agents and Multiagent Systems (AAMAS 2010 , 2015 )
  • 13th European Conference on Multi-Agent Systems (EUMAS 2015 )
  • 19th, 21st & 23rd European Conference on Artificial Intelligence (ECAI 2010 , 2012 , 2014 )
Workshops:
  • 15th International Workshop on Multi-Agent-Based Simulation (MABS 2014 )
  • 1st International Workshop on Norms, Actions, and Games (NAG 2014 )
  • 7th, 8th & 9th European Workshops on Multi-Agent Systems (EUMAS 2009 , 2010 , 2011 )
  • 5th European Starting AI Researcher Symposium (STAIRS 2010 )

Reviewer

Journals:
  • Logical Methods in Computer Science (LMCS 2016)
  • Journal of Artificial Intelligence Research (JAIR 2014)
  • IEEE Transactions on Cybernetics (2014)
  • Electronic Commerce Research and Applications (ECRA 2014)
  • AI Communications (AICOMM 2012, 2013, 2014)
  • AI Reviews, Special Issue on Agreement Technologies (AIRE-AT 2012)
  • ACM Transactions on Interactive Intelligent Systems (TiiS 2011)
  • International Journal of Agent-Oriented Software Engineering (IJAOSE 2010)
  • Journal of Web Semantics (JWS 2009)
Conferences:
  • 22nd European Conference on Artificial Intelligence (ECAI 2016)
  • 10th International Federated Conference on Distributed Computing Techniques (Coordination 2015)
  • 29th AAAI Conference on Artificial Intelligence (AAAI 2015)
  • 1st International Conference on Agreement Technologies (AT 2012)
  • 4th International Conference on Computational Models of Argument (COMMA 2012)
  • IEEE/WIC/ACM International Conference on Intelligent Agent Technology (IAT 2011)
  • 24th AAAI Conference on Artificial Intelligence (AAAI 2010)
  • 21st International Joint Conferences on Artificial Intelligence (IJCAI 2009)
Workshops:
  • Workshop on Feedback from Multimodal Interactions in Learning Management Systems (FFMI @ EDM 2014)
  • 11th European Workshop on Multi-Agent Systems (EUMAS 2013)
  • 10th & 13th International Workshops on Multi-Agent Based Simulation (MABS 2009, 2012)

Professional Societies

  • Deputy Chair, European Association for Multi-Agent Systems (EURAMAS)
  • Member of the Board of Directors, European Association for Multi-Agent Systems (EURAMAS)
  • Member, Catalan Association for Artificial Intelligence (ACIA)

Other Merits

Invited Speaker

  • Workshop on Agents Living in Augmented Worlds (ALAW @ ECAI 2016)
    The Collective Mind in an Augmented World

Invited Seminar

  • Artificial Intelligence Group, Universitat Pompeu Fabra (UPF), Barcelona, Spain
    Model Checking Multiagent Systems
    17/04/2009
  • Indian Institute of Information Technology (IIIT), Bangalore, India
    Dynamic Verification of Trust in Distributed Open Systems
    16/01/2007

Awards

  • Best Paper in Session Award
    Nardine Osman, Mark d'Inverno, Carles Sierra, Leila Amgoud, Henri Prade, Matthew Yee-King, Roberto Confalonieri, Dave de Jonge, and Katina Hazelden. An experience-based BDI logic: motivating shared experiences and intentionality. In Proceedings of the 39th Annual Conference of the IEEE Industrial Electronics Society (IECON 2013), pages 6654–6659. IEEE, November 2013.

Certificates

  • Tenure-track lecturer ("Profesorado lector")
    Accrediting agency: AQU Catalunya, Barcelona, Spain
    July 2014