JAMES James and I
JAMES James' new hand
JAMES James' head (Philips iCat)

Journal articles

Nicole Mirnig, Gerald Stollnberger, Markus Miksch, Susanne Stadler, Manuel Giuliani, and Manfred Tscheligi
To Err Is Robot: How Humans Assess and Act toward an Erroneous Social Robot
In Frontiers in Robotics and AI, Vol. 4, pages 21, May 2017
pdf   bib


Sebastian Loth, Katharina Jettka, Manuel Giuliani, and Jan P. De Ruiter
Ghost-in-the-Machine Reveals Human Social Signals for Human-Robot Interaction
In Frontiers in Psychology, 6 (1641), November 2015
pdf   bib


Manuel Giuliani, Nicole Mirnig, Gerald Stollnberger, Susanne Stadler, Roland Buchner, and Manfred Tscheligi
Systematic Analysis of Video Data from Different Human-Robot Interaction Studies: A Categorisation of Social Signals During Error Situations
In Frontiers in Psychology, 6 (931), July 2015
pdf   bib


Guang Chen, Daniel Clarke, Manuel Giuliani, Andre Gaschler, and Alois Knoll
Combining Unsupervised Learning and Discrimination for 3D Action Recognition
In Signal Processing, August 2014
pdf   bib


Abolfazl Zaraki, Daniele Mazzei, Manuel Giuliani, and Danilo De Rossi
Designing and Evaluating a Social Gaze-Control System for a Humanoid Robot
In IEEE Transactions on Human-Machine Systems, 44 (2):157-168, April 2014
pdf   bib


Mary Ellen Foster, Manuel Giuliani, and Amy Isard
Task-Based Evaluation of Context-Sensitive Referring Expressions in Human-Robot Dialogue
In Language and Cognitive Processes, October 2013
pdf   bib


Manuel Giuliani and Alois Knoll
Using Embodied Multimodal Fusion to Perform Supportive and Instructive Robot Roles in Human-Robot Interaction
International Journal of Social Robotics, 5 (3):345-356, July 2013
preprint   pdf   bib


Manuel Giuliani, Claus Lenz, Thomas Müller, Markus Rickert, and Alois Knoll
Design Principles for Safety in Human-Robot Interaction
International Journal of Social Robotics, 2(3):253-274, September 2010
preprint   pdf   bib

Conference articles

Kevin Sebastian Kain, Susanne Stadler, Manuel Giuliani, Nicole Mirnig, Gerald Stollnberger, and Manfred Tscheligi
Tablet-Based Augmented Reality in the Factory: Influence of Knowledge in Computer Programming on Robot Teaching Tasks
In Proceedings of the Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (HRI 2017), Vienna, Austria, March 2017
pdf   bib


Zdeněk Materna, Michal Kapinus, Vítězslav Beran, Pavel Smrž, Manuel Giuliani, Nicole Mirnig, Susanne Stadler, Gerald Stollnberger, and Manfred Tscheligi
Using Persona, Scenario, and Use Case to Develop a Human-Robot Augmented Reality Collaborative Workspace
In Proceedings of the Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (HRI 2017), Vienna, Austria, March 2017
pdf   bib


Nicole Mirnig, Gerald Stollnberger, Manuel Giuliani, and Manfred Tscheligi
Elements of Humor: How Humans Perceive Verbal and Non-verbal Aspects of Humorous Robot Behavior
In Proceedings of the Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (HRI 2017), Vienna, Austria, March 2017
pdf   bib


Susanne Stadler, Nicole Mirnig, Manuel Giuliani, Manfred Tscheligi, Zdeněk Materna, Michal Kapinus
Industrial Human-Robot Interaction: Creating Personas for Augmented Reality supported Robot Control and Teaching
In Proceedings of the Proceedings of the Companion of the 2017 ACM/IEEE International Conference on Human-Robot Interaction (HRI 2017), Vienna, Austria, March 2017
pdf   bib


Susanne Stadler, Kevin Kain, Manuel Giuliani, Nicole Mirnig, Gerald Stollnberger, and Manfred Tscheligi
Augmented Reality for Industrial Robot Programmers: Workload Analysis for Task-based, Augmented Reality-supported Robot Control
In Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2016), New York, USA, August 2016
pdf   bib


Gerald Stollnberger, Manuel Giuliani, Nicole Mirnig, Manfred Tscheligi, Krzysztof Arent, Kreczmer Bogdan, Filip Grzeszczak, Dorota Szczesniak-Stanczyk, Zarczuk Radoslaw, and Andrzej Wysokinski
Designing User Interfaces for Different User Groups: A Three-Way Teleconference System for Doctors, Patients and Assistants Using a Remote Medical Robot
In Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2016), New York, USA, August 2016
pdf   bib


Gerald Stollnberger, Moser Christiane, Manuel Giuliani, Susanne Stadler, Manfred Tscheligi, Dorota Szczesniak-Stanczyk, and Bartlomiej Stanczyk
User Requirements for a Medical Robotic System: Enabling Doctors to Remotely Conduct Ultrasonography and Physical Examination
In Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2016), New York, USA, August 2016
pdf   bib


Nicole Mirnig, Susanne Stadler, Gerald Stollnberger, Manuel Giuliani, and Manfred Tscheligi
Robot Humor: How Self-Irony and Schadenfreude Influence People's Rating of Robot Likability
In Proceedings of the IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN 2016), New York, USA, August 2016
pdf   bib


Krzysztof Arent, Janusz Jakubiak, Michal Drwikega, Mateusz Cholewinski, Gerald Stollnberger, Manuel Giuliani, Manfred Tscheligi, Dorota Szczkesniak-Stanczyk, Marcin Janowski, Wojciech Brzozowski, and Andrzej Wysokinski
Control of Mobile Robot for Remote Medical Examination: Design Concepts and Users' Feedback from Experimental Studies
In Proceedings of the 9th International Conference on Human System Interactions (HSI 2016), 76-82, Portsmouth , UK, July 2016
pdf   bib


Johannes Vollmer, Patrick Schuster, and Manuel Giuliani
Plank Challenge with NAO: Using a Robot to Persuade Humans to Exercise Longer
In Proceedings of the 11th International Conference on Persuasive Technology, Salzburg, Austria, April 2016
pdf   bib


Nicole Mirnig, Manuel Giuliani, Gerald Stollnberger, Susanne Stadler, Roland Buchner, and Manfred Tscheligi
Impact of Robot Actions on Social Signals and Reaction Times in HRI Error Situations
In Proceedings of 7th International Conference on Social Robotics (ICSR 2015), Paris, France, November 2015
pdf   bib


Alina Roitberg, Alexander Perzylo, Nikhil Somani, Manuel Giuliani, Markus Rickert, and Alois Knoll
Human Activity Recognition in the Context of Industrial Human-Robot Interaction
In Proceedings of AsiaPacific Signal and Information Processing Association Annual Summit and Conference (APSIPA ASC 2014), Siem Reap, Cambodia, December 2014
pdf   bib


Manuel Giuliani, Thomas Marschall, and Manfred Tscheligi
Applying Topic Recognition to Spoken Language in Human-Robot Interaction Dialogues
In Proceedings of the 2014 Workshop on Multimodal, Multi-Party, Real-World Human-Robot Interaction at ICMI 2014, Istanbul, Turkey, November 2014
pdf   bib


Abolfazl Zaraki, Manuel Giuliani, Maryam Banitalebi Dehkordi, Daniele Mazzei, Annamaria D'ursi, and Danilo De Rossi
An RGB-D Based Social Behavior Interpretation System for a Humanoid Social Robot
In Proceedings of the 2nd RSI International Conference on Robotics and Mechatronics (ICRoM 2014), Tehran, Iran, October 2014
Best Paper Award, Best Presentation Award
pdf   bib


Guang Chen, Daniel Clarke, David Weikersdorfer, Manuel Giuliani, Andre Gaschler, and Alois Knoll
Multi-modality Gesture Detection and Recognition With Un-supervision, Randomization and Discrimination
In Proceedings of the ChaLearn Looking at People Workshop, European Conference on Computer Vision (ECCV 2014), Zurich, Switzerland, September 2014
pdf   bib


Simon Keizer, Mary Ellen Foster, Andre Gaschler, Manuel Giuliani, Amy Isard, and Oliver Lemon
Handling Uncertain Input in Multi-user Human-robot Interaction
In Proceedings of the 23rd IEEE International Syposium on Robot and Human Interactive Communication (RO-MAN 2014), Edinburgh, Scotland, August 2014
pdf   bib


Manuel Giuliani, Thomas Marschall, and Amy Isard
Using Ellipsis Detection and Word Similarity for Transformation of Spoken Language into Grammatically Valid Sentences
In Proceedings of the 15th Annual SIGdial Meeting on Discourse and Dialogue (SIGDIAL 2014), Philadelphia, USA, June 2014
pdf   bib


Guang Chen, Manuel Giuliani, Daniel S. Clarke, Andre K. Gaschler, and Alois Knoll
Action Recognition Using Ensemble Weighted Multi-Instance Learning
In Proceedings of the IEEE International Conference on Robotics and Automation 2014 (ICRA 2014), Hong Kong, China, May 2014
pdf   bib


Sebastian Loth, Manuel Giuliani, and Jan P. de Ruiter
Ghost-in-the-Machine: Initial Results
In Proceedings of the 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2014), Bielefeld, Germany, March 2014
pdf   bib


Manuel Giuliani, Ronald P. A. Petrick, Mary Ellen Foster, Andre Gaschler, Amy Isard, Maria Pateraki, and Markos Sigalas
Comparing Task-based and Socially Intelligent Behaviour in a Robot Bartender
In Proceedings of the 15th International Conference on Multimodal Interfaces (ICMI 2013), Sydney, Australia, December 2013
pdf   bib


Mary Ellen Foster, Andre Gaschler, and Manuel Giuliani
How Can I Help You? Comparing Engagement Classification Strategies for a Robot Bartender
In Proceedings of the 15th International Conference on Multimodal Interfaces (ICMI 2013), Sydney, Australia, December 2013
pdf   bib


Andre Gaschler, Ronald P. A. Petrick, Manuel Giuliani, Markus Rickert, and Alois Knoll
KVP: A Knowledge of Volumes Approach to Robot Task Planning
In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2013), November 2013
pdf   bib


Guang Chen, Feihu Zhang, Manuel Giuliani, Christian Buckl, and Alois Knoll
Unsupervised Learning Spatio-temporal Features for Human Activity Recognition from RGB-D Video Data
In Proceedings of the International Conference on Social Robotics 2013 (ICSR 2013), Bristol, UK, October 2013
pdf   bib


Simon Keizer, Mary Ellen Foster, Oliver Lemon, Andre Gaschler, and Manuel Giuliani
Training and Evaluation of an MDP Model for Social Multi-User Human-Robot Interaction
In Proceedings of the 14th Annual SIGdial Meeting on Discourse and Dialogue (SIGDIAL 2013), Metz, France, August 2013
pdf   bib


Mary Ellen Foster, Andre Gaschler, Manuel Giuliani, Amy Isard, Maria Pateraki,
and Ronald P. A. Petrick
Two People Walk Into a Bar: Dynamic Multi-party Social Interaction with a Robot Agent
In Proceedings of the 14th ACM International Conference on Multimodal Interaction (ICMI 2012), Santa Monica, USA, October 2012
pdf   bib


Andre Gaschler, Sören Jentzsch, Manuel Giuliani, Kerstin Huth, Jan de Ruiter,
and Alois Knoll
Social Behavior Recognition Using Body Posture and Head Pose for Human-Robot Interaction
In IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2012), Vilamoura, Portugal, October 2012
pdf   bib


Manuel Giuliani and Jan de Ruiter
Combining Classical and Embodied Multimodal Fusion for Human-Robot Interaction
In Proceedings of the Embodied and Situated Language Processing 2012 (ESLP 2012), Newcastle Upon Tyne, England, August 2012
pdf   bib


Andre Gaschler, Kerstin Huth, Manuel Giuliani, Ingmar Kessler, Jan de Ruiter, and Alois Knoll
Modelling State of Interaction from Head Poses for Social Human-Robot Interaction
In Proceedings of the Gaze in Human-Robot Interaction Workshop held at the 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI 2012), Boston, MA, March 2012
pdf   bib


Manuel Giuliani and Alois Knoll
Evaluating Supportive and Instructive Robot Roles in Human-Robot Interaction
In Proceedings of the International Conference on Social Robotics 2011 (ICSR 2011), Amsterdam, Netherlands, November 2011
pdf   bib


Manuel Giuliani, Mary Ellen Foster, Amy Isard, Colin Matheson, Jon Oberlander, and Alois Knoll
Situated Reference in a Hybrid Human-Robot Interaction System
In Proceedings of the 6th International Natural Language Generation Conference (INLG 2010), Dublin, Ireland, July 2010
pdf   bib


Mary Ellen Foster, Manuel Giuliani, and Alois Knoll
Comparing Objective and Subjective Measures of Usability in a Human-Robot Dialogue System
In Proceedings of the 47th Annual Meeting of the Association for Computational Linguistics and the 4th International Joint Conference on Natural Language Processing of the Asian Federation of Natural Language Processing (ACL-IJCNLP 2009), Singapore, August 2009
pdf   bib


Mary Ellen Foster, Manuel Giuliani, Amy Isard, Colin Matheson, Jon Oberlander, and Alois Knoll
Evaluating Description and Reference Strategies in a Cooperative Human-Robot Dialogue System
In Proceedings of the Twenty-first International Joint Conference on Artificial Intelligence (IJCAI-09), Pasadena, California, July 2009
pdf   bib


Manuel Giuliani and Alois Knoll
MultiML - A General Purpose Representation Language for Multimodal Human Utterances
In Proceedings of the IEEE International Conference on Multimodal Interfaces, ICMI, Chania, Crete, October 2008
pdf   bib


Manuel Giuliani, Michael Kaßecker, Stefan Schwärzler, Alexander Bannat, Jürgen Gast, Frank Wallhoff, Christoph Mayer, Matthias Wimmer, Cornelia Wendt, and Sabrina Schmidt
MuDiS - A Multimodal Dialogue System for Human-Robot Interaction
In Proceedings of the International Workshop on Cognition for Technical Systems, Munich, Germany, October 2008
pdf   bib


Mary Ellen Foster, Manuel Giuliani, Thomas Müller, Markus Rickert, Alois Knoll, Wolfram Erlhagen, Estela Bicho, Nzoji Hipolito, and Luis Louro
Combining Goal Inference and Natural-Language Dialogue for Human-Robot Joint Action
In Proceedings of the International Workshop on Combinations of Intelligent Methods and Applications, European Conference on Artificial Intelligence, Patras, Greece, July 2008
pdf   bib


Manuel Giuliani and Alois Knoll
Integrating Multimodal Cues Using Grammar Based Models
In Constantine Stephanidis, editor, Proceedings of the 4th International Conference on Universal Access in Human-Computer Interaction, HCI International, Part II, volume 4555 of Lecture Notes in Computer Science, pages 858-867, Beijing, July 2007
pdf   bib


Markus Rickert, Mary Ellen Foster, Manuel Giuliani, Tomas By, Giorgio Panin, and Alois Knoll
Integrating Language, Vision and Action for Human Robot Dialog Systems
In Proceedings of the International Conference on Universal Access in Human-Computer Interaction, HCI International, volume 4555 of Lecture Notes in Computer Science, pages 987-995, Beijing, China, July 2007
pdf   bib


Manuel Giuliani, Tin Lay Nwe, and Haizhou Li
Meeting Segmentation Using Two-layer Cascaded Subband Filters
In Proceedings of 5th International Symposium on Chinese Spoken Language Processing, ISCSLP, Singapore, December 2005
pdf   bib

Theses

PhD thesis
Comparing Embodied and Classical Multimodal Fusion for Human-Robot Interaction
pdf   bib
Robotics and Embedded Systems
Technische Universität München
Adviser: Prof. Dr.-Ing. habil. Alois Knoll


Master's thesis
A Basic System for Interpretation of Utterances in Natural Language, Based on the Combinatory Categorial Grammar
November 2006
Robotics and Embedded Systems
Technische Universität München
Adviser: Prof. Dr.-Ing. habil. Alois Knoll


Magister Artium thesis
Praktische Dokumentkonversion in XML-Zielformate
March 2004
Centrum für Informations und Sprachverarbeitung
Ludwig-Maximilian-Universität München
Adviser: Prof. Dr. Klaus U. Schulz

Talks

Robots in Public Spaces: Towards Multi-party, Short-term, Dynamic Human-Robot Interaction
Workshop organiser at International Conference on Social Robotics, Bristol, UK, October 2013


Multimodal Fusion for Human-Robot Interaction
Invited talk at the SFB 732, Stuttgart, Germany, July 2012


Joint Action for Social Robotics: How to Build a Robot that Works Together with Several Humans
Organiser and presenter of tutorial at International Conference on Social Robotics, Amsterdam, Netherlands, November 2011


MultiML - A General Purpose Representation Language for Multimodal Human Utterances
Talk presented at the Dialogue Systems Group, School of Informatics, University of Edinburgh, Edinburgh, UK, October 2008


Representation of Speech and Gestures in Human-Robot Interaction
Talk presented at the IEEE RO-MAN 2008 workshop "Towards Natural Human-Robot Joint Action", Munich, Germany, August 2008