https://w3id.org/hdgi/gesture-interaction-pattern Madhawa Perera, Armin Haller Ontology pattern to model concepts related to human gesture interactions. Gesture Interaction Pattern: a content ontology design pattern. The Gesture Interaction Pattern aims to model the pose and movement of human body that are used to interact with devices (particularly with device affordances). This helps to describe a human gesture with its relationship between certain device affordances, related body parts and the temporal components associated with those. This might be helpful in creating user specific gesture profiles. This ontology pattern is geared at mapping the ubiquitousness in gesture vocabularies by linking them appropriately and does not enforce designers and manufacturers to follow a standard. This pattern is applicable for a wide range of scenarios in gesture interaction systems. For example: Consider a user who uses a certain gesture to turn on their personal air conditioner. If this user visits a hotel room with an air conditioner of a different model that carries different interactions, how can the system accommodate the user's preferred gesture and let the user continue, as in their own room, without having to read instructions. This ontology pattern will help to model parsonlised gesture details. Further, online search engines currently do not provide sufficient information for gesture related semantics. For example, search query to retrieve ‘gestures to turn on a TV’, would not provide relevant gesture vocabularies supported by different vendors. Designers/developers have to find individual studies separately and read/learn necessary data manually. Being able to retrieve semantics of gestures which are related to the affordance of ‘turn on a TV’ would be convenient for designers and developers in such situations. Gesture Interaction Pattern Refer to https://w3id.org/hdgi to see a complete ontology schema build around Gesture Interaction Pattern madhawaperera madhawaperera madhawaperera madhawaperera madhawaperera madhawaperera Relation between an Affordance and the Device classes where a device is able to afford it. affordedBy Turn on TV Relation between a Gesture and the Duration, where the gesture has a duration. This is an owl:equivalentClass time:hasDuration. hasDuration Relation between a Gesture and a Pose where the pose represents the ending Pose of that gesture. hasEndPose Relation between a Gesture and a Movement where the movement describes a particular motion of a body part. hasMovement Relation between a Gesture and Pose where the pose represents the initial pose of that gesture. hasStartPose A Gesture could consist multiple atomic Gestures. This represents the relation between the Gesture and its atomic Gestures. includesGestures Relation between a Human and a Gesture. performs Relation between a Gesture and an Affordance where affordance is supported by that particular gesture. supportsGesture Relation between a Gesture and a BodyPart which describes the body parts used in that gesture. This is an owl:equivalentClass prov:used. used Relation between a Human and BodyPart which describes the body part that a human uses to perform a certain gesture. uses A timestamp represent the date and time of an event occured and that is recorded by a system/person. timestamp Affordance is a quality or characteristic of Devices that indicates the possible action a Human can take with it. This is rdfs:subClassOf ssn:Property. Affordance BodyPart is any part of HumanBody such as an Face, Leg etc. BodyPart Device denotes a piece of hardware or software which consists of sensors or actuators or both. Device Duration of a temporal extent expressed as a decimal number scaled by a temporal unit. This is an owl:equivalentClass time:Duration. Duration 1 1 1 Gesture is a Movement or a Pose of a BodyPart. Gesture Human represents the user who performs a Gesture or a Pose. Human 1 Movement is the act of moving a certain BodyPart towards a certain direction in a certain period of time (Duration). Movement 1 Pose is repesent a particular Position and Rotation of a BodyPart at a particular timestamp. Pose