https://w3id.org/hdgi/gesture-interaction-pattern
Madhawa Perera, Armin Haller
Ontology pattern to model concepts related to human gesture interactions.
Gesture Interaction Pattern: a content ontology design pattern.
The Gesture Interaction Pattern aims to model the pose and movement of human body that are used to interact with devices (particularly with device affordances). This helps to describe a human gesture with its relationship between certain device affordances, related body parts and the temporal components associated with those.
This might be helpful in creating user specific gesture profiles. This ontology pattern is geared at mapping the ubiquitousness in gesture vocabularies by linking them appropriately and does not enforce designers and manufacturers to follow a standard.
This pattern is applicable for a wide range of scenarios in gesture interaction systems.
For example:
Consider a user who uses a certain gesture to turn on their personal air conditioner. If this user visits a hotel room with an air conditioner of a different model that carries different interactions, how can the system accommodate the user's preferred gesture and let the user continue, as in their own room, without having to read instructions. This ontology pattern will help to model parsonlised gesture details.
Further, online search engines currently do not provide sufficient information for gesture related semantics. For example, search query to retrieve ‘gestures to turn on a TV’, would not provide relevant gesture vocabularies supported by different vendors. Designers/developers have to find individual studies separately and read/learn necessary data manually. Being able to retrieve semantics of gestures which are related to the affordance of ‘turn on a TV’ would be convenient for designers and developers in such situations.
Gesture Interaction Pattern
Refer to https://w3id.org/hdgi to see a complete ontology schema build around Gesture Interaction Pattern
madhawaperera
madhawaperera
madhawaperera
madhawaperera
madhawaperera
madhawaperera
Relation between an Affordance and the Device classes where a device is able to afford it.
affordedBy
Turn on TV
Relation between a Gesture and the Duration, where the gesture has a duration. This is an owl:equivalentClass time:hasDuration.
hasDuration
Relation between a Gesture and a Pose where the pose represents the ending Pose of that gesture.
hasEndPose
Relation between a Gesture and a Movement where the movement describes a particular motion of a body part.
hasMovement
Relation between a Gesture and Pose where the pose represents the initial pose of that gesture.
hasStartPose
A Gesture could consist multiple atomic Gestures. This represents the relation between the Gesture and its atomic Gestures.
includesGestures
Relation between a Human and a Gesture.
performs
Relation between a Gesture and an Affordance where affordance is supported by that particular gesture.
supportsGesture
Relation between a Gesture and a BodyPart which describes the body parts used in that gesture. This is an owl:equivalentClass prov:used.
used
Relation between a Human and BodyPart which describes the body part that a human uses to perform a certain gesture.
uses
A timestamp represent the date and time of an event occured and that is recorded by a system/person.
timestamp
Affordance is a quality or characteristic of Devices that indicates the possible action a Human can take with it. This is rdfs:subClassOf ssn:Property.
Affordance
BodyPart is any part of HumanBody such as an Face, Leg etc.
BodyPart
Device denotes a piece of hardware or software which consists of sensors or actuators or both.
Device
Duration of a temporal extent expressed as a decimal number scaled by a temporal unit. This is an owl:equivalentClass time:Duration.
Duration
1
1
1
Gesture is a Movement or a Pose of a BodyPart.
Gesture
Human represents the user who performs a Gesture or a Pose.
Human
1
Movement is the act of moving a certain BodyPart towards a certain direction in a certain period of time (Duration).
Movement
1
Pose is repesent a particular Position and Rotation of a BodyPart at a particular timestamp.
Pose