Aldo Gangemi (Until version 1.1) Marieke van Erp (Until version 1.1) Bruno Sartini Sofia Baroncini Bruno Sartini, Sofia Baroncini, Marieke van Erp, Francesca Tomasi, and Aldo Gangemi. 2023. ICON: An Ontology for Comprehensive Artistic Interpretations. J. Comput. Cult. Herit. 16, 3, Article 59 (September 2023), 38 pages. https://doi.org/10.1145/3594724 April 12th, 2022 April 12th, 2022 https://creativecommons.org/licenses/by/4.0/ Bruno Sartini The top down development of this ontology followed these sources: Erwin Panofsky. 1972. Studies in iconology: humanistic themes in the art of the Renaissance. Westview Press, Boulder, Colo. OCLC: 1151325340. Max Imdahl. 2012. Iconica. L’intuizione delle immagini. Aisthesis. Pratiche, linguaggi e saperi dell’estetico (2012). Roelof van Straten. 2012. An introduction to iconography (2 ed.). Routledge, London, England. Its development followed these methodologies: Silvio Peroni. 2016. A Simplified Agile Methodology for Ontology Development.. In Proceedings of the 13th OWL: Experiences and Directions Workshop and 5th OWL reasoner evaluation workshop (OWLED-ORE 2016). Springer, Cham, Switzerland, 55–69. https://doi.org/10.6084/M9.FIGSHARE.3189769.V2 Valentina Presutti, Enrico Daga, Aldo Gangemi, and Eva Blomqvist. 2009. EXtreme Design with Content Ontology Design Patterns. In Proceedings of the 2009 International Conference on Ontology Patterns - Volume 516 (Washington DC) (WOP’09). CEUR-WS.org, Aachen, DEU, 83–97. ICON Ontology icon https://w3id.org/icon/ontology/ The ICON ontology deals with high granularity art interpretation. It was developed by conceptualizing Panofsky's theory of levels of interpretation, therefore artworks can be described according to Pre-iconographical, Iconographical and Iconological information. 1.1.0 1.1.0 2.1.0 work in progress **Version 2.1.0 Changelog** Introduction of six new classes: * Material * Color * Role * Preiconographical Subject * Iconographical Subject * Iconological Subject Seven new object properties * associatedMaterial * associatedColor * hasRole * hasPreiconographicalSubject * hasIconographicalSubject * hasIconologicalSubject * hasResponsibleAgent And one new data property * quantity Refer to the classes and properties in protege or in the documentation for more explanations on them This relation associates each Recognition directly to the artwork. In this way, it is possible to retrieve easily all the interpretations about an artwork. Therefore, it a highly recommended good practice to declare it for each interpretation. About Work Of Art This relation associates a Pure Form to the Pre-iconographical Recognition that describes it at the first level of interpretation. Associated Form Since 1.1 version This Property links an invenzione with its components, which may vary from Characters, Events, Named Objects, Places to Personifications, Symbols according to the kind of Invenzione is being described. Composed Of This relation links an Intrinsic Meaning to the Artistic Motif recognized at the first level of interpretation. It should be used to express that the third level meaning associated to the Intrinsic Meaning refers specifically to this Artistic Motif, and not only to the general artwork. Has Artistic Motif This relation links an Intrinsic Meaning to the Composition recognized at the first level of interpretation. It should be used to express that the third level meaning associated to the Intrinsic Meaning refers specifically to this Composition, and not only to the general artwork. Has Composition This relation describes the arrangement of the Artistic Motifs composing the Composition. It is suggested to use it only when they are arranged in a relevant observable structure (e.g. pyramidal, oblique) Has Compositional Structure This property is used to link an image to the iconographical subject it represents, it is used when it is difficult to distinguish between the different iconographical subjects (for instance in the case of an automatic conversion of data into the ICON ontology) has Iconographical Subject This property is used to link an intrinstic meaning to the iconological subject it represents. It is useful in the cases where it is difficult to identify the type of the iconological subject (cultural phenomenon, abstract concept...) especially in cases of automatic conversions of data to the ICON ontology structure has Iconological Subject This relation links an Intrinsic Meaning to the Image recognized at the second level of interpretation. It should be used to express that the third level meaning associated to the Intrinsic Meaning refers specifically to this Image, and not only to the general artwork. Has Image This relation links an Intrinsic Meaning to the Invenzione recognized at the second level of interpretation. It should be used to express that the third level meaning associated to the Intrinsic Meaning refers specifically to this invenzione, and not only to the general artwork. Has Invenzione This property links an artistic motif with a pre-iconographical subject represented by it, it is used when it is difficult to distinguish between the different types of pre-iconographical subjects (for example in situations where the conversion from interpretation to ICON is made automatically) has Pre-iconographical Subject This relation identifies objects belonging to the level 1 as fundamental for the recognition of a certain subject. It is suggested that the Artistic Motif of the object is included in the Composition corresponding to the subject. Has Rec Attribute Inverse property of aboutWorkOfArt Has Recognition This property links the Interpretation Description with all the agents responsible for the recognitions that are part of it has Responsible Agent This property is used to link an artistic motif or an image to one of the (recognized) roles of the elements recognized in those artistic motifs or images. For instance, expressing that the role of the man recognized in a painting is "butcher", "prince", etc... Role This property is used to link all the iconographical recognitions that take part in one or more interpretation(s), to that/those interpretation(s) iconographically complies with This property is used to link an artwork to the element of the second level of interpretation (iconographical) which it depicts. This elements can be Characters, Symbols, Personifications, Places, Stories, Allegories (and the element these stories and allegories are composed of). Example: There is an IconographicalRecognition of Artwork1 of Image1, which is linked to the character Thor through the hasCharacter property. Then Artwork1 iconographicallyDepicts Thor. Example2: There is an IconographicalRecognition of Artwork1 of Story1, which is the story of the death of Julius C. This story is composed by the Place Rome and the character Julius C. (and more...) Then Artwork1 IconographicallyDepicts the story of the death of Julius C., Julius C., and the city of Rome. This link can be created automatically through inference thanks to the super property chain, or it can be written by users who are not planning of including contextual information to the interpretation. Iconographically Depicts This property is used to link all the iconological recognitions that take part in one or more interpretation(s), to that/those interpretation(s) iconologically complies with This property is used to link an artwork to the element of the third level of interpretation (iconological) which it represents. This elements can be Cultural Phenomena, Social Objects (abstract concepts). Example: There is an IconologicalRecognition of Artwork1 of IntrinsicMeaning1, which is linked to the cultural phenomenon of ImitationOfClassics Then Artwork1 iconologicallyRepresents ImitationOfClassics. Example2: There is an IconologicalRecognition of Artwork1 of IntrinsicMeaning2, which is linked to the social object "Absurdity" (and to other elements from other levels that suppor this claim...) Then Artwork1 IconologicallyRepresents Absurdity This link can be created automatically through inference thanks to the super property chain, or it can be written by users who are not planning of including contextual information to the interpretation. Iconologically Represents Inverse property of has artistic motif Is artistic motif of Inverse property of hasCharacter Is Character Of Inverse of iconographically complies with is compliant with iconographical recognition inverse of iconologically complies with is compliant with iconological recognition Inverse of pre-iconographically complies with is compliant with pre-iconographical recognition Inverse property of has composition Is composition of Inverse property of hasCompositionalStructure Is Compositional Structure Of Inverse property of hasCopiedMotif Is Copied Motif Of Inverse property of recognizedCulturalPhenomenon Is Cultural Phenomenon Of Inverse property of hasEvent Is Event Of Inverse property of hasExpressionalMeaning Is Expressional Meaning Of Inverse property of hasFactualMeaning Is Factual Meaning Of Inverse property of recognizedImage Is Iconographically Recognized By Inverse property of refers to artistic motif Is iconographically referred by Inverse property of has image Is image of Inverse property of recognized intrinsic meaning Is Intrinsic Meaning Of Inverse property of hasInvenzione Is Invenzione Of Inverse property of hasNamedObject Is Named Object Of Inverse property of hasPersonification Is Personification Of Inverse property of hasPlace Is Place Of Inverse property of hasPrototypicalMotif Is Prototypical Motif Of Inverse property of associatedForm Is Pure Form Of since 1.1 version Inverse property of hasRecAttribute Is Rec Attribute Of Inverse property of recognizedInvenzione Is Recogn Of Inverse property of recognized artistic motif Is Recognized Artistic Motif Of Inverse property of recognizedComposition Is Recognized Composition Of Inverse property of recognizedConcept Is Recognized Concept Of Inverse property of has symbol Is Symbol Of Inverse property of hasPart Part Of (ICON) This property is used to link all the pre-iconographical and formal motif recognitions recognitions that take part in one or more interpretation(s), to that/those interpretation(s) pre-iconographically complies with This property is used to link an artwork to the element of the first level of interpretation (pre-iconographical) which it depicts. This element can be a Natural Element, an Action, Expression, or an element included in a recognized Composition (again, natural element, action, expression). Example: There is a PreiconographicalRecognition of Artwork1 of ArtisticMotif1, which is linked to the natural element bear. Then Artwork1 preiconographicallyDepicts bear. Example2: There is a PreiconographicalRecognition of Artwork1 of ArtisticMotif2, which is linked to the composition1, composed by a bear and the action of eating. Then Artwork1 preiconographicallyDepicts bear and eating. This link can be created automatically through inference thanks to the super property chain, or it can be written by users who are not planning of including contextual information to the interpretation. Pre-iconographically Depicts This relation expresses the Concept that is related to the Intrinsic Meaning Recognized Concept This relation expresses the Cultural Phenomenon that is related to the Intrinsic Meaning Recognized Cultural Phenomenon This property is substituted by the the solution adopted by linked.art using crm:P2_has_type as follows: <subject>, crm:P2_has_type, <specific style term>. <specific style term> crm:P2_has_type, <http://vocab.getty.edu/aat/300015646> # the AAT term indicating the concept of style. Recognized Genre since new version 25/03 This relation associates the Intrinsic Meaning to the Iconological Recognition that recognizes it at the third level of interpretation. Recognized Intrinsic Meaning This relation associates a Composition or an Artistic Motif to the Iconographical Recognition that describes it at the second level of interpretation. Refers To Artistic Motif Inverse property of composed of Takes part in This data property can be used to link an artistic motif or a composition with their coordinates in the image of the artwork in which they are recognized. These coordinates could indicate the bounding boxes of the detections of a computer vision algorithms or could also be the IIIF URI that selects the part of the image of the painting in which the artistic motif or the composition are found Region Description This class is substituted by the the solution adopted by linked.art using crm:P2_has_type as follows: <subject>, crm:P2_has_type, <specific style term>. <specific style term> crm:P2_has_type, <http://vocab.getty.edu/aat/300015646> # the AAT term indicating the concept of style. Art Genre since new version 25/03 1 1 1 Example term taken from Panofsky's studies, can be used as a specification of a cultural phenomemon if it can be considered an Attitude Attitude Example term taken from Panofsky's studies, can be used as a specification of a cultural phenomemon if it can be considered a Belief Belief Class representing the color of an entity represented in an Artistic Motif or Image Color 1 1 The compositional structure identifies relevant structures that can be recognized in the layout of Artistic Motifs in a Composition, e.g. pyramidal, symmetrical. Compositional Structure The cultural phenomenon entity expresses the cultural, social and historical aspects of which the work of art can be document. The iconographical evolution of subjects can have a cultural meaning as well. Also the personal characteristics of the artist, or of the patron, can be involved (Wittkower, Van Straten). The cultural phenomena are the object of investigation of an iconological interpretation (Van Straten, 2012, p. 12), which is considered, in the current work, a level 3 interpretation. Cultural Phenomenon Example term taken from Panofsky's studies, can be used as a specification of a cultural phenomemon if it can be considered a CulturalValue Cultural Value 1 1 1 1 The act of recognizing that subjects depicted by different artworks has the same formal motifs although the content represented may be different. The need of the usage of this class emerged from a bottom-up approach, rather than Panofsky's theory. It describes that certain subjects are prototypes of others, including preliminary drawings, but also cases in which another artist copied only the composition or gestures from another artwork. This recognition can link every specific part of a representation to the specific prototypes. The relation is between level 1 objects, i.e. Artistic Motifs and Composition, since it describes a formal aspect. Example of usage: if Hercules carrying the Boar is the prototype for a Christ carrying a deer, symbol of the human souls, it's possible to relate directly the boar represented in the former artwork to the deer represented in the latter. Formal Motif Recognition An Iconographical Description is the enumeration of iconographical recognitions of images or invenzioni recognized by one or more agents. It is thus a collection of triples. It is the summary of what would be called in Panofsky's term the second level of interpretation. Iconographical Description from version 1.1 1 1 A Iconographical Recognition is a n-ary relationship class that links the artwork described (and, if available, the Artistic Motifs recognized at the previous level along with their compositions) to the Images recognized, or directly to the Invenzione that results from the grouping of the subject depicted by each single image. The N-ary structure is necessary in order to include relevant additional information concerning the visual interpretation claimed. Iconographical Recognition This class represents all the iconographical subjects of an artwork recognized in images Iconographical Subject An Iconographical Synthesis is the enumeration of iconological recognitions of intrinsic meanings recognized by one or more agents concerning a work of art. It is thus a collection of triples. It is the summary of what would be called in Panofsky's term the third level of interpretation. Iconographical Synthesis from version 1.1 1 An Iconological Recognition is a n-ary relationship class that links the artwork described (and optionally all the subjects represented at the first and second level of interpretation) to the Intrinsic Meanings recognized. The N-ary structure is necessary in order to include relevant additional information concerning the visual interpretation claimed. This class can represent: (1) the third level act of Interpretation described by Panofsky (1939), without a distinction between a overall artwork symbolic meaning and a societal aspect, (2) the third and second level described by Van Straten, according to the value associated to the intrinsic meaning, (3) the iconic act of interpretation described by Imdahl (2012), when the intrinsic meaning is directly linked to level 1 characteristics of the image. Iconological Recognition Iconological Subject This class represents all the iconological subjects of an artwork recognized through an intrinstic meaning 1 1 1 1 1 1 1 1 1 1 1 1 This class represent the material expressed in an artistic motif or image (referring to the element recognized in them) Material A Pre-iconographical description is the enumeration of the Pre-Iconographical Recognitions of a certain work of art, performed by one or more agents. It is thus a collection of triples constituting the documentation of the interpretation at level 1. The term and its definition is taken from Panofsky's Studies in Iconology (1939). Preiconographical Description from version 1.1 1 1 A Pre-iconographical recognition is a n-ary relationship class that links the artwork described (and optionally the Pure Forms composing it) to the Artistic Motifs recognized as carrier of meaning at the first level of analysis. The N-ary structure is necessary in order to include relevant additional information concerning the visual interpretation claimed. Preiconographical Recognition This class is used to represent all the preiconographical subjects that can be recognized in an artistic motif Pre-iconographical Subject A pure form represents the physical portion of the work of art in which artistic motifs are found. It has been introduced as a way to include the results of analysis performed by computational agents, that are able to classify images and give image coordinates for specific recognition. It is not recommended to be used by manual annotators or in any case in which the coordinates of the image of the work of art are not considered. If available, the Pure form can represent the region of an image identified by IIIF Image API. Change the definition to the formal representation that can be enclosed in a certain coordinate. Pure Form from 1.1 version 1 1 This class represents the Role of an element recognized in an artistic motif or an image. Role Example term taken from Panofsky's studies, can be used as a specification of a cultural phenomemon if it can be considered a tendency Tendency A visual subject is the representation of the subject in specific artwork, in contrast with the arco:Subject which is used to define a general subject which can be shared by multiple artworks. For example, the image representing Christ in the Last Supper is a visual Subject because it is intended as only that representation for that specific artwork. The character referred by that image (Christ) would be an arco:Subject, and it can shared by all the artworks that have a specific image that refers to Christ. Visual Subject Character An event as recognized at level 1 of interpretation, e.g. a man who lifts one hand or a man riding a horse. Generally, all the actions should be described by this class. When an action is identified, it is suggested to create a Composition with all the elements involved in this action Action (ICON) An Allegory is a cohese combination of images that represent either symbols of personifications. Allegories are recognized in the context of iconographical recognition; their recognition can be included in an Iconographical Description. This definition of Allegory has been taken from Panofsky's Studies in Iconology (1939). Nevertheless, also a story can have a symbolical meaning. In this case, it is suggested to associate a Story to the images describing its content, an allegory to the images describing the story and the symbolical meaning associated to it. E.g.: the fall of Phaeton was generally considered as an allegory of the fate of every temerarius (Panofsky 1939, p. 218). Therefore, the image identifying Phaeton is linked both to the Allegory and to the Story. Allegory An ArtisticMotif is the output of a Pre Iconographic Recognition. It is a N-ary relationship class linking the physical unique representation depicted in an artwork to the corresponding real world meaning recognized. Each artistic motif describes exactly one meaning among: Natural Element, Action, Expression Quality. Qualities (e.g. colors) can be expressed. The N-ary structure allow first of all to maintain the distinction between the particular representation belonging to the artwork considered and the general meaning of which the representation is an expression. Furthermore, it allows to carefully describe in detail what is represented in the visual representation, since it gives the chance to identify uniquely details of objects and iconographies. Artistic Motif The artwork is a visual representation that may be relevant from an iconographical or an iconological point of view, carried by a physical cultural object (dul:InformationRealization) usually created by a person. Artwork A Character is a real or imaginary being identifiable as a subject in the Iconographical Analysis (level 2 of interpretation) Character A Composition is a jointly of ArtisticMotif having a meaning. It can be recognized as corresponding to the same image at the second level or interpretation, or can explicit groupings of level 1 elements that the descriptor considers significant. Its is suggested to express the level 1 elements involved every time that there is an action (e.g. the action "lifting" in the context of "man lifting a woman" should be grouped in a composition including the artistic motifs corresponding respectively to "man", "woman, "lifting") Composition An Event is an action that is depicted as subject by an artwork. It differs from the first level Action since it requires deeper interpretation to be identified. For example, the act of hurling the Trident (Action) held by Neptune in some iconographies is interpreted as the act of calming the storm (Event) provoked by Juno in Virgil's Aeneid book 1. Furthermore, an Event is linked to a icon:Image, and not to a icon:Artistic Motif. This class includes also events having a proper identity, such as historical events (e.g. the Battle of Cascina). Event An Expression Quality corresponds to the "expressional subject matter" described by Panofsky (1939), which belongs, along with the factual ones, to the Primary or natural subject matter of a work of art. Indeed, it individuates, by way of example, emotions, an atmosphere, the character of a person. Expressional Quality Image is a reification class linking the identified second level subject (namely: Characters, Events, Places, Named Objects, Symbols and Personifications) to the specific interpretation that recognizes it. It represents the subject depicted as a manifestation in the specific artwork taken into account, in contrast to the second level subjects cited and Invenzione, identifying iconographies from an abstract and general point of view. This distinction between the general subject level and the artwork-specific one is functional to identify the variants of a subject in relation to the specific context. Image The Interpretation Description is a class collecting all the triples describing each recognition in each level that shares a unique interpretative perspective. For example, it allows to collect claims agreeing each other or to describe the situation in which an art historian attributes to other art historians some details of the general interpretation he claims. Recognitions in disagree with each other should be documented in different descriptions. For example, the interpretation made in 1699 recognising Regnaudin's statuette as depicting "Time carrying off the Truth" is listed in a different description form the interpretation recognising "The rape of Cybele" as its subject (Wittkower). Interpretation Description N-ary relatioship class linking the identified cultural phenomenon or deeper meaning to the whole artwork or to the specific part of its representation and to the interpretation that identifies it. From a theoretical point of view, it corresponds to the manifestation in the specific artwork of the concepts and cultural phenomena identified by the iconological analysis. The terminology is taken from Panofsky (1939, 1955). Intrinsic Meaning An Invenzione, term taken from Panofsky's Studies in Iconology (1939), is the subject matter represented by the combination of the single images recognized. The recognition of an Invenzione happens in the context of the iconographical recognition and it is included in the Iconographical Description. This definition slightly differs from the Panofsky's one: while he describes an invenzione as a form expressing the subject, we consider it as an individual belonging to the "sphere of secondary or conventional subject matter, viz., the world of specific themes or concepts manifested in images [...]". This new definition has been introduced to allow to formalize and recognize subjects represented in different artworks. Nevertheless, the identity of form and subject is already included in the definition of the class Artwork. Story and Allegory are subclasses of Invenzione. Invenzione A named object is a non-living unique element that is often used as an attribute for the recognition of specific characters or as the individuals of a more general concept class. (e.g. Bible for the Book class) Named Object Comprises objects, human beings, natural elements that can be experienced. They are recognized at the first level of interpretation. Natural Element A representation of a concept through a human figure Personification (ICON) An identified setting, e.g. the city of Bologna, which is recognized as a Level 2 subject. The recognition of a generic city is formally represented by the Natural Element class (level 1). Place (ICON) A recognition, in the context of this ontology, is an interpretation act made by an agent (biological or electronic being) that links works of arts to something related to their content. More specific recognitions are available as subclasses for specific types of recognition according to the level of interpretation. Recognition A story is a cohese combination of images that represent narrative elements such as Characters, Places, Events, Named Objects. The recognition of a story happens in the context of an Iconographical Recognition, and it is included in an Iconographical Description. As the super class Invenzione, it concerns the word of the subject matter. It is not necessary to have multiple images to compose a story. Story A Symbol is the class representing the unity of a symbol and its symbolic meaning that can be expressed by an Image. The represented object (Simulacrum) and the symbolical meaning expressed (Reality Counterpart) along with the type of relation linking them if further represented by the Simulation Ontology. Symbol This property is used to link an artistic motif or an image to one of the (recognized) colors of the elements recognized in those artistic motifs or images. For instance, expressing "red" in the artistic motif representing a scarf in a work or art. associated Color This property is used to link an artistic motif or an image to one of the (recognized) materials of the element that are recognized in those artistic motifs or images. For instance, expressing that the artistic motif representing a crown in a portrait denotes also that the crown is made of bronze. Or that the image of the Thor's Hammer is denoting that the hammer is made of steel. associated Material This relation links an image to the Character depicted Has Character This relation associates to the act of Formal Motif Recognition the Artistic Motif representing the copied visual pattern. To be used when it is affirmed that a specific feature has as a prototype the same feature of a specific visual item. Has Copied Motif This relation links an image to the Event depicted Has Event This relation links the Expressional Meaning recognized to the Artistic Motif Has Expressional Meaning This relation links the Factual Meaning recognized (Actions or Natural Elements) to the Artistic Motif Has Factual Meaning This relation links an image to the Named Object depicted Has Named Object This relation links a Composition to the Artistic Motifs of which it consists. Has Part (ICON) This relation links an image to the Personification depicted Has Personification This relation links an image to the Place depicted Has Place This relation associates to the act of the Recognition of a formal motif to the artistic motif from which the visual pattern derives. It should be used when it is affirmed that a specific feature has as a prototype the same feature of a specific visual item. Has Prototypical Motif This relation links an image to the Symbol depicted Has Symbol This data property expresses the number or elements represented in an artistic motif, especially when the recognition of each element is not needed Quantity This relation associates the Artistic Motif to the Pre-iconographical Recognition that recognizes it at the first level of interpretation. Recognized Artistic Motif This relation associates the Composition to the Pre-iconographical Recognition that recognizes it at the first level of interpretation. Recognized Composition This relation associates the Image to the Iconographical Recognition that recognizes it at the second level of interpretation. Recognized Image This relation associates the Invenzione to the Iconographical Recognition that recognizes it at the second level of interpretation. Recognized Invenzione