{"id":1709,"date":"2018-12-16T00:00:10","date_gmt":"2018-12-15T23:00:10","guid":{"rendered":"https:\/\/www.um.sav.sk\/en\/?p=1709"},"modified":"2020-11-09T13:57:49","modified_gmt":"2020-11-09T12:57:49","slug":"1-object-recognition-in-color-images-of-a-complex-scene-based-on-hierarchical-temporal-memory-in-combination-with-the-detection-of-significant-areas","status":"publish","type":"post","link":"https:\/\/www.um.sav.sk\/en\/selected-results\/1-object-recognition-in-color-images-of-a-complex-scene-based-on-hierarchical-temporal-memory-in-combination-with-the-detection-of-significant-areas\/","title":{"rendered":"Object recognition in color images of a complex scene based on hierarchical temporal memory in combination with the detection of significant areas"},"content":{"rendered":"<p><span class=\"tlid-translation translation\" lang=\"en\">Investigator: I. Bajla<\/span><\/p>\n<p><span class=\"tlid-translation translation\" lang=\"en\">Biologically inspired hierarchical temporal memory (HTM) is one of the successful deep intelligent networks. However, its disadvantage is that it cannot be used directly to solve the detection and recognition of objects in multi-object color images of a complex scene. The basic goal of our research was to find a way to connect the HTM network with the apparatus of visual attention, which would allow the application of HTM to the task of recognizing objects in complex color images. We based the new solution of this task on our design of a parallel HTM system for three different features of objects (color, texture and shape), which we combined with an innovated computational model of visual attention, which uses maps of visual significance (so-called salient maps). Our proposed multi-stage algorithm allows to locate individual objects in the color image of complex scenes. The proposed combined system of HTM network and visual attention algorithm demonstrated better characteristics (so-called capture and success of object detection in the image) than two compared recognition approaches (cascade detectors and pattern matching). Promising results were obtained in the doctoral student&#8217;s dissertation, which was followed up during his postdoctoral stay at the Czech Technical University in Prague.<\/span><\/p>\n<p><a href=\"https:\/\/www.um.sav.sk\/veda-a-vyskum\/vybrane-vysledky-2-2\/vybrane-vysledky-2018\/pouzitie-metod-rontgenovej-mikrotomografie-v-komparativnej-anatomii\/attachment\/2018_projekty\/\" rel=\"attachment wp-att-nsm-1-3953\"><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter size-full wp-image-nsm-1-3953\" src=\"https:\/\/www.um.sav.sk\/en\/wp-content\/uploads\/2018_projekty.jpg\" alt=\"\" width=\"506\" height=\"759\" \/><\/a><\/p>\n<p><span class=\"tlid-translation translation\" lang=\"en\"><strong>Fig. 1:<\/strong> <em>Example of significance map, combined flag map and window position calculation process for HTM network application in two types of images &#8211; on partially distorted background (left column) and on completely distorted background (right column): 1 &#8211; input image of complexity 4, squares drawn the thick line represents the windows with real objects, 2 &#8211; the input image of complexity 2, the coarse squares &#8211; similarly as in Figure 1, 3,4 &#8211; the respective combined flag maps, 5,6 &#8211; the respective final maps of significance (salient maps). Asterisks indicate positions of local significance maxima, dashed squares indicate areas &#8211; sections from which image centroids (represented by triangles) are calculated. Centroids counted from the significance maps themselves are indicated by squares.<\/em><br \/>\n<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><span class=\"tlid-translation translation\" lang=\"en\"><strong>Foreign partner:<\/strong><br \/>\n\u2022 Czech Institute of Informatics, Robotics, and Cybernetics, Czech Technical University in Prague<\/span><\/p>\n<p>&nbsp;<\/p>\n<p><strong>Related projects:<\/strong><br \/>\n\u2022 VEGA 2\/0043\/13<br \/>\n\u2022 VEGA 2\/0138\/16<br \/>\n\u2022 European Regional Development Fund (CZ.02.1.01 \/ 0.0 \/ 0.0 \/ 15_0 03\/0 0 0 0470)<\/p>\n<p>&nbsp;<\/p>\n<p><strong>Publications:<\/strong><\/p>\n<ol>\n<li>\u0160KOVIERA, R. \u2013 BAJLA, I. \u2013 \u0160KOVIEROV\u00c1, J.: Object recognition in clutter color images using Hierarchical Temporal Memory combined with Salient-region detection. Neurocomputing, 2018, 307, s.172-183.\u00a0 (CC, IF=3,39).<\/li>\n<li>\u0160KOVIERA, R. \u2013 BAJLA, I. \u2013 KU\u010cEROV\u00c1, J. : Object Recognition in Clutter Color Images using Hierarchical Temporal Memory combined with Salient-Region Detection. In: M.H.Hamza (ed), IASTED 2015, Proc. of the Int. Conf. on Computational Intelligence, Innsbruck, Austria, February 16 &#8211; 17, 2015, s. 245-254, (ISI-WoS).<\/li>\n<li>\u0160KOVIERA, R.: Vyu\u017eitie samoorganizovan\u00e9ho u\u010denia v hierarchick\u00fdch HTM sie\u0165ach na rozpozn\u00e1vanie vizu\u00e1lnych objektov v obrazov\u00fdch datab\u00e1 Dizerta\u010dn\u00e1 pr\u00e1ca, 2015, FMFI UK a \u00daM SAV, Bratislava, 131 s.<\/li>\n<li>\u0160KOVIERA, R. \u2013 BAJLA, I.: Image classification based on Hierarchical Temporal Memory and color features. In: J. Ma\u0148ka, M. Ty\u0161ler, V. Witkovsk\u00fd, Frollo, (eds), MEASUREMENT 2013, Proc. of the 9th Int. Conf. on Measurement, Smolenice, Slovakia, May 27-30, 2013, s. 63-66. Institute of Measurement Science, Slovak Academy of Sciences, Bratislava, (ISI-WoS)<\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"<p>Investigator: I. Bajla Biologically inspired hierarchical temporal memory (HTM) is one of the successful deep intelligent networks. However, its disadvantage is that it cannot be&#8230;<\/p>\n","protected":false},"author":4,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":"","_links_to":"","_links_to_target":""},"categories":[33,30,36],"tags":[],"class_list":["post-1709","post","type-post","status-publish","format-standard","hentry","category-international-projects","category-selected-results","category-theo"],"publishpress_future_action":{"enabled":false,"date":"2026-04-15 13:29:41","action":"change-status","newStatus":"draft","terms":[],"taxonomy":"category","extraData":[]},"publishpress_future_workflow_manual_trigger":{"enabledWorkflows":[]},"_links":{"self":[{"href":"https:\/\/www.um.sav.sk\/en\/wp-json\/wp\/v2\/posts\/1709","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.um.sav.sk\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.um.sav.sk\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.um.sav.sk\/en\/wp-json\/wp\/v2\/users\/4"}],"replies":[{"embeddable":true,"href":"https:\/\/www.um.sav.sk\/en\/wp-json\/wp\/v2\/comments?post=1709"}],"version-history":[{"count":5,"href":"https:\/\/www.um.sav.sk\/en\/wp-json\/wp\/v2\/posts\/1709\/revisions"}],"predecessor-version":[{"id":2139,"href":"https:\/\/www.um.sav.sk\/en\/wp-json\/wp\/v2\/posts\/1709\/revisions\/2139"}],"wp:attachment":[{"href":"https:\/\/www.um.sav.sk\/en\/wp-json\/wp\/v2\/media?parent=1709"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.um.sav.sk\/en\/wp-json\/wp\/v2\/categories?post=1709"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.um.sav.sk\/en\/wp-json\/wp\/v2\/tags?post=1709"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}