You are currently browsing the tag archive for the ‘Contour Detection’ tag.
Pranav Mistry and SixthSense technology – Part 1 of 2
Pranav Mistry and SixthSense technology – Part 2 of 2
Fig. – Illusion created by Prof. Akiyoshi Kitaoka (Dep. of Psychology, Ritsumeikan Univ., Kyoto, Japan). If you don’t see any illusion at all, don’t worry. That’s exactly why this optical illusion is so great. The illusion is not there, or is it?! Meanwhile over his page, Akiyoshi warns: This page contains some works of “anomalous motion illusion”, which might make sensitive observers dizzy or sick. Should you feel dizzy, you had better leave this page immediately (more).
Where’s the illusion, right? Well,… what if I just tell you that no blue at all is used over this picture! No matter how strongly you want to believe you are seeing blue and green spirals here, there is no blue color in this image. There is only green, red and orange. What you think is blue is actually green. Don’t worry, … you are not daltonic. I mean, I’m a little bit but, you could check this out through Paint Shop Pro or Photoshop, if you need an affirmation. Indeed, these are just “Vain speculation undeceived by the senses” (1670’s Scilla’s treatise) .
In fact, Relations here, between different colors (green, red and orange), are more important than each color by itself. Relations plus context are the key (more here over Generative Art, and here over Swarm Intelligence based Pattern Recognition). Through these relations, much probably using Gestalt‘s principles (the German word Gestalt could be translated into “configuration or pattern”), here Akiyoshi manages to emerge us the blue color over our perception. This does not cheat a computer of course, however could cheat our own eyes. In other areas the opposite could also be found. For instance, Humans can easily recognize a car over background trees (segment it, in just tiny lapses of a second), while this natural task could be extremely painful for computers over some cases (here is one example).
Born in Prague (inspired by 1890’s works of Christian von Ehrenfels, Austrian philosopher), then later absorbed by a great and tremendous intellectual period occurred from Germany back to Austria (Bauhaus), the Gestalt Laws of Organization have guided the study of how people perceive visual components as organized patterns or wholes, instead of many different parts. I would say that most certainly some Wertheimer’s gestaltic principles were used in here: Figure and Ground, Similarity, Proximity or Contiguity, Continuity, Closure, Area, and Symmetry (check Gestalt Theory of Visual Perception). We could see this happening also in other areas, … in Music for instance:
[…] Gestalt theory first arose in 1890 as a reaction to the prevalent psychological theory of the time – atomism. Atomism examined parts of things with the idea that these parts could then be put back together to make wholes. Atomists believed the nature of things to be absolute and not dependent on context. Gestalt theorists, on the other hand, were intrigued by the way our mind perceives wholes out of incomplete elements [1, 2]. “To the Gestaltists, things are affected by where they are and by what surrounds them…so that things are better described as “more than the sum of their parts.” [1, p. 49]. Gestaltists believed that context was very important in perception. An essay by Christian von Ehrenfels discussed this belief using a musical example. Take a 12 note melody. Play it in one key, say the key of C. Now change to another key, say the key of A flat. There might not be any notes the same in the two songs, yet a person listening to it knows that it is the same tune. It is the relationships between the notes that give us the tune, the whole, not which notes make up the tune. […], from “Gestalt Principles of Perception“, Bonnie Skaalid, Univ. of Saskatchewan, Canada, 1999.
Care for an contemporary example? Well, … the first thing that comes to my mind is DUB music genre. In fact, I do have several albums from different musicians over my house. Dub music evolved in Jamaica (1968) from early rastafarian instrumental reggae music and versions that incorporated fairly primitive reverbs and echo sound effects, being found by accident (engineer Byron Smith left the vocal track out by accident). Over decades, it inspired immense groups of musicians from well-known bands such as The Police, The Clash, UB40 up to reputed musicians such as Bill Laswell. Of course !, it was not far from what John Cage have made for the solo piano Music of Changes, to determine which notes should be used and when they should sound. In the fifty’s, Cage start it to use the mechanism of the I Ching (Chinese “Book of Changes”) in the composition of his music in order to provide a framework for his uses of chance.
Other most recent bands include, Leftfield, Massive Attack, Bauhaus, The Beastie Boys, Asian Dub Foundation, Underworld, Thievery Corporation, Gorillaz, Kruder & Dorfmeister, and DJ Spooky. But what is then so special about Dub? Well, one of this genre’s most striking features is the fact that some if not all musical sentences are incomplete. Those special sentences (Gestaltic, let me add), are normally followed by a pause. The most amazing thing however, is that us, Humans could perceive the entire sentence being formed on the back of our minds! So the music is not there, and at the same time, we are listening to two adjacent simultaneous melodies, as we were a composer. By just using relations among a few notes, we soon start to emerge a perception for the whole sentence, as if they were self-organizing! Being it extremely rhythmic, this often could lead us to a sweet soft state of overwhelming emotion, or exalted organic feel to the music .
As you will probably know by now, the same could happen over misplaced letters over an entire phrase. Even if some letters are not at their right proper place, at each word, we could still perceive the whole sentence meaning. Up to your gestaltic neurons to decipher.
Next time you go to a rave party (I never did, neither pretend to), do think about the title of this post, the figure above, as well as on all those great past musicians, along with – unfortunately – awkward current DJ’s, who pass on for hours strident music mixes without knowing at all what Gestalt is all about! Oh, … by the way, should you feel extremely dizzy, do follow Akiyoshi’s advice: If you start feeling unwell when using this website (rave party), immediately cover one eye with your hand and then leave the page (leave the party). Do not close your both eyes because that can make the attack worse!
With the current ongoing dramatic need of Africa to have contemporary maps (currently, Google promises to launch his first and exhaustive world-wide open-access digital cartography of the African continent very soon), back in 1999-2000 we envisioned a very simple idea into a research project (over my previous lab. – CVRM IST). Instead of producing new maps in the regular standard way, which are costly (specially for African continent countries) as well as time consuming (imagine the amount of money and time needed to cover the whole continent with high resolution aerial photos) the idea then was to hybridize trough an automatic procedure (with the help of Artificial Intelligence) new current data coming from satellites with old data coming from the computational analysis of images of old colonial maps. For instance, old roads segmented in old maps will help us finding the new ones coming from the current satellite images, as well as those that were lost. The same goes on for bridges, buildings, numbers, letters at the map, etc. However in order to do this, several preparatory steps were needed. One of those crucial steps was to obtain (segment – know to be one of the hardest procedures in image processing) the old roads, buildings, airports, at the old maps. Back in 1999-2000 while dealing with several tasks at this research project (AUTOCARTIS – Automatic Methods for Updating Cartographic Maps) I started to think of using evolutionary computation in order to tackle and surpass this precise problem, in what then later become one of the first usages of Genetic Algorithms in image analysis. The result could be checked below. Meanwhile, the experience gained with AUTOCARTIS was then later useful not only for digital old books (Visão Magazine, March 2002), as well as for helping us finding water in Mars (at the MARS EXPRESS European project – Expresso newspaper, May 2003) from which CVRM lab. was one of the European partners. Much often in life simple ideas (I owe it to Prof. Fernando Muge and Prof. Pedro Pina) are the best ones. This is particularly true in science.
Figure – One original image (left – Luanda, Angola map) and two segmentation examples, rivers and roads respectively obtained through the Genetic Algorithm proposed (low resolution images). [at the same time this precise Map of Luanda, was used by me along with the face of Einstein to benchmark several dynamic image adaptive perception versus memory experiments via ant-like artificial life systems over what I then entitled Digital Image Habitats]
[] Vitorino Ramos, Fernando Muge, Map Segmentation by Colour Cube Genetic K-Mean Clustering, Proc. of ECDL´2000 – 4th European Conference on Research and Advanced Technology for Digital Libraries, J. Borbinha and T. Baker (Eds.), ISBN 3-540-41023-6, Lecture Notes in Computer Science, Vol. 1923, pp. 319-323, Springer-Verlag -Heidelberg, Lisbon, Portugal, 18-20 Sep. 2000.
Segmentation of a colour image composed of different kinds of texture regions can be a hard problem, namely to compute for an exact texture fields and a decision of the optimum number of segmentation areas in an image when it contains similar and/or non-stationary texture fields. In this work, a method is described for evolving adaptive procedures for these problems. In many real world applications data clustering constitutes a fundamental issue whenever behavioural or feature domains can be mapped into topological domains. We formulate the segmentation problem upon such images as an optimisation problem and adopt evolutionary strategy of Genetic Algorithms for the clustering of small regions in colour feature space. The present approach uses k-Means unsupervised clustering methods into Genetic Algorithms, namely for guiding this last Evolutionary Algorithm in his search for finding the optimal or sub-optimal data partition, task that as we know, requires a non-trivial search because of its NP-complete nature. To solve this task, the appropriate genetic coding is also discussed, since this is a key aspect in the implementation. Our purpose is to demonstrate the efficiency of Genetic Algorithms to automatic and unsupervised texture segmentation. Some examples in Colour Maps are presented and overall results discussed.
(to obtain the respective PDF file follow link above or visit chemoton.org)
Transition behavior of one Artificial Ant Colony in presence of a sudden change in his artificial digital image Habitat, between two different Digital Grey Images (face of Einstein and a Map). Created with an Artificial Ant Colony, that uses images as Habitats, being sensible to their gray levels [in, V. Ramos, F. Almeida, “Artificial Ant Colonies in Digital Image Habitats – a mass behavior effect study on Pattern Recognition“, ANTS’00 Conf., Brussels, Belgium, 2000].
After “Einstein face” is injected as a substrate at t=0, 100 iterations occur. At this point you could recognize the face. Then, a new substrate (a new “environmental condition”) is imposed (Map image). The colony then adapts quickly to this new situation, losing their collective memory of past contours.
In white, the higher levels of pheromone (a chemical evaporative sugar substance used by swarms on their orientation trough out the trails). It’s exactly this artificial evaporation and the computational ant collective group synergy reallocating their upgrades of pheromone at interesting places, that allows for the emergence of adaptation and “perception” of new images. Only some of the 6000 iterations processed are represented. The system does not have any type of hierarchy, and ants communicate only in indirect forms, through out the successive alteration that they found on the Habitat. If you however, inject Einstein image again as a substrate, the whole ant society will converge again to it, but much faster than the first time, due to the residual memory distributed in the environment.
As a whole, the system is constantly trying to establish a proper compromise between memory (past solutions – via pheromone reinforcement) and novel ones in order to adapt (new conditions on the habitat, through pheromone evaporation). The right compromise, ables the system to tackle two contradictory situations: keeping some memory while learning something radically new. Antagonist features such as exploration and exploitation are tackled this way.
Image Classification of Shellfish Larvae Digital Images using Swarm Intelligence. On the left a compendium of 9 raw images (out of 20 samples) used in the present project. Respective segmented images on the rigth.
[] Vitorino Ramos, Jonathan Campbell, John Slater, John Gillespie, Ivan F. Bendezu and Fionn Murtagh, Swarming around Shellfish Larvae Images, in WCLC-05, 2nd World Congress on Lateral Computing, Bangalore, India, 16-18 Dec., 2005.
The collection of wild larvae seed as a source of raw material is a major sub industry of shellfish aquaculture. To predict when, where and in what quantities wild seed will be available, it is necessary to track the appearance and growth of planktonic larvae. One of the most difficult groups to identify, particularly at the species level are the Bivalvia. This difficulty arises from the fact that fundamentally all bivalve larvae have a similar shape and colour. Identification based on gross morphological appearance is limited by the time-consuming nature of the microscopic examination and by the limited availability of expertise in this field. Molecular and immunological methods are also being studied. We describe the application of computational pattern recognition methods to the automated identification and size analysis of scallop larvae. For identification, the shape features used are binary invariant moments; that is, the features are invariant to shift (position within the image), scale (induced either by growth or differential image magnification) and rotation. Images of a sample of scallop and non-scallop larvae covering a range of maturities have been analysed. In order to overcome the automatic identification, as well as to allow the system to receive new unknown samples at any moment, a self-organized and unsupervised ant-like clustering algorithm based on Swarm Intelligence is proposed, followed by simple k-NNR nearest neighbour classification on the final map. Results achieve a full recognition rate of 100% under several situations (k =1 or 3).
(to obtain the respective PDF file follow link above or visit chemoton.org)
[] Vitorino Ramos, Filipe Almeida, Artificial Ant Colonies in Digital Image Habitats – A Mass Behaviour Effect Study on Pattern Recognition, Proceedings of ANTS´2000 – 2nd International Workshop on Ant Algorithms (From Ant Colonies to Artificial Ants), Marco Dorigo, Martin Middendorf & Thomas Stüzle (Eds.), pp. 113-116, Brussels, Belgium, 7-9 Sep. 2000.
Figure - Transition behaviour of one Artificial Ant Colony in presence of a sudden change in his artificial digital image Habitat, between two different Digital Grey Images. Created with an Artificial Ant Colony, that uses images as Habitats, being sensible to their gray levels. At the second row, "Kafka" image is replaced as a substrate, by "Red Ant". In black, the higher levels of pheromone (a chemical evaporative sugar substance used by swarms on their orientation trought out the trails). It’s exactly this artificial evaporation and the computational ant collective group sinergy realocating their upgrades of pheromone at interesting places, that allows for the emergence of adaptation and "perception" of new images. Only some of the 6000 iterations processed are represented. The system does not have any type of hierarchy, and ants communicate only in indirect forms, through out the sucessive alteration that they found on the Habitat.
Some recent studies have pointed that, the self-organization of neurons into brain-like structures, and the self-organization of ants into a swarm are similar in many respects. If possible to implement, these features could lead to important developments in pattern recognition systems, where perceptive capabilities can emerge and evolve from the interaction of many simple local rules. The principle of the method is inspired by the work of Chialvo and Millonas who developed the first numerical simulation in which swarm cognitive map formation could be explained. From this point, an extended model is presented in order to deal with digital image habitats, in which artificial ants could be able to react to the environment and perceive it. Evolution of pheromone fields point that artificial ant colonies could react and adapt appropriately to any type of digital habitat.
(to obtain the respective PDF file follow link above or visit chemoton.org)
Chemoton § Vitorino Ramos' research notebook 
Recent Comments