Title:Geometry and Topology of Conceptual Representations of Simple Visual
Data
Volume: 3
Issue: 2
Author(s): Serge Dolgikh*
Affiliation:
- Department of Information Technology, National Aviation University, Kyiv, 03058, Ukraine
Keywords:
Unsupervised learning, representation learning, concept learning, artificial intelligence, clustering, sensory data.
Abstract:
Introduction: Representations play an essential role in learning artificial and biological
systems by producing informative structures associated with characteristic patterns in the sensory
environment. In this work, we examined unsupervised latent representations of images of basic geometric
shapes with neural network models of unsupervised generative self-learning.
Background: Unsupervised concept learning with generative neural network models.
Objective: Investigation of structure, geometry and topology in the latent representations of generative
models that emerge as a result of unsupervised self-learning with minimization of generative
error. Examine the capacity of generative models to abstract and generalize essential data characteristics,
including the type of shape, size, contrast, position and orientation.
Methods: Generative neural network models, direct visualization, density clustering, and probing
and scanning of latent positions and regions.
Results: Structural consistency of latent representations; geometrical and topological characteristics
of latent representations examined and analysed with unsupervised methods. Development and verification
of methods of unsupervised analysis of latent representations.
Conclusion: Generative models can be instrumental in producing informative compact representations
of complex sensory data correlated with characteristic patterns.
