Brain Inspired Cortical Coding Method for Fast Clustering and Codebook Generation


Creative Commons License

Yücel M., Bagis S., SERTBAŞ A., Sarikaya M., Üstündağ B. B.

ENTROPY, vol.24, no.11, 2022 (SCI-Expanded) identifier identifier

  • Publication Type: Article / Article
  • Volume: 24 Issue: 11
  • Publication Date: 2022
  • Doi Number: 10.3390/e24111678
  • Journal Name: ENTROPY
  • Journal Indexes: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, Aerospace Database, Communication Abstracts, INSPEC, Metadex, zbMATH, Directory of Open Access Journals, Civil Engineering Abstracts
  • Keywords: clustering, codebook generation, cortical coding model, distortion, entropy maximization, execution time, feature extraction, machine learning, real-time execution, vector quantization, VECTOR QUANTIZATION, WAVELET, COMPRESSION, NEURONS, CELLS
  • Istanbul Technical University Affiliated: Yes

Abstract

A major archetype of artificial intelligence is developing algorithms facilitating temporal efficiency and accuracy while boosting the generalization performance. Even with the latest developments in machine learning, a key limitation has been the inefficient feature extraction from the initial data, which is essential in performance optimization. Here, we introduce a feature extraction method inspired by energy-entropy relations of sensory cortical networks in the brain. Dubbed the brain-inspired cortex, the algorithm provides convergence to orthogonal features from streaming signals with superior computational efficiency while processing data in a compressed form. We demonstrate the performance of the new algorithm using artificially created complex data by comparing it with the commonly used traditional clustering algorithms, such as Birch, GMM, and K-means. While the data processing time is significantly reduced-seconds versus hours-encoding distortions remain essentially the same in the new algorithm, providing a basis for better generalization. Although we show herein the superior performance of the cortical coding model in clustering and vector quantization, it also provides potent implementation opportunities for machine learning fundamental components, such as reasoning, anomaly detection and classification in large scope applications, e.g., finance, cybersecurity, and healthcare.