Manifold regularized extreme learning machine

Liu, Bing; Xia, Shi-Xiong; Meng, Fan-Rong; Zhou, Yong
February 2016
Neural Computing & Applications;Feb2016, Vol. 27 Issue 2, p255
Academic Journal
Extreme learning machine (ELM) works for generalized single-hidden-layer feedforward networks (SLFNs), and its essence is that the hidden layer of SLFNs need not be tuned. But ELM only utilizes labeled data to carry out the supervised learning task. In order to exploit unlabeled data in the ELM model, we first extend the manifold regularization (MR) framework and then demonstrate the relation between the extended MR framework and ELM. Finally, a manifold regularized extreme learning machine is derived from the proposed framework, which maintains the properties of ELM and can be applicable to large-scale learning problems. Experimental results show that the proposed semi-supervised extreme learning machine is the most cost-efficient method. It tends to have better scalability and achieve satisfactory generalization performance at a relatively faster learning speed than traditional semi-supervised learning algorithms.


Related Articles

  • A Novel Multiple Instance Learning Method Based on Extreme Learning Machine. Wang, Jie; Cai, Liangjian; Peng, Jinzhu; Jia, Yuheng // Computational Intelligence & Neuroscience;2/3/2015, Vol. 2015, p1 

    Since real-world data sets usually contain large instances, it is meaningful to develop efficient and effective multiple instance learning (MIL) algorithm. As a learning paradigm, MIL is different from traditional supervised learning that handles the classification of bags comprising unlabeled...

  • Relationship between phase and amplitude generalization errors in complex- and real-valued feedforward neural networks. Hirose, Akira; Yoshida, Shotaro // Neural Computing & Applications;Jun2013, Vol. 22 Issue 7/8, p1357 

    We compare the generalization characteristics of complex-valued and real-valued feedforward neural networks. We assume a task of function approximation with phase shift and/or amplitude change in signals having various coherence. Experiments demonstrate that complex-valued neural networks show...

  • Feature extraction for improved disruption prediction analysis at JET. Rattá, G. A.; Vega, J.; Murari, A.; Johnson, M.; JET-EFDA Contributors // Review of Scientific Instruments;Oct2008, Vol. 79 Issue 10, p10F328 

    Disruptions are major instabilities and remain one of the main problems in tokomaks. Using Joint European Torus database, a disruption predictor is developed by computational methods including supervised learning techniques. The main objectives of the work are to develop accurate automatic...

  • Bayesian Co-Training. Shipeng Yu; Krishnapuram, Balaji; Rosales, Rómer; Rao, R. Bharat // Journal of Machine Learning Research;Sep2012, Vol. 13 Issue 9, p2649 

    Co-training (or more generally, co-regularization) has been a popular algorithm for semi-supervised learning in data with two feature representations (or views), but the fundamental assumptions underlying this type of models are still unclear. In this paper we propose a Bayesian undirected...

  • OPTIMIZING UNSUPERVISED LEARNING OF OPINION TARGETS FROM UNSTRUCTURED REVIEW SUSINGG WORDNET BASED SEMANTIC ORIENTATION. Khan, Khairullah; Khan, Aurangzeb; Baharudin, Baharum Bin; Ashrafullah // Science International;Apr-Jun2014, Vol. 26 Issue 2, p865 

    Opinion Target identification is an important task of opinion mining problem. Several approaches have been employed for this task which can be broadly divided into two major categories: supervised and unsupervised: The supervised approaches requite training data which need m annual work and are...

  • Research Overview of Manifold Learning Algorithm. Wei Zhan; Guangming Dai; Hanmin Liu // Advances in Information Sciences & Service Sciences;Jan2013, Vol. 5 Issue 1, p58 

    Manifold learning is one kind of unsupervised learning algorithm, its aim is mining lowdimensional smooth manifold which embeds in high-dimensional data space. In this paper, after discussing on emerging of manifold learning algorithm and its research status in detail, research direction of...

  • Manifold Regularization and Semi-supervised Learning: Some Theoretical Analyses. Niyogi, Partha // Journal of Machine Learning Research;May2013, Vol. 14 Issue 5, p1229 

    Manifold regularization (Belkin et al., 2006) is a geometrically motivated framework for machine learning within which several semi-supervised algorithms have been constructed. Here we try to provide some theoretical understanding of this approach. Our main result is to expose the natural...

  • NEURAL NETWORK-BASED ENGLISH ALPHANUMERIC CHARACTER RECOGNITION. Kader, Md Fazlul; Deb, Kaushik // International Journal of Computer Science, Engineering & Applica;Aug2012, Vol. 2 Issue 4, p1 

    Propose a neural-network based size and color invariant character recognition system using feed-forward neural network. Our feed-forward network has two layers. One is input layer and another is output layer. The whole recognition process is divided into four basic steps such as pre-processing,...

  • Network Video Online Semi-supervised Classification Algorithm Based on Multiple View Co-training. Nanbin Zhang; Xiaoping Liu // Journal of Multimedia;Jun2013, Vol. 8 Issue 3, p206 

    As information integration based on multiple modal has to problems like complexity calculation process and low classification accuracy towards network video classification algorithm, came up with a network video online semi-supervised classification algorithm based on multiple view co-training....


Read the Article


Sorry, but this item is not currently available from your library.

Try another library?
Sign out of this library

Other Topics