Edge-coherent mode (ECM) is one of the most promising modes in the tokamak fusion experiment, such as the Experimental Advanced Superconducting Tokamak (EAST). This paper presents an efficient convolution neural network model called NoiseNet for ECM recognition from the cross-power spectral data. NoiseNet suppresses the overfitting by applying noise in both the horizontal and vertical directions to the output of each layer of the convolution. And the improvement of the receptive field enables the convolution layer to better learn the difference between the ECM and the turbulence in the data. Experiments show that NoiseNet has better performance in ECM recognition with fewer parameters, and thus improved efficiency, than other major models, such as AlexNet, ResNet, and DenseNet. NoiseNet achieves a test accuracy of 93.94% on the ECM data sets. In addition, compared with the traditional method, this method does not depend on the empirical threshold and its generalization ability will improve with the increase in the amount of data.