We prove a negative result for the approximation of functions defined on compact subsets of R^d (where d ≥2) using single layer feedforward neural networks with arbitrary continuous activation function. In a nutshell, this result claims the existence of target functions which are as difficult to approximate using these neural networks as one may want. We also demonstrate an analogous result (for general d ∈N) for neural networks with an arbitrary number of layers, for activation functions which are either rational functions, or continuous splines with finitely many pieces.
updated: Thu Jan 16 2020 19:37:20 GMT+0000 (UTC)
published: Tue Oct 23 2018 18:15:50 GMT+0000 (UTC)