IEEE Transactions on Information Theory

ReLU networks can represent max function with fewer layers

Researchers have demonstrated that the maximum of n real numbers can be precisely represented by a ReLU network with two hidden layers for any n up to 10. This is achieved by translating the problem into exact rational …