#activation-function

Complex Log-Mean-Exp Networks

1. Core definition A complex log-mean-exp unit (LME unit) is defined as $$y = \frac{1}{\beta}\,\log\Big(\widetilde{\sum_{i=1}^n w_i \exp (\beta \, x_i)} \Big)$$where \(x_i \in \mathbb{C}\) are the complex inputs. \(y\) is the unit’s output. \(w_i ...