Would using this neural network based on integer addition be faster? The paper does not claim it would be faster, so I'm assuming not?

What about over time? If this L-Mul (the matrix operation based on integer addition) operation proved to be much more energy efficient and became popular, would new hardware be created that was faster?