This reverts commit a5f4e22289229a5f6b7341d17c45db98be84d479.
Breaks the stdenv build, e.g.: http://hydra.nixos.org/build/50015717
In general, the architectures are different enough that there is no
reason to consider both as ARM, just like we don't consider x86_64 as
32-bit x86.
cc @fpletz