After talking to a few debian developers (all ppc and sparc), they seem to believe that letting the OSS lib handle the LE -> BE conversion is fine. Seems there are special commands for that and everything that the architecture code knows about.