MiBench benchsuite : Cross-compilation & results

The MiBench bench suite is open source, allowing us to provide the patches allowing to sucessfully cross-compile the benchmarks for some big-endian target architecture like the PowerPC ones.

Please refer to the MiBench website for details on the benchsuite.

Repository path

The patched MiBench source files are available in the UNISIM repository at the following address:

https://unisim.org/svn/public/components/CycleLevel/simulators/benchmarks/src/mibench/

Tested simulators

ppc-score: A Single core in-order PowerPC405, detailed on the ppc-score page.
ppc-sscore: An out-of order simulator based on the PowerPC ISA, which only a first prototype is available.
arm-score: A Single core in-order ARM v5te, detailed on the arm-score page.

Legend

N : Native compilation & execution
CC : Cross Compilation
E : Emulation (Instruction Set Simulation with ppcemu)
S : Cycle-level Simulation (with ppc-score/ppc)
EO : Emulation output matching native output
SO : Simulation output matching emulation output

Note that matching can be relative, a binary dump of a 4-bvte word to a file does not provide the same output for a little and a big endian machine.

automotive

basicmath

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405 small	ok	ppcemu	2s		ppc-score	1:52:38s	1 705 482 730
PPC750 small		ppcemu			ooosim
Arm9 small		armemu			arm-score

bitcount

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405 small	ok	ppcemu	2s		ppc-score	2:33s	38 767 968
PPC405 large	ok	ppcemu	31s		ppc-score
PPC750 small		ppcemu			ooosim
Arm9 small		armemu			arm-score

susan_s

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405 small	ok	ppcemu	45s		ppc-score	45:24s	645 068 163
PPC750 small		ppcemu			ooosim
Arm9 small		armemu			arm-score

susan_e

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405 small	ok	ppcemu	1s		ppc-score	35s	8 395 902
PPC750 small		ppcemu			ooosim
Arm9 small		armemu			arm-score

susan_c

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405 small	ok	ppcemu	1s		ppc-score	20s	4 893 274
PPC750 small		ppcemu			ooosim
Arm9 small		armemu			arm-score

qort

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405 small	ok	ppcemu	5s		ppc-score	6:11s	80 778 776
PPC405 large	ok	ppcemu	2:31s		ppc-score	2:35:54s	2 190 319 522
PPC750 small		ppcemu			ooosim
Arm9 small		armemu			arm-score

network

dijkstra

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405 small	ok	ppcemu	4s		ppc-score	6:30s	947 788 716
PPC405 large	ok	ppcemu	19s		ppc-score
PPC750 small		ppcemu			ooosim
Arm9 small		armemu			arm-score

patricia

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405 small	ok	ppcemu	10s		ppc-score	19:57s	289 010 528
PPC750 small		ppcemu			ooosim
Arm9 small		armemu			arm-score

security

blowfish

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405 small	ok	ppcemu	24s		ppc-score	17:36s	252 729 845
PPC750 small		ppcemu			ooosim
Arm9 small		armemu			arm-score

pgp

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405 small	ok	ppcemu	6s		ppc-score	7:43s	110 042 442
PPC750 small		ppcemu			ooosim
Arm9 small		armemu			arm-score

rijndael

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405 small	ok	ppcemu	3s		ppc-score	5:06s	71 465 582
PPC405 large	ok	ppcemu	37s		ppc-score	51:23s	719 402 462
PPC750 small		ppcemu			ooosim
Arm9 small		armemu			arm-score

sha

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405 small	ok	ppcemu	2s		ppc-score	3:07s	44 510 969
PPC750 small		ppcemu			ooosim
Arm9 small		armemu			arm-score

consumer

jpeg

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405	ok	ppcemu	4s		ppc-score	5:32s	78 645 032
PPC750		ppcemu			ooosim
Arm9		armemu			arm-score

mad

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405	ok	ppcemu	7s		ppc-score	10:40s	149 780 108
PPC750		ppcemu			ooosim
Arm9		armemu			arm-score

lame

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405	ok	ppcemu	13:45s		ppc-score	15:26:10s	13 827 523 916
PPC750		ppcemu			ooosim
Arm9		armemu			arm-score

typeset

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405	ok	ppcemu	12s		ppc-score	10:10s	142 626 756	empty output file
PPC750		ppcemu			ooosim
Arm9		armemu			arm-score

tiff2bw

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405	ok	ppcemu	7s		ppc-score	10:34s	156 147 454
PPC750		ppcemu			ooosim
Arm9		armemu			arm-score

tiff2rgba

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405	ok	ppcemu	7s		ppc-score	8:35s	117 137 951
PPC750		ppcemu			ooosim
Arm9		armemu			arm-score

tiffdither

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405	ok	ppcemu	51s		ppc-score	1:04:47s	898 759 239
PPC750		ppcemu			ooosim
Arm9		armemu			arm-score

tiffmedian

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405	ok	ppcemu	32s		ppc-score	41:39s	585 594 562
PPC750		ppcemu			ooosim
Arm9		armemu			arm-score

telecom

adpcm

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405	ok	ppcemu	2s		ppc-score	2:27s	44 540 744
PPC750		ppcemu			ooosim
Arm9		armemu			arm-score

crc32

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405	ok	ppcemu	16:34s		ppc-score	11:15:55s	9 399 368 318
PPC750		ppcemu			ooosim
Arm9		armemu			arm-score

fft

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405	ok	ppcemu	45s		ppc-score	46:51s	685 881 889
PPC750		ppcemu			ooosim
Arm9		armemu			arm-score

gsm

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405	ok	ppcemu	1.51s		ppc-score	stime	scycle	so
PPC750		ppcemu			ooosim
Arm9		armemu			arm-score

office

ghosstscript

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405	ok	ppcemu	1:34s		ppc-score	1:55:41s	1656564684
PPC750		ppcemu			ooosim
Arm9		armemu			arm-score

ispell

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405	ok	ppcemu	2s		ppc-score	2:04s	29 935 489
PPC750		ppcemu			ooosim
Arm9		armemu			arm-score

rsynth

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405	ok	ppcemu	2:57s		ppc-score	3:32:20s	3 092 052 946
PPC750		ppcemu			ooosim
Arm9		armemu			arm-score

sphinx

Authors does not provide patches anymore to compile sphinx on modern compilers.

stringsearch

		Emulation			Simulation
	CC	Prog	Time	Output	Prog	Time	Cycles	Output
PPC405	ok	ppcemu	0s		ppc-score	2s	379 951
PPC750		ppcemu			ooosim
Arm9		armemu			arm-score