undocumented features - more mips

> Recent Entries
> Archive
> Friends
> User Info
> devspace

March 4th, 2008


09:37 am - more mips
(still sick. well, i drove half an hour to work only to have them send me home so at least i tried.)

A little experiment I did that I thought some might find interesting:

mneme # for pkg in kdeaddons kdeadmin kdeartwork kdebase kdeedu kdegames kdegraphics kdelibs
kdemultimedia kdenetwork kdepim kdetoys kdeutils kdewebdev; do genlop -t $pkg; done

 * kde-base/kdeaddons

     Mon Feb 25 08:40:58 2008 >>> kde-base/kdeaddons-3.5.9
       merge time: 1 hour, 53 minutes and 37 seconds.

 * kde-base/kdeadmin

     Mon Feb 25 21:43:33 2008 >>> kde-base/kdeadmin-3.5.9
       merge time: 22 minutes and 53 seconds.

 * kde-base/kdeartwork

     Mon Feb 25 18:58:53 2008 >>> kde-base/kdeartwork-3.5.9
       merge time: 48 minutes and 56 seconds.

 * kde-base/kdebase

     Sun Feb 24 02:54:47 2008 >>> kde-base/kdebase-3.5.9
       merge time: 9 hours, 42 minutes and 47 seconds.

     Tue Mar  4 07:41:34 2008 >>> kde-base/kdebase-3.5.9
       merge time: 10 hours, 2 minutes and 26 seconds.

 * kde-base/kdeedu

     Tue Feb 26 09:29:29 2008 >>> kde-base/kdeedu-3.5.9
       merge time: 1 hour, 57 minutes and 1 second.

 * kde-base/kdegames

     Sun Feb 24 12:05:12 2008 >>> kde-base/kdegames-3.5.9
       merge time: 1 hour, 20 minutes and 59 seconds.

 * kde-base/kdegraphics

     Tue Feb 26 03:50:28 2008 >>> kde-base/kdegraphics-3.5.9
       merge time: 3 hours, 14 minutes and 17 seconds.

 * kde-base/kdelibs

     Sat Feb 23 06:36:54 2008 >>> kde-base/kdelibs-3.5.9
       merge time: 6 hours, 44 minutes and 9 seconds.

 * kde-base/kdemultimedia

     Sat Feb 23 11:26:45 2008 >>> kde-base/kdemultimedia-3.5.9
       merge time: 1 hour, 32 minutes and 1 second.

 * kde-base/kdenetwork

     Sun Feb 24 19:36:26 2008 >>> kde-base/kdenetwork-3.5.9
       merge time: 5 hours, 29 minutes and 6 seconds.

 * kde-base/kdepim

     Mon Feb 25 06:47:20 2008 >>> kde-base/kdepim-3.5.9
       merge time: 10 hours, 30 minutes and 5 seconds.

 * kde-base/kdetoys

     Tue Feb 26 09:57:10 2008 >>> kde-base/kdetoys-3.5.9
       merge time: 27 minutes and 41 seconds.

 * kde-base/kdeutils

     Mon Feb 25 20:59:09 2008 >>> kde-base/kdeutils-3.5.9
       merge time: 1 hour, 45 minutes and 32 seconds.

 * kde-base/kdewebdev

     Tue Feb 26 11:38:25 2008 >>> kde-base/kdewebdev-3.5.9
       merge time: 1 hour, 41 minutes and 15 seconds.



this is on a distcc cluster comprised of 2 additional dual-core processors (-j8), but a lot of the time they're not being used - the O2 can't preprocess fast enough to keep them occupied. ccache should help the second time around, but it looks like that wasn't the case for kdebase. still, i am hitting the cache a lot. i might need to bump the size a GiB or two.

cache directory                     /var/cache/ccache
cache hit                          25701
cache miss                         71263
called for link                     7158
multiple source files                 24
compile failed                      2092
preprocessor error                  1024
bad compiler arguments                 2
not a C/C++ file                    1991
autoconf compile/link              17169
unsupported compiler option         1391
no input file                       6007
files in cache                    142526
cache size                           1.2 Gbytes
max cache size                       1.5 Gbytes



a lot time is spent in configure, generating Makefiles, eautoreconf (usually takes 15-30 min (!)), linking, anything that can't be distributed. ebuilds that force -j1 are going to make me sad.


PS - don't mistake this for complaining. I do this cause I like it. ;) I'm just surprised at what we can take for granted.
Tags:

(Leave a comment)

Comments:


[User Picture]
From:[info]foozini
Date:March 4th, 2008 05:29 pm (UTC)
(Link)
So I was curious about this and just how it would compare to the Fulong. Here are my results:

kiona ~ # for pkg in kdeaddons kdeadmin kdeartwork kdebase kdeedu kdegames kdegraphics kdelibs kdemultimedia kdenetwork kdepim kdetoys kdeutils kdewebdev; do genlop -t $pkg; done
* kde-base/kdeaddons

Sat Jan 12 13:12:16 2008 >>> kde-base/kdeaddons-3.5.8
merge time: 55 minutes and 54 seconds.

* kde-base/kdeadmin

Sat Jan 12 01:31:28 2008 >>> kde-base/kdeadmin-3.5.8
merge time: 18 minutes and 51 seconds.

* kde-base/kdeartwork

Fri Jan 11 15:24:05 2008 >>> kde-base/kdeartwork-3.5.8
merge time: 22 minutes and 38 seconds.

* kde-base/kdebase

Fri Jan 11 01:36:48 2008 >>> kde-base/kdebase-3.5.8-r5
merge time: 4 hours, 59 minutes and 46 seconds.

Sat Mar 1 17:54:52 2008 >>> kde-base/kdebase-3.5.8-r6
merge time: 4 hours, 59 minutes and 12 seconds.

* kde-base/kdeedu

Sat Jan 12 01:12:37 2008 >>> kde-base/kdeedu-3.5.8
merge time: 1 hour, 52 minutes and 53 seconds.

* kde-base/kdegames

Fri Jan 11 14:37:26 2008 >>> kde-base/kdegames-3.5.8
merge time: 1 hour and 55 seconds.

* kde-base/kdegraphics

Sat Jan 12 04:00:52 2008 >>> kde-base/kdegraphics-3.5.8-r2
merge time: 2 hours, 29 minutes and 24 seconds.

* kde-base/kdelibs

Mon Jan 7 21:44:56 2008 >>> kde-base/kdelibs-3.5.8-r2
merge time: 3 hours, 56 minutes and 15 seconds.

Tue Jan 15 12:47:09 2008 >>> kde-base/kdelibs-3.5.8-r2
merge time: 4 hours, 22 minutes and 31 seconds.

Fri Feb 22 14:16:42 2008 >>> kde-base/kdelibs-3.5.8-r3
merge time: 4 hours, 17 minutes and 16 seconds.

Sat Mar 1 04:58:21 2008 >>> kde-base/kdelibs-3.5.8-r3
merge time: 4 hours, 17 minutes and 41 seconds.

* kde-base/kdemultimedia

Sat Jan 12 05:28:55 2008 >>> kde-base/kdemultimedia-3.5.8-r1
merge time: 48 minutes and 45 seconds.

* kde-base/kdenetwork

Fri Jan 11 23:19:43 2008 >>> kde-base/kdenetwork-3.5.8
merge time: 3 hours, 25 minutes and 1 second.

* kde-base/kdepim

Sat Jan 12 12:16:22 2008 >>> kde-base/kdepim-3.5.8
merge time: 5 hours, 51 minutes and 46 seconds.

* kde-base/kdetoys

Tue Jan 8 02:13:33 2008 >>> kde-base/kdetoys-3.5.8
merge time: 13 minutes and 19 seconds.

* kde-base/kdeutils

Fri Jan 11 18:14:59 2008 >>> kde-base/kdeutils-3.5.8-r1
merge time: 1 hour, 7 minutes and 58 seconds.

* kde-base/kdewebdev

Thu Jan 10 18:10:38 2008 >>> kde-base/kdewebdev-3.5.8
merge time: 1 hour, 28 minutes and 11 seconds.

[User Picture]
From:[info]psykil
Date:March 4th, 2008 07:04 pm (UTC)
(Link)
update

actually, looking at it closer it seems like some packages like kdebase and kdelibs aren't being distributed at all, hence the huge compile times.

:/

> Go to Top
LiveJournal.com