Archive for March, 2010

Fedora Activity Day Niederrhein 2010

Wednesday, March 31st, 2010

Last weekend I attended at the Fedora Activity Day Niederrhein 2010. It was my first FAD and very interesting. I got to know the 6 other Fedora Users here in my federal state ;-) and I believe there were around 12 FOSS users around. On the first day we had a little gpg keysigning party using gpg-key2ps fingerprint stripes. It went pretty well after we got a printer working so everyone else could print his gpg fingerprints cut them using the scissors I brought (Uh, I believe I also forgot to take the scissors home). I also answered some questions about gpg. But I was not sure which gpg keyserver to recommend, since subkeys.pgp.net is not as reliable as it was some years ago. But I know now a better one, it is x-hkp://pool.sks-keyservers.net. I did not expect that much interest in gpg, since there was only one attendee listed on the wiki page, but then everyone took part.

The remaining time, I finally got to review the package submission from the first Fedora packager candidate I was going to sponsor, answered some generic FOSS questions / helped with removing the NVIDIA binary driver from a fresh installation and started to take a deeper look at the package status scripts. Most of the information did not look that interesting to me and since perl scripts seemed to be involved, I started writing/gathering some code to identify EOL packages in CVS, koji and PKGDB. I got it working, but it seems that the only way to do this for PKGDB is to query all packages instead of making it return such a list. The next step is to compare these lists to find packages, that are not marked as EOL in three databases. Another data source is the wiki, where another list needs to be compared. This is then going to be my first new status report script.

I believe the next Fedora meeting in my area will be at  FrOSCon 2010 near Bonn, Germany. I hope I will be able to attend there, as well.

fedora updates need more systematic testing

Wednesday, March 10th, 2010

There is a lot of discussion ongoing about how to change Fedora updates and several proposals for an update policy float around. But after I read parts of the FESCo log for the meeting last night, where an updates policy was discussed, I came to another conclusion. Fedora needs more systematic testing. There is a proposal to require at least three positive testing comments in Bodhi (aka 3 karma points) to allow testing updates to become stable. But afaics nobody prepared some statistics about what this would have meant for the previous updates, i.e. how many updates would have been pushed in the past from testint to stable with this policy enabled.

And this leads to a big problem, there is no real knowledge available how well Fedora updates are covered by testing. Looking at the Bodhi metrics, it seems that there is not that much testing going on for testing updates in F11, because the top testers seemed not to improve recently, but the top testers in F12 have already provided more feedback. But even with these comments, there is no way to properly detect how well the testing of a package is covered, e.g. there was an update that was clearly broken that still got positive karma by people who thought using it in a dependent package, but this was not true. I do not want to blame them, because the non-existent dependency was not obvious, but this shows why systematic testing is important. This does not meant that everything has to be tested perfectly, but it should be at least known how well updates are tested to know how to improve it.

My opinion on requiring karma for updates is, that before this is done, it should be made sure that there are enough people willing to test the updates or a automated package behaviour testing should be implemented. E.g. for every package for that a certain karma amount is required, at least one dedicated tester and several occasional testers should sign up. And the required number of the testers should reflect the number of karma points required for an update. If people want better updates in stable, they should imho contribute to testing them, even if they only spend one hour every month on it.