[opensuse-factory] creating a better Factory
Hi there is this problem, that Factory is sometimes broken but it would be nice if people had a safer way to test new software even between milestone-releases (which are manual factory-snaphots). via https://fedoraproject.org/wiki/QA/Tools I found something I wanted to have for openSUSE, too: https://fedoraproject.org/wiki/Israwhidebroken.com_Proposal I did s/rawhide/Factory/ s/chewtoy/Factory-tested/ and seeded this onto http://en.opensuse.org/openSUSE:Factory-tested_Proposal It is about creating a snapshot of Factory whenever it passes all basic automated tests (aka critical path) - preferably with minimal human intervention (aka hard work) needed. I have much of the automated testing done, so what is missing is a way to trigger+do the snapshotting. Ciao Bernhard M. -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
Am Dienstag 16 November 2010 schrieb Bernhard M. Wiedemann:
Hi
there is this problem, that Factory is sometimes broken but it would be nice if people had a safer way to test new software even between milestone-releases (which are manual factory-snaphots).
via https://fedoraproject.org/wiki/QA/Tools I found something I wanted to have for openSUSE, too: https://fedoraproject.org/wiki/Israwhidebroken.com_Proposal
I did s/rawhide/Factory/ s/chewtoy/Factory-tested/ and seeded this onto http://en.opensuse.org/openSUSE:Factory-tested_Proposal
It is about creating a snapshot of Factory whenever it passes all basic automated tests (aka critical path) - preferably with minimal human intervention (aka hard work) needed. I have much of the automated testing done, so what is missing is a way to trigger+do the snapshotting.
I can poll a file on openqa.opensuse.org and do a factory-tested snapshot when it contains the content of /factory/repo/oss/media.1/build - this is really peanuts. What's not peanuts: this is several GB more to host and mirror. Not a big problem on our own hosts, but for wider use you may want to convince mirror admins to mirror it too. But that might come from itself when it's a good solution. Greetings, Stephan -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
On Tue, 16 Nov 2010 17:31:48 +0100 Stephan Kulow <coolo@novell.com> wrote:
I can poll a file on openqa.opensuse.org and do a factory-tested snapshot when it contains the content of /factory/repo/oss/media.1/build - this is really peanuts.
What's not peanuts: this is several GB more to host and mirror. Not a big
Actually if this is a previously already mirrored out release, this can be done with hardlinking the current state into the snapshot release. Even if is is not 100% the same as the already mirrored state, this would still cut most of the bandwidth. rsync can also handle hardlinks, so the mirroring should not be that big of a problem. Of course, over time, when the unstable repo gets changed, on-disk space requirements will rise as the hardlinks will get broken. I'm not sure if the bandwidth or the disk space is the problem, though. -- Stefan Seyfried "Any ideas, John?" "Well, surrounding them's out." -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
Am 16.11.2010 22:53, schrieb Stefan Seyfried:
On Tue, 16 Nov 2010 17:31:48 +0100 Stephan Kulow<coolo@novell.com> wrote:
I can poll a file on openqa.opensuse.org and do a factory-tested snapshot when it contains the content of /factory/repo/oss/media.1/build - this is really peanuts.
What's not peanuts: this is several GB more to host and mirror. Not a big
Actually if this is a previously already mirrored out release, this can be done with hardlinking the current state into the snapshot release. Even if is is not 100% the same as the already mirrored state, this would still cut most of the bandwidth.
rsync can also handle hardlinks, so the mirroring should not be that big of a problem.
Of course, over time, when the unstable repo gets changed, on-disk space requirements will rise as the hardlinks will get broken.
I'm not sure if the bandwidth or the disk space is the problem, though.
Factory repos are 14GB total (if you do not count the project+user repos which are not even snapshotted for milestones) and isos use another 3-4GB (not counting 8.5GB of DVDs). Storing 18 GB would not be a problem with disk-space on my server. But bandwidth might be, with enough users. I could dedicate 3 TB/month of bandwidth to this project, which should suffice for a few hundred users - depending on how much Factory gets rebuilt and how much they update. As coolo said, when bandwidth really becomes a problem, this means that this thing is useful which should make it easier to find more mirrors - e.g. those who already find mirroring factory useful. Ciao Bernhard M. -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
Thanks to coolo this extra repo now went online. See http://lizards.opensuse.org/2010/11/29/announcing-factory-tested/ More big thanks go to javier and AJ for their awesome help with the above announcement. The plan now is to see, how many users who are currently using Factory or Milestones are interested in using the factory-tested repo instead. And once there is a significant number, mirror-admins will be contacted. Also, if you find issues that could block a big number of Factory-users but are not covered by my basic install+zypper+X11 tests, please tell me so that I could include it. There is certainly some trade-off to be made with regards to frequency of updates versus guaranteed level of quality. Ciao Bernhard M. -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
Am Montag, 29. November 2010, 21:41:51 schrieb Bernhard M. Wiedemann:
Thanks to coolo this extra repo now went online. See http://lizards.opensuse.org/2010/11/29/announcing-factory-tested/
More big thanks go to javier and AJ for their awesome help with the above announcement.
The plan now is to see, how many users who are currently using Factory or Milestones are interested in using the factory-tested repo instead. And once there is a significant number, mirror-admins will be contacted.
Also, if you find issues that could block a big number of Factory-users but are not covered by my basic install+zypper+X11 tests, please tell me so that I could include it. There is certainly some trade-off to be made with regards to frequency of updates versus guaranteed level of quality.
Ciao Bernhard M.
A test for cable connected lan would be nice as this will allow most of the factory users to troubleshoot any problems on the affected machine and do proper bugreports. A working default browser would be nice as well for the task but as we have multiple alternatives I guess most will be able to find a working one thanks to the available network connection. Regards, Karsten -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
Am 30.11.2010 01:38, schrieb Karsten König:
Am Montag, 29. November 2010, 21:41:51 schrieb Bernhard M. Wiedemann:Thanks to coolo this extra repo now went online. See
Also, if you find issues that could block a big number of Factory-users but are not covered by my basic install+zypper+X11 tests, please tell me so that I could include it. There is certainly some trade-off to be made with regards to frequency of updates versus guaranteed level of quality.
Ciao Bernhard M.
A test for cable connected lan would be nice as this will allow most of the factory users to troubleshoot any problems on the affected machine and do proper bugreports. A working default browser would be nice as well for the task but as we have multiple alternatives I guess most will be able to find a working one thanks to the available network connection.
Regards, Karsten
Hi Karsten, thanks for your feedback. The zypper test already fetches rpms from a network repo, so if that was found working, it shows that DHCP via classic ifup works, too. Static network-configuration itself is rarely problematic, so there are only NetworkManager and hardware-specific drivers left untested that could cause problems - hopefully only for a small portion of users. I just wonder if there is already a troubleshooting guide to help factory-users get back into an updateable state. Maybe a bit like http://en.opensuse.org/openSUSE:Most_annoying_bugs_11.4_dev - just for recent factory issues. Ciao Bernhard M. -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
On Mon, Nov 29, 2010 at 09:41:51PM +0100, Bernhard M. Wiedemann wrote:
Thanks to coolo this extra repo now went online. See http://lizards.opensuse.org/2010/11/29/announcing-factory-tested/
More big thanks go to javier and AJ for their awesome help with the above announcement.
Very cool, nice job.
The plan now is to see, how many users who are currently using Factory or Milestones are interested in using the factory-tested repo instead. And once there is a significant number, mirror-admins will be contacted.
How will you determine this? Do we have statistics for repo usages anywhere? thanks, greg k-h -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
Am Dienstag 30 November 2010 schrieb Greg KH:
On Mon, Nov 29, 2010 at 09:41:51PM +0100, Bernhard M. Wiedemann wrote:
Thanks to coolo this extra repo now went online. See http://lizards.opensuse.org/2010/11/29/announcing-factory-tested/
More big thanks go to javier and AJ for their awesome help with the above announcement.
Very cool, nice job.
The plan now is to see, how many users who are currently using Factory or Milestones are interested in using the factory-tested repo instead. And once there is a significant number, mirror-admins will be contacted.
How will you determine this? Do we have statistics for repo usages anywhere?
We grep the log files for random days. Greetings, Stephan -- To unsubscribe, e-mail: opensuse-factory+unsubscribe@opensuse.org For additional commands, e-mail: opensuse-factory+help@opensuse.org
participants (5)
-
Bernhard M. Wiedemann -
Greg KH -
Karsten König -
Stefan Seyfried -
Stephan Kulow