Feature changed by: Adrian Schröter (adrianSuSE) Feature #324909, revision 2 Title: speed up staging setup and rebuild Buildservice: New Priority Requester: Important Requested by: Ludwig Nussel (lnussel) Partner organization: openSUSE.org Description: Staging projects have to rebuild quite often which takes a lot of time and resources. Maybe OBS could speed that up by taking some shortcuts. Some ideas by an unqualified external: * using ccache to speed up rebuilds without source changes. Could be implemented by project or project group for example. * have some cloning feature that also copies binaries and does not lead to immediate rebuild. That would allow to setup a new staging or rebase one in no time by cloing all packages including their binaries from rings. + Discussion: + #1: Adrian Schröter (adriansuse) (2018-06-07 07:31:12Z) + Just some first comments regarding ccache: + * We have already ccache support in build script, but we don't transfer + files between builds + * transfering ccache files between builds means we need more disk space + and network IO. Esp. disk space is very limited atm in openSUSE. -- openSUSE Feature: https://features.opensuse.org/324909

Feature changed by: Adrian Schröter (adrianSuSE) Feature #324909, revision 4 Title: speed up staging setup and rebuild Buildservice: New Priority Requester: Important Requested by: Ludwig Nussel (lnussel) Partner organization: openSUSE.org Description: Staging projects have to rebuild quite often which takes a lot of time and resources. Maybe OBS could speed that up by taking some shortcuts. Some ideas by an unqualified external: * using ccache to speed up rebuilds without source changes. Could be implemented by project or project group for example. * have some cloning feature that also copies binaries and does not lead to immediate rebuild. That would allow to setup a new staging or rebase one in no time by cloing all packages including their binaries from rings. Discussion: #1: Adrian Schröter (adriansuse) (2018-06-07 07:31:12Z) Just some first comments regarding ccache: * We have already ccache support in build script, but we don't transfer files between builds * transfering ccache files between builds means we need more disk space and network IO. Esp. disk space is very limited atm in openSUSE. #2: Adrian Schröter (adriansuse) (2018-06-07 07:32:22Z) What makes staging projects special here btw? Or is this just a generic way to speed up builds? + #3: Adrian Schröter (adriansuse) (2018-06-07 07:34:00Z) + Do we have some measurements that ccache would actually help here? A + build should be only be scheduled if some dependency has changed, so + could the cache be used at all? -- openSUSE Feature: https://features.opensuse.org/324909

Feature changed by: Ludwig Nussel (lnussel) Feature #324909, revision 6 Title: speed up staging setup and rebuild Buildservice: New Priority Requester: Important Requested by: Ludwig Nussel (lnussel) Partner organization: openSUSE.org Description: Staging projects have to rebuild quite often which takes a lot of time and resources. Maybe OBS could speed that up by taking some shortcuts. Some ideas by an unqualified external: * using ccache to speed up rebuilds without source changes. Could be implemented by project or project group for example. * have some cloning feature that also copies binaries and does not lead to immediate rebuild. That would allow to setup a new staging or rebase one in no time by cloing all packages including their binaries from rings. Discussion: #1: Adrian Schröter (adriansuse) (2018-06-07 07:31:12Z) Just some first comments regarding ccache: * We have already ccache support in build script, but we don't transfer files between builds * transfering ccache files between builds means we need more disk space and network IO. Esp. disk space is very limited atm in openSUSE. #2: Adrian Schröter (adriansuse) (2018-06-07 07:32:22Z) What makes staging projects special here btw? Or is this just a generic way to speed up builds? #3: Adrian Schröter (adriansuse) (2018-06-07 07:34:00Z) Do we have some measurements that ccache would actually help here? A build should be only be scheduled if some dependency has changed, so could the cache be used at all? #4: Adrian Schröter (adriansuse) (2019-03-08 08:41:11Z) We keep discussing here, but this request is not concrete enough for me to transfer it to jira atm. + #5: Ludwig Nussel (lnussel) (2019-08-15 08:02:31Z) + There's even a user who wrote code to share the ccache cache: + https://github.com/openSUSE/obs-build/pull/396 -- openSUSE Feature: https://features.opensuse.org/324909