[yast-devel] YaST svn migrated to git
Hi YaST hackers, the YaST svn migrated to git - finally! After about 24 hours the conversion was completed. All 147 YasT modules are now uploaded to github.com. If you do not yet have a login on github.com, go and create one. The YaST modules are grouped in the yast organization: https://github.com/yast As the libYUI was extracted from the YaST code base we put them into its own organization to underline its independence: https://github.com/libyui We also got our first forks while I was still uploading the repos. This shows the collaborative strength of git hosted projects. To make your initial clones a little easier there is a small tool called 'y2m' in this repo. https://github.com/yast/yast-meta If just follow the installation instructions in the README this tool helps you to clone or checkout all (or just some) YaST modules. Please feel free to adapt and improve this tool (grep for TODO) or write a better one. I just wanted to give those guys who are used to svn a small tool to help them getting started. Just one module did not make it in the conversion: yast-qt-pkg I will reenable write access to it in svn. Thus it will be migrated later. Please note the 'Conventions' for naming branches and tags for released products: http://en.opensuse.org/openSUSE:YaST_SVN_to_GIT For any questions related this to this switch contact us on our mailing lists: http://en.opensuse.org/Portal:YaST or chat with us in the #yast channel on irc.freenode.org Ciao, Daniel -- J. Daniel Schmidt <jdsn@suse.de> SUSE LINUX Products GmbH Research & Development Maxfeldstr. 5 HRB 16746 (AG Nürnberg) D-90409 Nürnberg GF: Jeff Hawn, Jennifer Guild, Felix Imendörffer -- To unsubscribe, e-mail: yast-devel+unsubscribe@opensuse.org To contact the owner, e-mail: yast-devel+owner@opensuse.org
On 05/18/2012 09:41 PM, J. Daniel Schmidt wrote:
the YaST svn migrated to git - finally!
The YaST modules are grouped in the yast organization: https://github.com/yast
We also got our first forks while I was still uploading the repos. This shows the collaborative strength of git hosted projects.
Congrats on completing the move! Cheers, James T. -- To unsubscribe, e-mail: yast-devel+unsubscribe@opensuse.org To contact the owner, e-mail: yast-devel+owner@opensuse.org
On Friday 18 May 2012 21:41:12 J. Daniel Schmidt wrote:
Just one module did not make it in the conversion: yast-qt-pkg I will reenable write access to it in svn. Thus it will be migrated later.
Please don't let it wither in svn indefinitely.
Please note the 'Conventions' for naming branches and tags for released products: http://en.opensuse.org/openSUSE:YaST_SVN_to_GIT
For any questions related this to this switch contact us on our mailing lists: http://en.opensuse.org/Portal:YaST or chat with us in the #yast channel on irc.freenode.org
Don't forget to update http://en.opensuse.org/openSUSE:YaST_development and other wiki pages with this information. Could you also update the openSUSE community about the successful move directly? I saw Lukas' blogpost last week but a mail like this one to opensuse-project@ would be productive. Will -- Will Stephenson, openSUSE Board, Booster, KDE Developer SUSE LINUX GmbH, GF: Jeff Hawn, Jennifer Guild, Felix Imendörffer, HRB 21284 (AG Nürnberg) Maxfeldstraße 5 90409 Nürnberg Germany -- To unsubscribe, e-mail: yast-devel+unsubscribe@opensuse.org To contact the owner, e-mail: yast-devel+owner@opensuse.org
On Mon May 21 2012 12:30:46 Will Stephenson wrote:
On Friday 18 May 2012 21:41:12 J. Daniel Schmidt wrote:
Just one module did not make it in the conversion: yast-qt-pkg I will reenable write access to it in svn. Thus it will be migrated later.
Please don't let it wither in svn indefinitely.
Please note the 'Conventions' for naming branches and tags for released
products: http://en.opensuse.org/openSUSE:YaST_SVN_to_GIT
For any questions related this to this switch contact us on our mailing lists: http://en.opensuse.org/Portal:YaST or chat with us in the #yast channel on irc.freenode.org
Don't forget to update http://en.opensuse.org/openSUSE:YaST_development and other wiki pages with this information. I updated that page.
Could you also update the openSUSE community about the successful move directly? I saw Lukas' blogpost last week but a mail like this one to opensuse-project@ would be productive.
Will
-- Thomas Goettlicher SUSE LINUX Products GmbH, GF: Jeff Hawn, Jennifer Guild, Felix Imendörffer, HRB 16746 (AG Nürnberg) Maxfeldstraße 5 90409 Nürnberg Germany
On 05/18/2012 09:41 PM, J. Daniel Schmidt wrote:
Hi YaST hackers,
the YaST svn migrated to git - finally!
After about 24 hours the conversion was completed. All 147 YasT modules are now uploaded to github.com. If you do not yet have a login on github.com, go and create one.
Thanks a lot guys for all the effort and sleepless nights ;) Bye Lukas -- Lukas Ocilka, Appliances Department SUSE LINUX s.r.o., Praha -- To unsubscribe, e-mail: yast-devel+unsubscribe@opensuse.org To contact the owner, e-mail: yast-devel+owner@opensuse.org
On Friday 18 May 2012 21:41:12 J. Daniel Schmidt wrote:
the YaST svn migrated to git - finally!
The YaST modules are grouped in the yast organization: https://github.com/yast
Some people asked me about automatically converting the svnignore properties into .gitignore files. In general: It is possible to automate this - yes - it requires some work though. The result would be just a copy of the svnignores. Anyhow I would recommend that every maintainer reviews the ignore settings of his module and creates the .gitignore himself. The benefits: - You get used to git(ignore) - You learn that it only requires one ".gitignore" file on the top level instead of setting it for every single directory - Your can review the ignores and clean them up. Maybe we even can summarize them and create yast.gitignore and add it to: https://github.com/github/gitignore The attached script does the initial conversion for you - just review the output, clean it up and save the result in .gitignore. Pass the URL as parameter: svnignore2gitignore.pl You can do it manually with this command: svn propget -R svn:ignore http://svn.opensuse.org/svn/yast/trunk/$MODULE Just adapt the URL for branches if needed. Ciao, Daniel -- J. Daniel Schmidt <jdsn@suse.de> SUSE LINUX Products GmbH Research & Development Maxfeldstr. 5 HRB 16746 (AG Nürnberg) D-90409 Nürnberg GF: Jeff Hawn, Jennifer Guild, Felix Imendörffer
On Monday 21 May 2012 13:46:36 J. Daniel Schmidt wrote:
The attached script does the initial conversion for you - just review the output, clean it up and save the result in .gitignore. Pass the URL as parameter: svnignore2gitignore.pl
Call it like this: svnignore2gitignore.pl http://svn.opensuse.org/svn/yast/trunk/registration/ Ciao, Daniel -- J. Daniel Schmidt <jdsn@suse.de> SUSE LINUX Products GmbH Research & Development Maxfeldstr. 5 HRB 16746 (AG Nürnberg) D-90409 Nürnberg GF: Jeff Hawn, Jennifer Guild, Felix Imendörffer -- To unsubscribe, e-mail: yast-devel+unsubscribe@opensuse.org To contact the owner, e-mail: yast-devel+owner@opensuse.org
Hi, big thanks to Daniel and Bernhard for the migration! BUT we are not done yet. As I tried to build a yast2-core update for SLE11 SP2 today, I found the build tests failing. First it was a simple case of svn:executable not having been migrated for some(!) files, but then I found that the history of some files is not complete: http://svn.opensuse.org/viewvc/yast/branches/SuSE-Code-11-SP2-Branch/core/li... https://github.com/yast/yast-core/commits/Code-11-SP2/libycp/testsuite/tests... The currently published result is unfortunately BROKEN. I don't know the extent of that now. It looks like it will be useful to run more tests on the result of an improved migration. -- Martin Vidner, YaST developer http://en.opensuse.org/User:Mvidner Kuracke oddeleni v restauraci je jako fekalni oddeleni v bazenu
On Wed, May 23, 2012 at 06:26:47PM +0200, Martin Vidner wrote:
Hi,
big thanks to Daniel and Bernhard for the migration!
BUT we are not done yet.
As I tried to build a yast2-core update for SLE11 SP2 today, I found the build tests failing. First it was a simple case of svn:executable not having been migrated for some(!) files, but then I found that the history of some files is not complete:
http://svn.opensuse.org/viewvc/yast/branches/SuSE-Code-11-SP2-Branch/core/li... https://github.com/yast/yast-core/commits/Code-11-SP2/libycp/testsuite/tests...
The currently published result is unfortunately BROKEN. I don't know the extent of that now.
It looks like it will be useful to run more tests on the result of an improved migration.
I am running(*) a comparison now, https://github.com/mvidner/yast2git/blob/master/yast-svn-git-diff-all (and other yast-svn-git-diff* files) and from the first dozen of repos it looks like many repos are affected, either by 1) missing executable bits, or 2) failing to record that a file became empty. *) If you want to run that script, it will be useful to have a local copy of the SVN repo. You may want to run this overnight to get it: https://github.com/mvidner/yast-svn2git/blob/satsolver/yast-svnsync -- Martin Vidner, YaST developer http://en.opensuse.org/User:Mvidner Kuracke oddeleni v restauraci je jako fekalni oddeleni v bazenu
On Thu, May 24, 2012 at 06:15:00PM +0200, Martin Vidner wrote:
I am running(*) a comparison now, https://github.com/mvidner/yast2git/blob/master/yast-svn-git-diff-all (and other yast-svn-git-diff* files)
Results at https://github.com/mvidner/yast2git/tree/9e75e5c419dd07db46b070ba6dd50cdc117... (some diffs are empty which is not visible on the github web listing) -- Martin Vidner, YaST developer http://en.opensuse.org/User:Mvidner Kuracke oddeleni v restauraci je jako fekalni oddeleni v bazenu
Hello! Can someone run such a comparison for libyui-*, please ? BR, Björn 2012/5/24 Martin Vidner <mvidner@suse.cz>:
On Thu, May 24, 2012 at 06:15:00PM +0200, Martin Vidner wrote:
I am running(*) a comparison now, https://github.com/mvidner/yast2git/blob/master/yast-svn-git-diff-all (and other yast-svn-git-diff* files)
Results at https://github.com/mvidner/yast2git/tree/9e75e5c419dd07db46b070ba6dd50cdc117... (some diffs are empty which is not visible on the github web listing) -- Martin Vidner, YaST developer http://en.opensuse.org/User:Mvidner
Kuracke oddeleni v restauraci je jako fekalni oddeleni v bazenu -- To unsubscribe, e-mail: yast-devel+unsubscribe@opensuse.org To contact the owner, e-mail: yast-devel+owner@opensuse.org
On Thu, May 24, 2012 at 07:55:22PM +0200, Björn Esser wrote:
Hello!
Can someone run such a comparison for libyui-*, please ?
Done, https://github.com/mvidner/yast2git/tree/libyui/yast-svn-git-diff-results-li... It *looks* like there are only a couple missing executable bits which shouldn't be there in the first place. -- Martin Vidner, YaST developer http://en.opensuse.org/User:Mvidner Kuracke oddeleni v restauraci je jako fekalni oddeleni v bazenu
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On 05/24/2012 07:15 PM, Martin Vidner wrote:
On Thu, May 24, 2012 at 06:15:00PM +0200, Martin Vidner wrote:
I am running(*) a comparison now, https://github.com/mvidner/yast2git/blob/master/yast-svn-git-diff-all
(and other yast-svn-git-diff* files)
Results at https://github.com/mvidner/yast2git/tree/9e75e5c419dd07db46b070ba6dd50cdc117...
(some diffs are empty which is not visible on the github web
listing)
I made a small reproducer for the non-truncating of files bug in svndumpfilter3 and CCed the svndumpfilter3-Author. #!/bin/sh R=/tmp/REPO svnadmin create $R svn co file://$R cd REPO echo test > testfile svn add testfile svn commit -m "add" echo -n > testfile svn commit -m "empty" echo -e '#!/bin/sh\necho OK' > script.sh chmod a+x script.sh svn add script.sh svn commit -m "add script" svnadmin dump $R > ~/test.dump MODULE=x svndumpfilter3 ".*" < ~/test.dump > /dev/shm/test2.dump diff -u ~/test.dump /dev/shm/test2.dump which should make fixing the svndumpfilter3 a lot easier than using a 4GB dump that takes hours to filter. The executable bit issues might be a bit more tricky. I had noticed before, that output differed in that regard depending on which pathes were specified as interesting, so it might be something in the untangle operation. Ciao Bernhard M. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk+/bqYACgkQSTYLOx37oWQi3QCfaTVqUJ03o/32wtr1bFPU0XVe 4IsAn31+7t1TeJq49tA6GWGLbDUVoYGz =DNFF -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: yast-devel+unsubscribe@opensuse.org To contact the owner, e-mail: yast-devel+owner@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Am 25.05.2012 13:36, schrieb Bernhard M. Wiedemann:
On 05/24/2012 07:15 PM, Martin Vidner wrote: [...] The executable bit issues might be a bit more tricky. I had noticed before, that output differed in that regard depending on which pathes were specified as interesting, so it might be something in the untangle operation.
turns out the executable bit issues were documented as a known bug on the svndumpfilter3 web page and had a very similar cause to the non-trucating of files (treating a missing entry and a zero-length entry the same). I enhanced my test script and made changes to fix both. Not sure if they break something else though: https://github.com/bmwiedemann/svndumpfilter3/tree/zerofilefix please review/test/comment/merge Ciao Bernhard M. - -- (o_ //\ V_/_ http://www.suse.de/ SUSE LINUX Products GmbH, GF: Jeff Hawn, Jennifer Guild, Felix Imendörffer, HRB 16746 (AG Nürnberg) -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.18 (GNU/Linux) Comment: Using GnuPG with Mozilla - http://enigmail.mozdev.org/ iEYEARECAAYFAk/DXlcACgkQSTYLOx37oWTI5gCgt7ClMDQkmNyzBWxbhXsfXbhQ KqoAnjS4I+djoOuJ+MiaOVV3UYhAY8wi =dk64 -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: yast-devel+unsubscribe@opensuse.org To contact the owner, e-mail: yast-devel+owner@opensuse.org
Hi, I have been working on putting the correctly migrated yast repos in place, but I am slower than I expected. If you're interested in the work in progress, see here: https://github.com/mvidner/recover-broken-git -- Martin Vidner, YaST developer http://en.opensuse.org/User:Mvidner Kuracke oddeleni v restauraci je jako fekalni oddeleni v bazenu
On 05/24/2012 07:15 PM, Martin Vidner wrote:
On Thu, May 24, 2012 at 06:15:00PM +0200, Martin Vidner wrote:
I am running(*) a comparison now, https://github.com/mvidner/yast2git/blob/master/yast-svn-git-diff-all (and other yast-svn-git-diff* files)
Results at https://github.com/mvidner/yast2git/tree/9e75e5c419dd07db46b070ba6dd50cdc117... (some diffs are empty which is not visible on the github web listing)
I did a search on my server and found that there are at most 75 modules (of 154 total) with deviations in history. $ echo `find -name \*.pack -mtime +9 -mtime -15 |sort| cut -d/ -f2` yast-apparmor.git yast-autofs.git yast-autoinstallation.git yast-backup.git yast-bootloader.git yast-ca-management.git yast-cd-creator.git yast-cluster.git yast-control-center-gnome.git yast-core.git yast-country.git yast-dbus-server.git yast-devtools.git yast-dhcp-server.git yast-dns-server.git yast-doc.git yast-drbd.git yast-firewall.git yast-firstboot.git yast-gtk.git yast-hpc.git yast-http-server.git yast-inetd.git yast-installation.git yast-instserver.git yast-ipsec.git yast-kdump.git yast-kerberos-server.git yast-ldap-server.git yast-live-installer.git yast-mail.git yast-mail-server.git yast-metapackage.git yast-multipath.git yast-mysql-server.git yast-ncurses.git yast-ncurses-pkg.git yast-network.git yast-nfs-client.git yast-nfs-server.git yast-nis-client.git yast-nis-server.git yast-ntp-client.git yast-ntsutils.git yast-online-update-configuration.git yast-packagemanager.git yast-packager.git yast-pam.git yast-perl-bindings.git yast-printer.git yast-product-creator.git yast-qt.git yast-registration.git yast-repair.git yast-restore.git yast-ruby-bindings.git yast-runlevel.git yast-samba-client.git yast-scanner.git yast-schema.git yast-slide-show.git yast-sound.git yast-storage.git yast-sudo.git yast-support.git yast-sysconfig.git yast-testsuite.git yast-theme.git yast-tv.git yast-uml.git yast-update.git yast-users.git yast-x11.git yast-y2pmsh.git yast-yast2.git other modules like slp still have a .pack file with the identical sha1-sum which replaced the old one. Ciao Bernhard M. -- To unsubscribe, e-mail: yast-devel+unsubscribe@opensuse.org To contact the owner, e-mail: yast-devel+owner@opensuse.org
participants (8)
-
Bernhard M. Wiedemann -
Björn Esser -
J. Daniel Schmidt -
James Tan -
Lukas Ocilka -
Martin Vidner -
Thomas Goettlicher -
Will Stephenson