[opensuse] Local Update Server Works Great!
Listmates, Over the past 2 weeks, I have be working to set up a local update repository that serves the 6 or so other boxes in the house. After having gone through the pases, I thought I would pass on the results -- It works great! The biggest benefit is that it eliminates all of the download time for updates, etc. I gave it a try tonight with: [04:26 nemesis/etc/zypp/repos.d] # zypper up -r 3111updt -t package Reading installed packages... The following packages are going to be upgraded: libwbclient0 libqt4-devel ghostscript-fonts-other libgomp43 libgcj_bc43 OpenOffice_org-calc perl-Event digikamimageplugins-superimpose libqt4-x11 libmpfr1 samba-client perl-XML-Parser gstreamer-0_10-lang gimp-plugins-python soprano libkdcraw3 libkexiv2-3 mysql-client libstrigi0 OpenOffice_org-impress libgcj43-jar libqt4 acroread spamassassin OpenOffice_org MyODBC-unixODBC digikam openal libkipi0 libgcj43-devel OpenOffice_org-filters mozilla-nss strigi-devel cifs-mount OpenOffice_org-writer bluez-utils strigi kdebase3-nsplugin libobjc43 clucene-core-devel libstdc++43-devel libqt4-devel-doc libgcc43 libsmbclient0 gimp-ufraw cpp43 gwenview mozilla-nspr OpenOffice_org-kde OpenOffice_org-base libsmbclient-devel ufraw perl-HTML-Parser gcc43 perl-Data-ShowTable xalan-j2 libqt4-devel-doc-data qt3-devel-doc inst-source-utils oxygen-icon-theme update-alternatives oxygen-icon-theme-scalable kdelibs3-devel-doc clucene-core OpenOffice_org-draw python-gobject2 libmysqlclient15 kipi-plugins libqt4-sql-sqlite gcc43-objc libqt4-sql libstdc++43 java-1_6_0-sun-plugin OpenOffice_org-mailmerge gstreamer-0_10-plugins-good digikamimageplugins libtalloc1 libadns1 libsoprano-devel libgstinterfaces-0_10-0 gstreamer-0_10-plugins-base-lang gstreamer-0_10-plugins-base libQtWebKit4 OpenOffice_org-pyuno keepassx libsoprano4 libmysqlclient_r15 libtdb1 ghostscript-library digikam-lang libgstreamer-0_10-0 php5-pear libgpod-tools libqt4-qt3support libqt4-sql-unixODBC samba gimp-lang gmp-devel java-1_6_0-sun ghostscript-fonts-std gcc43-c++ gimp kdiff3 gwenview-lang libgcj43 libgimpprint ghostscript-omni gcc43-info OpenOffice_org-icon-themes xerces-j2-xml-apis gimp-help xerces-j2 build libfaac0 libdvdcss faad2 libmpeg2-0 lame libmpeg2convert0 libdvdcss-devel libdca0 libmp4v2-0 libfaad0 liba52-0 libmp3lame0 faac transcode mysql perl-spamassassin python-sip fdupes gstreamer-0_10 jhead OpenOffice_org-math ghostscript-x11 gmp The following NEW packages are going to be installed: kipi-plugins-lang libgpod4 libtheoraenc1 libkdcraw3-lang OpenOffice_org-branding-upstream libtheoradec1 OpenOffice_org-l10n-en-US libkonq5 The following package is going to be REMOVED: libkonq4 The following packages are going to change vendor: libqt4-devel OpenOffice_org-calc libqt4-x11 perl-XML-Parser soprano libkdcraw3 libkexiv2-3 mysql-client libstrigi0 OpenOffice_org-impress libqt4 OpenOffice_org MyODBC-unixODBC libkipi0 OpenOffice_org-filters mozilla-nss strigi-devel OpenOffice_org-writer strigi kdebase3-nsplugin clucene-core-devel libqt4-devel-doc mozilla-nspr OpenOffice_org-kde OpenOffice_org-base perl-HTML-Parser perl-Data-ShowTable xalan-j2 libqt4-devel-doc-data inst-source-utils oxygen-icon-theme update-alternatives oxygen-icon-theme-scalable OpenOffice_org-draw python-gobject2 libmysqlclient15 libqt4-sql-sqlite libqt4-sql OpenOffice_org-mailmerge libsoprano-devel libQtWebKit4 OpenOffice_org-pyuno libsoprano4 libmysqlclient_r15 libqt4-qt3support libqt4-sql-unixODBC xerces-j2-xml-apis xerces-j2 build mysql fdupes jhead OpenOffice_org-math Overall download size: 489.5 M. After the operation, additional 123.1 M will be used. Continue? [YES/no]: yes And after hitting go, there was *zero* discernible download time, so the only time taken to update is just the time it takes to do the install. Bottom line, for me, it was well worth the time to set up. I am also working on a howto page that goes through the setup and then has the scripts need to maintain and update your local repository. I'll post that when it is done. **IN THE MEAN TIME IF YOU ARE THINKING ABOUT A LOCAL UPDATE REPO ** Go back and set the '-k' (--keeppackages) option on all the repos you want to save the rpms from so you can start building your local cache. Just use: zypper mr -k alias to start caching packages. You can also just edit the repo files in /etc/zypp/repos.d/ and set keeppackages=1 in the ones you want to cache packages for. -- David C. Rankin, J.D.,P.E. Rankin Law Firm, PLLC 510 Ochiltree Street Nacogdoches, Texas 75961 Telephone: (936) 715-9333 Facsimile: (936) 715-9339 www.rankinlawfirm.com -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thursday, 2009-04-02 at 05:30 -0500, David C. Rankin wrote:
Listmates,
Over the past 2 weeks, I have be working to set up a local update repository that serves the 6 or so other boxes in the house. After having gone through the pases, I thought I would pass on the results -- It works great! The biggest benefit is that it eliminates all of the download time for updates, etc. I gave it a try tonight with:
Interesting :-) ...
Bottom line, for me, it was well worth the time to set up. I am also working on a howto page that goes through the setup and then has the scripts need to maintain and update your local repository. I'll post that when it is done.
Yes, please :-)) - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (GNU/Linux) iEYEARECAAYFAknUsxcACgkQtTMYHG2NR9Xs2QCdEVTsvmDFxBi8jtQu39XAXSgp xk4AnRUmYoF9fUuyIOCz56O+DMSH0vYS =vrKk -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Carlos E. R. wrote:
On Thursday, 2009-04-02 at 05:30 -0500, David C. Rankin wrote:
Listmates,
Over the past 2 weeks, I have be working to set up a local update repository that serves the 6 or so other boxes in the house. After having gone through the pases, I thought I would pass on the results -- It works great! The biggest benefit is that it eliminates all of the download time for updates, etc. I gave it a try tonight with:
Interesting :-)
...
Bottom line, for me, it was well worth the time to set up. I am also working on a howto page that goes through the setup and then has the scripts need to maintain and update your local repository. I'll post that when it is done.
Yes, please :-))
-- Cheers, Carlos E. R.
OK -- Done, The full and hopefully complete write-up on how to build and administer you own local update repo. Let me know if you find any typo, error, or general screw-ups I need to fix. Thanks. http://www.3111skyline.com/linux/openSuSE-LocalUpdate.php -- David C. Rankin, J.D.,P.E. Rankin Law Firm, PLLC 510 Ochiltree Street Nacogdoches, Texas 75961 Telephone: (936) 715-9333 Facsimile: (936) 715-9339 www.rankinlawfirm.com -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
OK -- Done,
The full and hopefully complete write-up on how to build and administer you own local update repo. Let me know if you find any typo, error, or general screw-ups I need to fix. Thanks.
http://www.3111skyline.com/linux/openSuSE-LocalUpdate.php
-- David C. Rankin, J.D.,P.E.
David, That is really cool, but was there a reason you didn't do it on the opensuse wiki? A lot more people would find it there. Also seems like a great topic for the weekly opensuse newsletter. All they need is short blurb and a link I assume. Anyone associated with the newsletter reading this? Greg -- Greg Freemyer Head of EDD Tape Extraction and Processing team Litigation Triage Solutions Specialist http://www.linkedin.com/in/gregfreemyer First 99 Days Litigation White Paper - http://www.norcrossgroup.com/forms/whitepapers/99%20Days%20whitepaper.pdf The Norcross Group The Intersection of Evidence & Technology http://www.norcrossgroup.com -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Greg Freemyer wrote:
OK -- Done,
The full and hopefully complete write-up on how to build and administer you own local update repo. Let me know if you find any typo, error, or general screw-ups I need to fix. Thanks.
http://www.3111skyline.com/linux/openSuSE-LocalUpdate.php
-- David C. Rankin, J.D.,P.E.
David,
That is really cool, but was there a reason you didn't do it on the opensuse wiki?
A lot more people would find it there.
Also seems like a great topic for the weekly opensuse newsletter. All they need is short blurb and a link I assume. Anyone associated with the newsletter reading this?
Greg
Greg, Eventually, I'll move it over, but since I do all my development work on my laptop and it takes me 4 times longer than a normal person to dork with every little piece, edit the scripts, play with it some more, it is just a hell of a lot easier to do it locally and then move it over. Second reason, I don't speak wiki, and after all the trouble I had building the madwifi-rpms for 11.1 after the release, I just found it easier to do it locally and when I have something I like, then move it. I had another birthday yesterday and [[ ${old} == ${slow} ]] && echo "it just takes a while longer" ;-) -- David C. Rankin, J.D.,P.E. Rankin Law Firm, PLLC 510 Ochiltree Street Nacogdoches, Texas 75961 Telephone: (936) 715-9333 Facsimile: (936) 715-9339 www.rankinlawfirm.com -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
David C. Rankin wrote:
Listmates,
Over the past 2 weeks, I have be working to set up a local update repository that serves the 6 or so other boxes in the house. After having gone through the pases, I thought I would pass on the results -- It works great! The biggest benefit is that it eliminates all of the download time for updates, etc. I gave it a try tonight with:
[04:26 nemesis/etc/zypp/repos.d] # zypper up -r 3111updt -t package Reading installed packages...
The following packages are going to be upgraded: libwbclient0 libqt4-devel ghostscript-fonts-other libgomp43 libgcj_bc43 OpenOffice_org-calc perl-Event digikamimageplugins-superimpose libqt4-x11 libmpfr1 samba-client perl-XML-Parser gstreamer-0_10-lang gimp-plugins-python soprano libkdcraw3 libkexiv2-3 mysql-client libstrigi0 OpenOffice_org-impress libgcj43-jar libqt4 acroread spamassassin OpenOffice_org MyODBC-unixODBC digikam openal libkipi0 libgcj43-devel OpenOffice_org-filters mozilla-nss strigi-devel cifs-mount OpenOffice_org-writer bluez-utils strigi kdebase3-nsplugin libobjc43 clucene-core-devel libstdc++43-devel libqt4-devel-doc libgcc43 libsmbclient0 gimp-ufraw cpp43 gwenview mozilla-nspr OpenOffice_org-kde OpenOffice_org-base libsmbclient-devel ufraw perl-HTML-Parser gcc43 perl-Data-ShowTable xalan-j2 libqt4-devel-doc-data qt3-devel-doc inst-source-utils oxygen-icon-theme update-alternatives oxygen-icon-theme-scalable kdelibs3-devel-doc clucene-core OpenOffice_org-draw python-gobject2 libmysqlclient15 kipi-plugins libqt4-sql-sqlite gcc43-objc libqt4-sql libstdc++43 java-1_6_0-sun-plugin OpenOffice_org-mailmerge gstreamer-0_10-plugins-good digikamimageplugins libtalloc1 libadns1 libsoprano-devel libgstinterfaces-0_10-0 gstreamer-0_10-plugins-base-lang gstreamer-0_10-plugins-base libQtWebKit4 OpenOffice_org-pyuno keepassx libsoprano4 libmysqlclient_r15 libtdb1 ghostscript-library digikam-lang libgstreamer-0_10-0 php5-pear libgpod-tools libqt4-qt3support libqt4-sql-unixODBC samba gimp-lang gmp-devel java-1_6_0-sun ghostscript-fonts-std gcc43-c++ gimp kdiff3 gwenview-lang libgcj43 libgimpprint ghostscript-omni gcc43-info OpenOffice_org-icon-themes xerces-j2-xml-apis gimp-help xerces-j2 build libfaac0 libdvdcss faad2 libmpeg2-0 lame libmpeg2convert0 libdvdcss-devel libdca0 libmp4v2-0 libfaad0 liba52-0 libmp3lame0 faac transcode mysql perl-spamassassin python-sip fdupes gstreamer-0_10 jhead OpenOffice_org-math ghostscript-x11 gmp
The following NEW packages are going to be installed: kipi-plugins-lang libgpod4 libtheoraenc1 libkdcraw3-lang OpenOffice_org-branding-upstream libtheoradec1 OpenOffice_org-l10n-en-US libkonq5
The following package is going to be REMOVED: libkonq4
The following packages are going to change vendor: libqt4-devel OpenOffice_org-calc libqt4-x11 perl-XML-Parser soprano libkdcraw3 libkexiv2-3 mysql-client libstrigi0 OpenOffice_org-impress libqt4 OpenOffice_org MyODBC-unixODBC libkipi0 OpenOffice_org-filters mozilla-nss strigi-devel OpenOffice_org-writer strigi kdebase3-nsplugin clucene-core-devel libqt4-devel-doc mozilla-nspr OpenOffice_org-kde OpenOffice_org-base perl-HTML-Parser perl-Data-ShowTable xalan-j2 libqt4-devel-doc-data inst-source-utils oxygen-icon-theme update-alternatives oxygen-icon-theme-scalable OpenOffice_org-draw python-gobject2 libmysqlclient15 libqt4-sql-sqlite libqt4-sql OpenOffice_org-mailmerge libsoprano-devel libQtWebKit4 OpenOffice_org-pyuno libsoprano4 libmysqlclient_r15 libqt4-qt3support libqt4-sql-unixODBC xerces-j2-xml-apis xerces-j2 build mysql fdupes jhead OpenOffice_org-math
Overall download size: 489.5 M. After the operation, additional 123.1 M will be used. Continue? [YES/no]: yes
And after hitting go, there was *zero* discernible download time, so the only time taken to update is just the time it takes to do the install.
Bottom line, for me, it was well worth the time to set up. I am also working on a howto page that goes through the setup and then has the scripts need to maintain and update your local repository. I'll post that when it is done.
**IN THE MEAN TIME IF YOU ARE THINKING ABOUT A LOCAL UPDATE REPO **
Go back and set the '-k' (--keeppackages) option on all the repos you want to save the rpms from so you can start building your local cache. Just use:
zypper mr -k alias
If you want all repos, then zypper mr -k --all ;) (or my favority zypper mr -k --remote to cache only remote repositories, so don't cache e.g.DVD). JR
to start caching packages. You can also just edit the repo files in /etc/zypp/repos.d/ and set keeppackages=1 in the ones you want to cache packages for.
-- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thursday, 2009-04-02 at 14:50 +0200, Josef Reidinger wrote:
zypper mr -k alias
If you want all repos, then zypper mr -k --all ;) (or my favority zypper mr -k --remote to cache only remote repositories, so don't cache e.g.DVD).
I wonder if his local network repository could be defined as "local" for the purpose of that command :-? - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (GNU/Linux) iEYEARECAAYFAknUt+EACgkQtTMYHG2NR9Wo7wCfZwbLHSg+gtN2yspp1TFLqMVB FtcAn3MO9SXINCn2goIdc48lgUzXKY8N =RmIE -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Carlos E. R. wrote:
On Thursday, 2009-04-02 at 14:50 +0200, Josef Reidinger wrote:
zypper mr -k alias
If you want all repos, then zypper mr -k --all ;) (or my favority zypper mr -k --remote to cache only remote repositories, so don't cache e.g.DVD).
I wonder if his local network repository could be defined as "local" for the purpose of that command :-?
-- Cheers, Carlos E. R.
No, local network repository is recognized as remote (it depends on used protocol). JR -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 On Thursday, 2009-04-02 at 15:37 +0200, Josef Reidinger wrote:
zypper mr -k alias
If you want all repos, then zypper mr -k --all ;) (or my favority zypper mr -k --remote to cache only remote repositories, so don't cache e.g.DVD).
I wonder if his local network repository could be defined as "local" for the purpose of that command :-?
No, local network repository is recognized as remote (it depends on used protocol).
Then perhaps you have to think about an exception file ;-) - -- Cheers, Carlos E. R. -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.9 (GNU/Linux) iEYEARECAAYFAknUxL8ACgkQtTMYHG2NR9UPawCfVcEUNX+Sz2FlXudWvucTBzoL ci4AoIaOr8WY/1PRnCOmTvvqt79O7Fce =LAM4 -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Josef Reidinger wrote:
Carlos E. R. wrote:
On Thursday, 2009-04-02 at 14:50 +0200, Josef Reidinger wrote:
zypper mr -k alias If you want all repos, then zypper mr -k --all ;) (or my favority zypper mr -k --remote to cache only remote repositories, so don't cache e.g.DVD). I wonder if his local network repository could be defined as "local" for the purpose of that command :-?
-- Cheers, Carlos E. R.
No, local network repository is recognized as remote (it depends on used protocol). JR
Hey Josef, Maybe you can help with another problem with the local update setup. The only problem I have is that to access rpms on the local repository I have to use the '-t package' option even if the rpms were originally cached from the openSuSE Update server during an online update. It's really just more annoying than anything else. I would expect that doing a "zypper up -r localrepo" would return a list of updates that have not yet been applied to the client machine. Instead, you get the "Nothing to do" answer. If you use -t package against the local repo, then you get all the updates both from the online-update repo as well as all of the packages cached during a regular zypper up -t package update. Is there any designation of flag the online-update metadata has that I might be missing in creating the repo with 'createrepo -p -d openSUSE_11.0'? -- David C. Rankin, J.D.,P.E. Rankin Law Firm, PLLC 510 Ochiltree Street Nacogdoches, Texas 75961 Telephone: (936) 715-9333 Facsimile: (936) 715-9339 www.rankinlawfirm.com -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
-----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi David, David C. Rankin wrote:
Maybe you can help with another problem with the local update setup. The only problem I have is that to access rpms on the local repository I have to use the '-t package' option even if the rpms were originally cached from the openSuSE Update server during an online update.
It's really just more annoying than anything else. I would expect that doing a "zypper up -r localrepo" would return a list of updates that have not yet been applied to the client machine. Instead, you get the "Nothing to do" answer.
If you use -t package against the local repo, then you get all the updates both from the online-update repo as well as all of the packages cached during a regular zypper up -t package update.
Is there any designation of flag the online-update metadata has that I might be missing in creating the repo with 'createrepo -p -d openSUSE_11.0'?
What you get with createrepo from dirs with rpms is just plain packages. The update repositories contain also special metadata called 'Patches'. These live only in the metadata, that's why you don't get them with createrepo. There're located in <repository>/repodata/updateinfo.xml.gz in recent update repos (they used to be in /repodata/patches.xml + patch-*.xml files before 11.0). My guess is that copying these raw metadata to corresponding dir on the client machines will suffice, they contain all architectures the repo contains. HTH BTW (info for those on 11.1) on a 11.1+ system: zypper up == zypper up -t package zypper patch == zypper up -t patch - -- cheers, jano Ján Kupec YaST team - ---------------------------------------------------------(PGP)--- Key ID: 637EE901 Fingerprint: 93B9 C79B 2D20 51C3 800B E09B 8048 46A6 637E E901 - ---------------------------------------------------------(IRC)--- Server: irc.freenode.net Nick: jniq Channels: #zypp #yast #suse #susecz - ---------------------------------------------------------(EOF)--- -----BEGIN PGP SIGNATURE----- Version: GnuPG v2.0.11 (GNU/Linux) Comment: Using GnuPG with SUSE - http://enigmail.mozdev.org iEYEARECAAYFAknWC0sACgkQgEhGpmN+6QF6bwCff1Q/cuCgvR5y9mxawElpygfH LCYAnim6SMqEpIG872K2/KIQuEUMm/n8 =VRQF -----END PGP SIGNATURE----- -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
Jan Kupec wrote:
Hi David,
David C. Rankin wrote:
Maybe you can help with another problem with the local update setup. The only problem I have is that to access rpms on the local repository I have to use the '-t package' option even if the rpms were originally cached from the openSuSE Update server during an online update.
It's really just more annoying than anything else. I would expect that doing a "zypper up -r localrepo" would return a list of updates that have not yet been applied to the client machine. Instead, you get the "Nothing to do" answer.
If you use -t package against the local repo, then you get all the updates both from the online-update repo as well as all of the packages cached during a regular zypper up -t package update.
Is there any designation of flag the online-update metadata has that I might be missing in creating the repo with 'createrepo -p -d openSUSE_11.0'?
What you get with createrepo from dirs with rpms is just plain packages. The update repositories contain also special metadata called 'Patches'. These live only in the metadata, that's why you don't get them with createrepo. There're located in <repository>/repodata/updateinfo.xml.gz in recent update repos (they used to be in /repodata/patches.xml + patch-*.xml files before 11.0).
My guess is that copying these raw metadata to corresponding dir on the client machines will suffice, they contain all architectures the repo contains.
HTH
BTW (info for those on 11.1) on a 11.1+ system: zypper up == zypper up -t package zypper patch == zypper up -t patch
Thank you Jan, I'll give it a go and report back. I'm all about this local repo stuff, case in point: [06:40 alchemy:/media] # zypper in -r 3111updt qdvdauthor-templates Reading installed packages... The following NEW package is going to be installed: qdvdauthor-templates Overall download size: 78.9 M. After the operation, additional 96.2 M will be used. Continue? [YES/no]: yes Downloading package qdvdauthor-templates-1.0.0-1.pm.0.noarch (1/1), 78.9 M (96.2 M unpacked) Downloading: qdvdauthor-templates-1.0.0-1.pm.0.noarch.rpm [done (2.9 M/s)] ^^^^^^^^^^^^^^^^^^ What was a 10 *minute* download the first time, turned into a 30 second download the second time (and that's over wireless). I bet I can cut it down to a 9 second download over CAT5 ;-) -- David C. Rankin, J.D.,P.E. Rankin Law Firm, PLLC 510 Ochiltree Street Nacogdoches, Texas 75961 Telephone: (936) 715-9333 Facsimile: (936) 715-9339 www.rankinlawfirm.com -- To unsubscribe, e-mail: opensuse+unsubscribe@opensuse.org For additional commands, e-mail: opensuse+help@opensuse.org
participants (5)
-
Carlos E. R. -
David C. Rankin -
Greg Freemyer -
Jan Kupec -
Josef Reidinger