[opensuse-project] download.opensuse.org mirrorbrain IPv6 improvements
Hi everybody, I'd like to let you know that Marcus Rueckert aka darix and myself have been investing some time in the last couple days in an attempt to get download.opensuse.org handle IPv6 traffic a bit smarter. It has been a long-standing issue that users connecting using IPv6 could not be assigned to any geographical location, resulting in mirrorbrain redirecting them all around the world. After a couple of nicely spent evening analyzing/confirming the various geoip databases in use, Apache's way of dealing with it and bridging this all together, today we seem to have reached what was believed to be impossible: download.opensuse.org knows in what country I am when connecting using an IPv6 address Now, I myself am a very small subset of our total userbase out there, and as such this test is of course of limited value - yet, it is a step forward. I'd like you to keep an eye out for potential changed / regressed behaviors when working with download.opensuse.org during the next few days/weeks and report anything inexplicable. We are aware that we're not at the full level of IPv6 support that we would like to reach: unlike on IPv4, we cannot yet do AS and Prefix based matching of mirrors. Thank you for your attention - and happy downloading Dominique
On vendredi, 17 février 2017 23.46:05 h CET Dominique Leuenberger / DimStar wrote:
Hi everybody,
I'd like to let you know that Marcus Rueckert aka darix and myself have been investing some time in the last couple days in an attempt to get download.opensuse.org handle IPv6 traffic a bit smarter.
It has been a long-standing issue that users connecting using IPv6 could not be assigned to any geographical location, resulting in mirrorbrain redirecting them all around the world.
After a couple of nicely spent evening analyzing/confirming the various geoip databases in use, Apache's way of dealing with it and bridging this all together, today we seem to have reached what was believed to be impossible:
download.opensuse.org knows in what country I am when connecting using an IPv6 address
Now, I myself am a very small subset of our total userbase out there, and as such this test is of course of limited value - yet, it is a step forward.
I'd like you to keep an eye out for potential changed / regressed behaviors when working with download.opensuse.org during the next few days/weeks and report anything inexplicable.
We are aware that we're not at the full level of IPv6 support that we would like to reach: unlike on IPv4, we cannot yet do AS and Prefix based matching of mirrors.
Thank you for your attention - and happy downloading Dominique
Tested from the 3 locations I mainly used and it works \<o>/ Thanks a lot. Now it means less download from south-america, when I need a European mirror. -- Bruno Friedmann Ioda-Net Sàrl www.ioda-net.ch Bareos Partner, openSUSE Member, fsfe fellowship GPG KEY : D5C9B751C4653227 irc: tigerfoot -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org To contact the owner, email: opensuse-project+owner@opensuse.org
Dominique Leuenberger / DimStar wrote:
I'd like you to keep an eye out for potential changed / regressed behaviors when working with download.opensuse.org during the next few days/weeks and report anything inexplicable.
Thanks for addressing this issue, good stuff! With a few attempts just now, I was directed to the following sites: 1) ftp.gwdg.de 2) mirror.23media.de 3) opensuse.mirrors.ovh.net 4) mirror1.hs-esslingen.de (no IPv6) 5) anorien.csc.warwick.ac.uk 6) ftp.linux.cz 7) www.mirrorservice.org 8) mirror.library.ucy.ac.cy (no IPv6) 9) fr2.rpmfind.net (no IPv6) 10) mirror.euserv.net 11) ftp.uni-bayreuth.de (no ipv6) 12) mirrors.se.eu.kernel.org 13) files.opensuse-education.org (no ipv6) 14) mirror.rackspace.co.uk (no ipv6) 15) mirror.onet.pl (no ipv6) 16) opensuse.mirrors.proxad.net This is somewhat better than previously, at least they're European mirrors, but there isn't one single Swiss mirror listed? Looking at the mirror list, the geolocation works: List of best mirrors for IP address 2a03:7520:4c68:1:21d:92ff:fe39:a132, located in Switzerland (CH). Still, not one Swiss mirror is listed. I would have expected at least http://mirror.switch.ch/.
We are aware that we're not at the full level of IPv6 support that we would like to reach: unlike on IPv4, we cannot yet do AS and Prefix based matching of mirrors.
Does that explain the above? What about the redirects to mirrors with no IPv6? -- Per Jessen, Zürich (4.4°C) http://www.hostsuisse.com/ - virtual servers, made in Switzerland. -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org To contact the owner, email: opensuse-project+owner@opensuse.org
On Sat, 2017-02-18 at 20:01 +0100, Per Jessen wrote:
With a few attempts just now, I was directed to the following sites:
1) ftp.gwdg.de 2) mirror.23media.de 3) opensuse.mirrors.ovh.net 4) mirror1.hs-esslingen.de (no IPv6) 5) anorien.csc.warwick.ac.uk 6) ftp.linux.cz 7) www.mirrorservice.org 8) mirror.library.ucy.ac.cy (no IPv6) 9) fr2.rpmfind.net (no IPv6) 10) mirror.euserv.net 11) ftp.uni-bayreuth.de (no ipv6) 12) mirrors.se.eu.kernel.org 13) files.opensuse-education.org (no ipv6) 14) mirror.rackspace.co.uk (no ipv6) 15) mirror.onet.pl (no ipv6) 16) opensuse.mirrors.proxad.net
This is somewhat better than previously, at least they're European mirrors, but there isn't one single Swiss mirror listed? Looking at the mirror list, the geolocation works:
List of best mirrors for IP address 2a03:7520:4c68:1:21d:92ff:fe39:a132, located in Switzerland (CH).
I don't think we have currently any Swiss mirrors for Tumblewed; Switch only hosts the released distributions. Cheers Dominqiue
On Sat, 2017-02-18 at 20:01 +0100, Per Jessen wrote:
We are aware that we're not at the full level of IPv6 support that
we would like to reach: unlike on IPv4, we cannot yet do AS and Prefix based matching of mirrors.
Does that explain the above? What about the redirects to mirrors with no IPv6?
?No, that's different issues. The AS and Prefix matching would make the network connection an additional criteria to get redirected (e.g. if swisscom would host a mirror, and you're inside the swisscom network, this could be the preferred mirror; not that they do have any mirrors) The redirection to ipv4 hosts is a bit of a problem of mirrorbrain as far as I've seen so far: there seems not to be enough metadata about mirrors (on can be set as ip6only, but there is no setting for dualstack suppoort. So, a mirror can say it accepts ONLY ipv6, any other host is assumed to be either v4 only or dual stack - and clients are assumed to be dualstack. That is, as far as I understood, the current limitation of mirrorbrain (for the current reality, the assumptions are not far off, but as tmie progresses this will need adjustments); the trickiest part will be to find out if the client is dual stack or not (server info would just be administrative tasks) Cheers, Dominique
Dominique Leuenberger / DimStar wrote:
On Sat, 2017-02-18 at 20:01 +0100, Per Jessen wrote:
With a few attempts just now, I was directed to the following sites:
1) ftp.gwdg.de 2) mirror.23media.de 3) opensuse.mirrors.ovh.net 4) mirror1.hs-esslingen.de (no IPv6) 5) anorien.csc.warwick.ac.uk 6) ftp.linux.cz 7) www.mirrorservice.org 8) mirror.library.ucy.ac.cy (no IPv6) 9) fr2.rpmfind.net (no IPv6) 10) mirror.euserv.net 11) ftp.uni-bayreuth.de (no ipv6) 12) mirrors.se.eu.kernel.org 13) files.opensuse-education.org (no ipv6) 14) mirror.rackspace.co.uk (no ipv6) 15) mirror.onet.pl (no ipv6) 16) opensuse.mirrors.proxad.net
This is somewhat better than previously, at least they're European mirrors, but there isn't one single Swiss mirror listed? Looking at the mirror list, the geolocation works:
List of best mirrors for IP address 2a03:7520:4c68:1:21d:92ff:fe39:a132, located in Switzerland (CH).
I don't think we have currently any Swiss mirrors for Tumblewed; Switch only hosts the released distributions.
What's the significance of Tumbleweed in this context? you didn't mention it in your posting. The URL I tried was just a Leap422 iso from: http://download.opensuse.org/distribution/leap/42.2/iso/ -- Per Jessen, Zürich (2.6°C) http://www.dns24.ch/ - your free DNS host, made in Switzerland. -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org To contact the owner, email: opensuse-project+owner@opensuse.org
On Sat, 2017-02-18 at 20:46 +0100, Per Jessen wrote:
What's the significance of Tumbleweed in this context? you didn't mention it in your posting.
The URL I tried was just a Leap422 iso from:
That was a pure assumption, as I know that mirror has no TW; but I looked a bit more into that one already and it seems the directory structure offered by the mirror is actually not what we expect to find there; hence, mirrorbrani seems to mark it as an invalid mirror. Something to be fixed - having found the issue is a good starting point :) Cheers, Dominique
Dominique Leuenberger / DimStar wrote:
On Sat, 2017-02-18 at 20:01 +0100, Per Jessen wrote:
We are aware that we're not at the full level of IPv6 support that
we would like to reach: unlike on IPv4, we cannot yet do AS and Prefix based matching of mirrors.
Does that explain the above? What about the redirects to mirrors with no IPv6?
No, that's different issues. The AS and Prefix matching would make the network connection an additional criteria to get redirected (e.g. if swisscom would host a mirror, and you're inside the swisscom network, this could be the preferred mirror; not that they do have any mirrors)
Ah, that would be a cool feature.
That is, as far as I understood, the current limitation of mirrorbrain (for the current reality, the assumptions are not far off, but as tmie progresses this will need adjustments); the trickiest part will be to find out if the client is dual stack or not (server info would just be administrative tasks)
Mirrors could just be ordered by address-type, then country. Not perfect, but perhaps a bit better. -- Per Jessen, Zürich (2.1°C) http://www.hostsuisse.com/ - dedicated server rental in Switzerland. -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org To contact the owner, email: opensuse-project+owner@opensuse.org
On Sat, 2017-02-18 at 21:14 +0100, Per Jessen wrote:
That is, as far as I understood, the current limitation of
mirrorbrain (for the current reality, the assumptions are not far off, but as tmie progresses this will need adjustments); the trickiest part will be to find out if the client is dual stack or not (server info would just be administrative tasks)
Mirrors could just be ordered by address-type, then country. Not perfect, but perhaps a bit better.
Just, that the srever is only registered by it's DNS name, not IP addresses - there is, in the current implementation of mirrorbrain, just no field that would even tell if a mirror has V6 enabled next to V4 or not. There is really only a bool for 'give me ipv6 hosts only' Cheers Dominique
On 18/02/17 03:23 PM, Dominique Leuenberger / DimStar wrote:
On Sat, 2017-02-18 at 21:14 +0100, Per Jessen wrote:
That is, as far as I understood, the current limitation of
mirrorbrain (for the current reality, the assumptions are not far off, but as tmie progresses this will need adjustments); the trickiest part will be to find out if the client is dual stack or not (server info would just be administrative tasks)
Mirrors could just be ordered by address-type, then country. Not perfect, but perhaps a bit better.
Just, that the srever is only registered by it's DNS name, not IP addresses - there is, in the current implementation of mirrorbrain, just no field that would even tell if a mirror has V6 enabled next to V4 or not. There is really only a bool for 'give me ipv6 hosts only'
Cheers Dominique
When I downloaded Tumbleweed, I now had 4 different servers downloading Tumbleweed instead of a single one several days ago. Much faster. Thank you, Roman -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org To contact the owner, email: opensuse-project+owner@opensuse.org
Dominique Leuenberger / DimStar wrote:
On Sat, 2017-02-18 at 20:46 +0100, Per Jessen wrote:
What's the significance of Tumbleweed in this context? you didn't mention it in your posting.
The URL I tried was just a Leap422 iso from:
That was a pure assumption, as I know that mirror has no TW; but I looked a bit more into that one already and it seems the directory structure offered by the mirror is actually not what we expect to find there; hence, mirrorbrani seems to mark it as an invalid mirror.
Ah, that's weird. I thought there was at least one more Swiss mirror (ftp.solnet.ch), but they seem to have stopped long ago. Not so important, but good for testing. /Per -- Per Jessen, Zürich (1.8°C) http://www.dns24.ch/ - your free DNS host, made in Switzerland. -- To unsubscribe, e-mail: opensuse-project+unsubscribe@opensuse.org To contact the owner, email: opensuse-project+owner@opensuse.org
participants (4)
-
Bruno Friedmann -
Dominique Leuenberger / DimStar -
Per Jessen -
Roman Bysh