[Dev] [Urgent] Mirroring Policy

Luke Shumaker lukeshu at sbcglobal.net
Sat May 30 21:00:13 GMT 2015


On Sat, 30 May 2015 09:03:53 -0600,
Icarious wrote:
> The idea of adding a mirror for the distribution is to balance the
> load between users.  However this isn't doing any better and the
> upstream mirror "repo.parabola.nu" is being over loaded every time
> someone runs rsync from it.

Oh!  RFC for prioritization: if we split up the pkgpools for Parabola
and Arch packages (Arch packages go into 'packages' and 'community',
Parabola packages also go into 'packages'), if a mirror is already an
Arch mirror, the can avoid syncing the 'packages' and 'community'
pools, and just use the Arch ones, which would hugely reduce the load
on our server. (Or if they wanted to be a little evil, they could get
the pools from an Arch mirror without being an Arch mirror :P ).

> It is my request to every existing + new mirror administrator to
> consider syncing from other frequently updated mirrors. Something in
> the lines of `repo.parabola.nu [serving via rsync] -> Mirror 1 ->
> Mirror 2 -> User running pacman `.

In Arch, the main server is referred to as the "Tier 0" mirror, the
mirrors that rsync with it directly are "Tier 1" mirrors, and
all the mirrors that sync with those are "Tier 2".  Then, rsync is
configured to not accept connections except from the specifically
whitelisted "Tier 1" IPs.  We could work with a couple of mirror
maintainers to do this with Parabola as well.

Also, in Arch, there is a separate mirror-maintainers mailing list
("arch-mirrors") for coordinating with mirror maintainers.  Perhaps we
should set up a similar list?

> I would also like to thank mtjm for raising a critical issue related
> to the same. The above solution only solves 50% of the Problem. We
> need to randomise mirror selection within pacman itself. Any
> voluntary help would be appreciated.

In the past we've discussed setting up a 'repomirror.parabola.nu' that
automatically redirects you to a mirror.  Perhaps that should be
bumped in priority.  The "gotcha" with that is we'd need
up-to-date-ish information on which mirrors had already synced for new
packages.


--
Happy hacking,
~ Luke Shumaker



More information about the Dev mailing list