Some help with rsyncd overload?

So you love  Fedora so much you have  decided to mirror it ?  Great! However some of you are causing undo strain on the master servers by doing  partial rsyncs ( times out mid way  or  connection tanks).   So how to know if you are one of strainers and /or  why would | should you care one iota? Well  those partials are  `stat`ed and  take a very large toll on  remaining open connections for others, seeing as in the default rsync the master servers have to check your current copy  against its copy to see what you have and still need.  These partials of  (often 1Tb-10Tb trees like alt, development (Alpha builds for Fedora 24), and rawhide) take up bandwidth, IOPS, and available connections for other folks namely the registered `Tier 0` and `Tier 1` mirrors (aka the ones we  average mortals  get updates from).  Makes sense that if they  can’t  get timely  copies of  updates on their  drives they  surely  can’t get them to you can they?

So you think you may be one of these offenders or  wanna help someone (friend who is mirroring or the admin of your local mirror) stop / prevent being one,  what can you do?

  • Read Mirroring Guidelines: Recommended rsyncd timing
  • Set your cron jobs to a more sane and practical 6-8 hours OR 2/3x daily
  • Let your main internal use mirror source your machines in your environment, updating your local master daily
  • Ensure you are on the master list of official mirrors, and the mirroring mailing list, which keeps you (or the admin running it) up to date of  high traffic  days or  pre-release `bit-flip` times when rsyncs that are not  deltas are  requested to stay at a minimal
  • Once you are fully  updated that first time  use delta pulls `–delta –delete-after`  which only  pulls in  what is  missing not  re-downloading the entire mirror



Source: partial rsyncs causing undo stress on main servers


One thought on “Some help with rsyncd overload?”

Leave a Reply

Please log in using one of these methods to post your comment: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s