Manjaro Difference between revisions of "Manjaro Mirrors"

Difference between revisions of "Manjaro Mirrors"

From Manjaro
imported>Handy
imported>Philm
(update rsync services)
Line 41: Line 41:
====What is the size of the Manjaro database?====
====What is the size of the Manjaro database?====


We are at 42 GB. 100 GB or higher would be better.
We are at around 40 GB. 100 GB or higher would be better.


<br clear="all" />
<br clear="all" />
Line 49: Line 49:


<br clear="all" />
<br clear="all" />
  Brasil
  BR / Brasil:
  rsync://rsync.las.ic.unicamp.br/pub/manjarolinux/
  rsync://rsync.las.ic.unicamp.br/pub/manjarolinux/


  Germany
  Asia / Bangladesh
rsync://repo.manjaro.org/repos (whitelisted IP needed)
  rsync://mirrors.ispros.com.bd/manjaro
rsync://ftp.halifax.rwth-aachen.de/manjaro/
  rsync://ftp.rz.tu-bs.de/pub/mirror/manjaro.org/repos/


  Japan
  Asia / Japan:
  rsync://ftp.tsukuba.wide.ad.jp/manjaro
  rsync://ftp.tsukuba.wide.ad.jp/manjaro
  rsync://ftp.kddilabs.jp/manjaro/
  rsync://ftp.kddilabs.jp/manjaro/


  United States
  Asia / South Korea:
rsync://mirror.yongbok.net/manjaro/
 
Europe / Germany
rsync://ftp.rz.tu-bs.de/pub/mirror/manjaro.org/repos/
rsync://ftp.halifax.rwth-aachen.de/manjaro/
 
Europe / Sweden:
rsync://ftp.lysator.liu.se/pub/manjaro/
 
Europe / United Kingdom:
rsync://rsync.mirrorservice.org/repo.manjaro.org/repos/
 
RU / Russian Federation:
rsync://mirror.yandex.ru/mirrors/manjaro/
 
US / United States:
rsync://rsync.gtlib.gatech.edu/pub/manjaro/
  rsync://mirror.jmu.edu/manjaro/
  rsync://mirror.jmu.edu/manjaro/


 
''It is always recommend to sync from the nearest location. To sync from our own manjaro.org server we need the IP of your server so it can be white-listed at our end. There is a recommended script for use with our server, so please contact the Manjaro administration in this regard. ''
''To sync from our own manjaro.org server we need the IP of your server so it can be white-listed at our end. There is a recommended script for use with our server, so please contact the Manjaro administration in this regard. ''


<br clear="all" />
<br clear="all" />
Line 87: Line 101:
Our aim is to create a light Linux distribution which is simple, up to date, fast, user friendly and which follows the K.I.S.S (Keep It Simple, Stupid) principle.  As such, Manjaro Linux provides a more user friendly installation process, utilities for managing graphic drivers, and pre-configured desktop environments.
Our aim is to create a light Linux distribution which is simple, up to date, fast, user friendly and which follows the K.I.S.S (Keep It Simple, Stupid) principle.  As such, Manjaro Linux provides a more user friendly installation process, utilities for managing graphic drivers, and pre-configured desktop environments.


Our repository is currently at the size of 42 GB. We have between 50 GB and 100 GB granted on other mirrors hosting our packages.
Our repository is at the size of around 40 GB. We have between 50 GB and 100 GB granted on other mirrors hosting our packages.
Currently it is possible to sync from the following rsync services:
Currently it is possible to sync from the following rsync services:


<br clear="all" />
<br clear="all" />
  rsync://repo.manjaro.org/repos (white-listed IP needed)
  Master / Germany (whitelisted IP needed):
rsync://ftp.halifax.rwth-aachen.de/manjaro/
  rsync://repo.manjaro.org/repos/
  rsync://ftp.rz.tu-bs.de/pub/mirror/manjaro.org/repos/
BR / Brasil:
  rsync://rsync.las.ic.unicamp.br/pub/manjarolinux/
  rsync://rsync.las.ic.unicamp.br/pub/manjarolinux/
Asia / Bangladesh
rsync://mirrors.ispros.com.bd/manjaro
Asia / Japan:
rsync://ftp.tsukuba.wide.ad.jp/manjaro
  rsync://ftp.kddilabs.jp/manjaro/
  rsync://ftp.kddilabs.jp/manjaro/
  rsync://ftp.tsukuba.wide.ad.jp/manjaro
Asia / South Korea:
rsync://mirror.yongbok.net/manjaro/
Europe / Germany
  rsync://ftp.rz.tu-bs.de/pub/mirror/manjaro.org/repos/
rsync://ftp.halifax.rwth-aachen.de/manjaro/
Europe / Sweden:
rsync://ftp.lysator.liu.se/pub/manjaro/
Europe / United Kingdom:
rsync://rsync.mirrorservice.org/repo.manjaro.org/repos/
RU / Russian Federation:
rsync://mirror.yandex.ru/mirrors/manjaro/
US / United States:
rsync://rsync.gtlib.gatech.edu/pub/manjaro/
  rsync://mirror.jmu.edu/manjaro/
  rsync://mirror.jmu.edu/manjaro/
<br clear="all" />
If possible, please sync from the nearest rsync-service to your location. If you like to sync from our own Manjaro.org server we need the IP of the server that you wish to sync, as it needs to be white-listed at our end. Also, it is recommended to use a script which we will provide, to sync from our server:


<br clear="all" />
https://git.manjaro.org/core/boxit/blobs/raw/master/manjaroreposync
To sync from our own Manjaro.org server we need the IP of the server that you wish to sync, as it needs to be white-listed at our end. Also, it is recommended to use a script which we will provide, to sync from our server.


Thank you for your time and consideration,
Thank you for your time and consideration,
Line 110: Line 151:
==Current Size Required for a Manjaro Mirror:==
==Current Size Required for a Manjaro Mirror:==


''(last checked 2013-05-06 19:41 CEST)''
''(last checked 2013-06-09 13:47 CEST)''


<br clear="all" />
<br clear="all" />
  996K  ./testing/multilib/x86_64
  1000K ./testing/multilib/x86_64
  1000K  ./testing/multilib
  1004K ./testing/multilib
  400K  ./testing/core/i686
  396K ./testing/core/i686
  468K  ./testing/core/x86_64
  476K ./testing/core/x86_64
  872K  ./testing/core
  876K ./testing/core
  11M   ./testing/extra/i686
  11M ./testing/extra/i686
  12M   ./testing/extra/x86_64
  12M ./testing/extra/x86_64
  22M   ./testing/extra
  22M ./testing/extra
  8.0M  ./testing/community/i686
  8.1M ./testing/community/i686
  9.1M  ./testing/community/x86_64
  9.3M ./testing/community/x86_64
  18M   ./testing/community
  18M ./testing/community
  41M   ./testing
  41M ./testing
  8.0K  ./compatibility/empty/i686
  1000K ./stable/multilib/x86_64
8.0K  ./compatibility/empty/x86_64
  1004K ./stable/multilib
20K  ./compatibility/empty
  392K ./stable/core/i686
252M  ./compatibility/basis/i686
  472K ./stable/core/x86_64
4.0K  ./compatibility/basis/x86_64/symdir_output
  868K ./stable/core
253M  ./compatibility/basis/x86_64
  10M ./stable/extra/i686
504M  ./compatibility/basis
  12M ./stable/extra/x86_64
504M  ./compatibility
  22M ./stable/extra
996K  ./stable/multilib/x86_64
  8.0M ./stable/community/i686
  1000K  ./stable/multilib
  9.2M ./stable/community/x86_64
  400K  ./stable/core/i686
  18M ./stable/community
  468K  ./stable/core/x86_64
  41M ./stable
  872K  ./stable/core
  1004K ./unstable/multilib/x86_64
  11M  ./stable/extra/i686
  1008K ./unstable/multilib
  12M   ./stable/extra/x86_64
  412K ./unstable/core/i686
  22M   ./stable/extra
  488K ./unstable/core/x86_64
  8.0M   ./stable/community/i686
  904K ./unstable/core
  9.1M  ./stable/community/x86_64
  11M ./unstable/extra/i686
  18M   ./stable/community
  12M ./unstable/extra/x86_64
  41M   ./stable
  22M ./unstable/extra
  1000K  ./unstable/multilib/x86_64
  8.1M ./unstable/community/i686
  1004K  ./unstable/multilib
  9.3M ./unstable/community/x86_64
  412K   ./unstable/core/i686
  18M ./unstable/community
  484K  ./unstable/core/x86_64
  41M ./unstable
  900K  ./unstable/core
  35G ./pool/sync
  11M   ./unstable/extra/i686
  1.1G ./pool/overlay
  12M   ./unstable/extra/x86_64
  36G ./pool
  22M   ./unstable/extra
  36G .
  8.0M  ./unstable/community/i686
  9.2M  ./unstable/community/x86_64
  18M   ./unstable/community
  41M   ./unstable
  8.2G  ./pool/.~tmp~
  32G  ./pool/sync
837M  ./pool/overlay
  41G  ./pool
  42G  .
 
<br clear="all" />
<br clear="all" />



Revision as of 11:51, 9 June 2013



What's a Mirror?

In the GNU/Linux distro world (& other systems too) a mirror is a server that hosts an up to date copy of a distro's software packages, stored in repositories (repos). There exist repos that are maintained by the distro administration - official - & other's. The Arch User Repository (AUR) being a good example of a non-official user maintained repo.

There are usually multiple repos in a mirror, holding software packages in categories, such as Manjaro's - core, extra, community & multilib repos. These repos will be duplicated with package content to suit both 32bit & 64bit installations, as well as for any & all the variety of releases that a distro may support. In Manjaro's case that is quite a number when all of the different Desktop & Window Manager titled front ends are considered.

The distro has package maintainers in its administration. They manage the contents of the repos, keeping it up to date, patching packages if required. Some distros, like Manjaro, have certain packages that are unique to it only - like mhwd for example.


Why do we need more mirrors?

The more mirrors we have the faster Manjaro's users can upgrade their systems. Some parts of the world have much faster internet speeds than others. In some circumstances, having a server in your country, or better yet, in your city, can make a world of difference to your download speeds.


How does Manjaro know what mirror(s) to use?

There is a file /etc/pacman.d/mirrorlist which lists all of the available mirrors.

There is another file called /etc/pacman-mirrors.conf that by default is configured to re-write your mirrorlist in a list with the fastest at the top, descending to the slowest, when the system is given the Terminal command:

sudo pacman-mirrors -g

This is a remarkably streamlined system compared to the ways that it has been in the past for the pacman rolling release system to manage its mirrors, let alone to rank their speed.


How do we get more mirrors?

I'm glad you asked that question.


Phil's advice, taken from the Manjaro forum:

Some people still ask me how I got 5 mirrors in one week before 0.8.0 came out. It is simple. Just write 100 mails to universities and companies supporting Linux. Go to Arch linux and grab their mirrorlist. Crawl through their servers and get their contact data. Write an email and see what response you get. Here is some more info about it.


What is the size of the Manjaro database?

We are at around 40 GB. 100 GB or higher would be better.


How is the mirror synchronized?

Via the following Rsync-Services:


BR / Brasil:
rsync://rsync.las.ic.unicamp.br/pub/manjarolinux/
Asia / Bangladesh
rsync://mirrors.ispros.com.bd/manjaro
Asia / Japan:
rsync://ftp.tsukuba.wide.ad.jp/manjaro
rsync://ftp.kddilabs.jp/manjaro/
Asia / South Korea:
rsync://mirror.yongbok.net/manjaro/
Europe / Germany
rsync://ftp.rz.tu-bs.de/pub/mirror/manjaro.org/repos/
rsync://ftp.halifax.rwth-aachen.de/manjaro/
Europe / Sweden:
rsync://ftp.lysator.liu.se/pub/manjaro/
Europe / United Kingdom:
rsync://rsync.mirrorservice.org/repo.manjaro.org/repos/
RU / Russian Federation:
rsync://mirror.yandex.ru/mirrors/manjaro/
US / United States:
rsync://rsync.gtlib.gatech.edu/pub/manjaro/
rsync://mirror.jmu.edu/manjaro/

It is always recommend to sync from the nearest location. To sync from our own manjaro.org server we need the IP of your server so it can be white-listed at our end. There is a recommended script for use with our server, so please contact the Manjaro administration in this regard.


How do you ask an organisation with servers to create a Manjaro mirror?


Write them an email like this (in your native language):


Dear Sir or Madam,

My name is <YOUR NAME>, I wish to ask you to please spare me a few minutes to read this letter & consider its contents.

I'd like to introduce you to a relative new comer to the world of Linux distributions - Manjaro Linux. Manjaro is a new user-friendly Linux distribution based on the highly regarded Arch Linux. We are currently searching for mirrors to host our packages.

Although new, we are already one of the top 10 most popular Linux Distributions in the world, as listed in the DistroWatch.com top 100.

Manjaro Linux is based on well tested snapshots of the Arch Linux repositories, and is 100% compatible with Arch itself. We manage our repositories with our own in-house tool called BoxIt, which is designed like git.

Our aim is to create a light Linux distribution which is simple, up to date, fast, user friendly and which follows the K.I.S.S (Keep It Simple, Stupid) principle. As such, Manjaro Linux provides a more user friendly installation process, utilities for managing graphic drivers, and pre-configured desktop environments.

Our repository is at the size of around 40 GB. We have between 50 GB and 100 GB granted on other mirrors hosting our packages. Currently it is possible to sync from the following rsync services:


Master / Germany (whitelisted IP needed):
rsync://repo.manjaro.org/repos/

BR / Brasil:
rsync://rsync.las.ic.unicamp.br/pub/manjarolinux/

Asia / Bangladesh
rsync://mirrors.ispros.com.bd/manjaro

Asia / Japan:
rsync://ftp.tsukuba.wide.ad.jp/manjaro
rsync://ftp.kddilabs.jp/manjaro/

Asia / South Korea:
rsync://mirror.yongbok.net/manjaro/

Europe / Germany
rsync://ftp.rz.tu-bs.de/pub/mirror/manjaro.org/repos/
rsync://ftp.halifax.rwth-aachen.de/manjaro/

Europe / Sweden:
rsync://ftp.lysator.liu.se/pub/manjaro/

Europe / United Kingdom:
rsync://rsync.mirrorservice.org/repo.manjaro.org/repos/

RU / Russian Federation:
rsync://mirror.yandex.ru/mirrors/manjaro/

US / United States:
rsync://rsync.gtlib.gatech.edu/pub/manjaro/
rsync://mirror.jmu.edu/manjaro/


If possible, please sync from the nearest rsync-service to your location. If you like to sync from our own Manjaro.org server we need the IP of the server that you wish to sync, as it needs to be white-listed at our end. Also, it is recommended to use a script which we will provide, to sync from our server:

https://git.manjaro.org/core/boxit/blobs/raw/master/manjaroreposync

Thank you for your time and consideration,

<YOUR NAME>


Current Size Required for a Manjaro Mirror:

(last checked 2013-06-09 13:47 CEST)


1000K	./testing/multilib/x86_64
1004K	./testing/multilib
396K	./testing/core/i686
476K	./testing/core/x86_64
876K	./testing/core
11M	./testing/extra/i686
12M	./testing/extra/x86_64
22M	./testing/extra
8.1M	./testing/community/i686
9.3M	./testing/community/x86_64
18M	./testing/community
41M	./testing
1000K	./stable/multilib/x86_64
1004K	./stable/multilib
392K	./stable/core/i686
472K	./stable/core/x86_64
868K	./stable/core
10M	./stable/extra/i686
12M	./stable/extra/x86_64
22M	./stable/extra
8.0M	./stable/community/i686
9.2M	./stable/community/x86_64
18M	./stable/community
41M	./stable
1004K	./unstable/multilib/x86_64
1008K	./unstable/multilib
412K	./unstable/core/i686
488K	./unstable/core/x86_64
904K	./unstable/core
11M	./unstable/extra/i686
12M	./unstable/extra/x86_64
22M	./unstable/extra
8.1M	./unstable/community/i686
9.3M	./unstable/community/x86_64
18M	./unstable/community
41M	./unstable
35G	./pool/sync
1.1G	./pool/overlay
36G	./pool
36G	.


Check here before you send a request for mirror hosting:

Following is a list that will be updated when required.

It is very important that we don't send requests to anyone on this list, as they will consider it spam & could have Manjaro's IP addresses blocked by organisations who's business is to attempt to control spam.

So when you are trying to organise new mirrors DO NOT bother hosters who have already denied us support:


23-05-2013
Canada
----------------------
csclub.uwaterloo.ca  - We are not currently
interested in mirroring Manjaro Linux.


It is a good idea to check this thread: [1] to be sure that the wiki is up to date & also if you have been denied a request to post it in the same thread for obvious reasons.


Do You Manage a Potential Manjaro Mirror Server?

If so, here are some guidelines for you to think about, as putting up such a Mirror requires a certain commitment & perseverance.

The Manjaro community is better off not having a mirror, if it isn't kept functioning & up to date. So if you aren't in it for the long run, don't do it. You will only create disappointment.

Do you have enough bandwidth for the job? Do you pay for traffic? Your traffic may increase a lot. If you don't have enough bandwidth, you will end up offering at best a slow mirror, at worst an unreachable mirror.

Do you have enough disk space? You will need 50GB, though being able to offer 100GB would be great for the future. If your drive fills up you will not be able to rsync your mirror, it will become out of date & cause problems.

Sync every six hours. Being a rolling release system Manjaro's repos are very dynamic. So mirrors need to be updated multiple times per day.

Keep an eye on your sync scripts. Make sure that your mirror updates are functioning correctly. Users depend on your data to be all there & current.

Watch the Manjaro forum for announcements re. changes that may effect the mirror/repo system. The Manjaro administration will send you an email for any important changes. Though it often helps to be primed & ready for a change.


If you can supply a new Manjaro mirror, post in this thread: [2]

Cookies help us deliver our services. By using our services, you agree to our use of cookies.