Heads up on new CVS server and mirrors

Heads up on new CVS server and mirrors

av Martin Dougiamas -
Antall svar: 49
Bilde av Core developers Bilde av Documentation writers Bilde av Moodle HQ Bilde av Particularly helpful Moodlers Bilde av Plugin developers Bilde av Testers
As most of you know, we are moving away from Sourceforge. I'm working on the new CVS servers and it should be ready to go soonish.

All NON-developers should switch to using one of the anonymous mirrors, because cvs.moodle.org itself will NOT support anonymous access in future: http://docs.moodle.org/en/CVS_for_Administrators

All developers should be using cvs.moodle.org as your CVS repository to minimise problems later on (it's currently just an alias to Sourceforge but that will change). All your usernames/passwords will have to be regenerated on the new server - I'll post more info about that soon.

All mirror sites will be rsync-ing from cvsmirror.moodle.org that itself mirrors the developer repository very closely. I'll post more info on this soon too.
Gjennomsnittlig vurdering: -
Som svar til Martin Dougiamas

Info about the new CVS server for developers

av Martin Dougiamas -
Bilde av Core developers Bilde av Documentation writers Bilde av Moodle HQ Bilde av Particularly helpful Moodlers Bilde av Plugin developers Bilde av Testers
Another heads-up: we're just about ready to move cvs.moodle.org to point over to the new CVS server (most likely Thursday 6th December).

At that exact moment I'll disable all write access to the old server to avoid any code going into a black hole.

IMPORTANT: We need to re-create all the accounts on the new server. Can ALL current developers please email support@moodle.com with an email containing:
  1. Your full name
  2. Your email address
  3. Your new CVS username
  4. Your new CVS password
  5. Your old Sourceforge username (only if it's different)
  6. Your ssh public key if you have one

Put "CVS access" in the subject, please. Thanks!
Som svar til Martin Dougiamas

Re: Info about the new CVS server for developers

av Michael Blake -
Probably best to stick with the same CVS username to maintain history. We may be able to link the 2 names after the changeover, but it'll less of hassle if you don't change in the first instance.
Som svar til Martin Dougiamas

Info about the new CVS server for mirror sites

av Martin Dougiamas -
Bilde av Core developers Bilde av Documentation writers Bilde av Moodle HQ Bilde av Particularly helpful Moodlers Bilde av Plugin developers Bilde av Testers
A note for maintainers of the mirrors:

I was hoping to keep things on the new server exactly the same for you, so that it would be transparent, but I've decided it's better to run a dedicated rsync service so we have a bit more efficiency, control and logging.

Basically it means you'll just need to modify the commands you use to mirror the repository to something like this:
   rsync -av cvsmirror.moodle.org::moodle .

NOT YET though ... wait until the CVS moves on Thursday 6th December.
Som svar til Martin Dougiamas

Re: Info about the new CVS server for mirror sites

av Iñaki Arenaza -
Bilde av Core developers Bilde av Documentation writers Bilde av Peer reviewers Bilde av Plugin developers
Ok, message received smiler

Could you please post a message here once you've moved CVS and enabled the new syncing mirror so we can switch to the new configuration?

Saludos. Iñaki.
Som svar til Iñaki Arenaza

Re: Info about the new CVS server for mirror sites

av Dan Poltawski -
Also, do you have an time in mind?

If its whilst i'm awake i'll try and be available to switch it ;)
Som svar til Dan Poltawski

Re: Info about the new CVS server for mirror sites

av Martin Dougiamas -
Bilde av Core developers Bilde av Documentation writers Bilde av Moodle HQ Bilde av Particularly helpful Moodlers Bilde av Plugin developers Bilde av Testers
Sorry about the late notice, but the move should be in about 2 hours from .... NOW. smiler

At the same time I'm going to bump the release name of the MOODLE_19_STABLE branch to "1.9 Beta 3" just to help distinguish the new server from the old one (could help in debugging).
Som svar til Martin Dougiamas

Re: Info about the new CVS server for mirror sites

av Ryan Smith -
I'm using the anonymous access on eu.cvs.moodle.org and I don't get the new version.php with the bump to 1.9 beta 3. The view CVS site shows that this is the latest version of the file.

Any ideas? Thanks!
Som svar til Ryan Smith

Re: Info about the new CVS server for mirror sites

av Iñaki Arenaza -
Bilde av Core developers Bilde av Documentation writers Bilde av Peer reviewers Bilde av Plugin developers

Maybe they haven't switched to the new master CVS mirror yet? We (es.cvs.moodle.org) are doing it right now, so you'll still get the 'old' files in the following 30-45 minutes or so.

Saludos. Iñaki.

Som svar til Martin Dougiamas

Re: Info about the new CVS server for mirror sites

av Wen Hao Chuang -
OK, Roger here in US too (for the US mirror site), we will make the change the first thing tomorrow morning. Thanks for the heads-up. smiler

Uh.. by the way, is the site http://download.moodle.org/ currently down right now (local time is pacific standard time 10:14pm)?
Som svar til Martin Dougiamas

Re: Info about the new CVS server for mirror sites

av Iñaki Arenaza -
Bilde av Core developers Bilde av Documentation writers Bilde av Peer reviewers Bilde av Plugin developers

I've received an email asking me if we provide the rsync service for the CVS repository. When the CVS was hosted at SourceForge, anyone could rsync the repository.

Should we (the final mirrors) provide this service? I don't mind providing it on our server, but some consensus on the subject would be better smiler

saludos. Iñaki.

Som svar til Iñaki Arenaza

Re: Info about the new CVS server for mirror sites

av Pieterjan Heyse -
I would like to bring this to your attention folks, because atm. I cannot use rsync to mirror the entire repo.

I am providing moodle services from moodle 1.5 to HEAD and checking them all out is just not practical for me. I am running my own cvs server, and rsyncing the moodle repo into my cvs server. Since the move to the new moodle.com cvs server, I cannot use this technique anymore. Is there any possibility on providing this service again?

PJ
Som svar til Pieterjan Heyse

Re: Info about the new CVS server for mirror sites

av Iñaki Arenaza -
Bilde av Core developers Bilde av Documentation writers Bilde av Peer reviewers Bilde av Plugin developers

I have just enabled rsync access to es.cvs.moodle.org.

Just a couple of 'warnings':

  • Compression is disabled/refused. The machine is a little bit underpowered and rsync is CPU-intensive (espcially with compression).
  • We are using cvsd with a chroot setup (instead of plain cvs). This means the CVSROOT of the top of the repository is different than the one you'd get from the real repository. Note that this shouln't make a difference to anonymous users, but I felt I should mention it.

Saludos. Iñaki.

Gjennomsnittlig vurdering:Useful (1)
Som svar til Martin Dougiamas

Re: Heads up on new CVS server and mirrors

av Martin Dougiamas -
Bilde av Core developers Bilde av Documentation writers Bilde av Moodle HQ Bilde av Particularly helpful Moodlers Bilde av Plugin developers Bilde av Testers
It's all up and running. smiler

I've updated the How to set up a CVS mirror docs with the new rsync info.

The ViewCVS site is here now: http://cvs.moodle.org

There is also a commits@cvs.moodle.org mailing lists here (the mailing lists site is still being tidied up but it works if you want to subscribe to it). Commits are now pretty-printed with colors (using cvsspam).

Email support@moodle.com (or skype me) if there are any problems!
Som svar til Martin Dougiamas

Re: Heads up on new CVS server and mirrors

av Howard Miller -
Bilde av Core developers Bilde av Documentation writers Bilde av Particularly helpful Moodlers Bilde av Peer reviewers Bilde av Plugin developers
Errrr.... how do you subscribe to the list? I tried the usual suspects, but they don't seem to work.

I know.... I'm almost certainly being dumb again trist
Som svar til Martin Dougiamas

Re: Heads up on new CVS server and mirrors

av Iñaki Arenaza -
Bilde av Core developers Bilde av Documentation writers Bilde av Peer reviewers Bilde av Plugin developers

It's all up and running

And that has made for a BIG difference. 'cvs update -dPRA' used to take 10-25 minutes with sourceforge for me. I've just done it in under 30 seconds with the new server stort smil stort smil stort smil

Thanks Martin smiler

Saludos. Iñaki.

Som svar til Iñaki Arenaza

Re: Heads up on new CVS server and mirrors

av Martín Langhoff -
+1 from nz - new server - niiiiiiiiiiiice.

(and waiting to be whitelisted for the cvsmirror - at least it rejects my approaches... instantly!)
Som svar til Martin Dougiamas

Re: Heads up on new CVS server and mirrors

av Martín Langhoff -

Note about the rsync invocation for mirror maintainers! You will want 2 things:

  • --delete so files moved to the Attic (and perhaps then moved back out!) are removed/readded correctly from your mirror!
  • --exclude '#cvs.*' -- you don't want to bring in any of the silly lockfiles cvs scatters all around, as they can render your mirror unusable (clients will get "waiting for lock held by user blah"
Som svar til Martin Dougiamas

Dette foruminnlegget har blitt fjernet

Innholdet i dette foruminnlegget har blitt fjernet og er ikke lengre tilgjengelig.
Som svar til Slettet bruker

Dette foruminnlegget har blitt fjernet

Innholdet i dette foruminnlegget har blitt fjernet og er ikke lengre tilgjengelig.
Som svar til Martin Dougiamas

Re: Heads up on new CVS server and mirrors

av David Mudrák -
Bilde av Core developers Bilde av Documentation writers Bilde av Moodle HQ Bilde av Particularly helpful Moodlers Bilde av Peer reviewers Bilde av Plugin developers Bilde av Plugins guardians Bilde av Testers Bilde av Translators

I just switched to the new repository using Martín's command

$ find . -type f -name Root -print0 | xargs -0 perl -pi -e 's/\@moodle\.cvs\.sourceforge\.net/\@cvs\.moodle\.org/'

and it seems to work fine! cool I just had to accept server's RSA key fingerprint. Well, I was waiting about a minute before an update started to work, but it is probably because of everybody wants the new server right now blunker

TODO: modify instructions at http://docs.moodle.org/en/CVS_for_Developers

Som svar til Martin Dougiamas

Re: Heads up on new CVS server and mirrors

av Martin Dougiamas -
Bilde av Core developers Bilde av Documentation writers Bilde av Moodle HQ Bilde av Particularly helpful Moodlers Bilde av Plugin developers Bilde av Testers
Some more updates:

1) I've fixed Moodle docs to remove all the Sourceforge references.

2) UK/EU and ES mirrors are running fine, but the US server is behind (they are not responding to my emails). I should also have mentioned that we have a whitelist on hosts allowed to download the whole repository via rsync ... for a while yesterday this wasn't working correctly but it's all fine now.
Som svar til Martin Dougiamas

Re: Heads up on new CVS server and mirrors

av Wen Hao Chuang -
Martin, sorry about that. I was sick earlier today so didn't respond your message right away. We will do the switch tomorrow the first thing (current time is 10:22pm Dec 06 2007, pacific standard time).. I will post here again when it's done. Thanks! smiler
Som svar til Martin Dougiamas

Re: Heads up on new CVS server and mirrors

av Wen Hao Chuang -
OK guys the US CVS mirror is now updated. Please give it a try and if you still encounter problems please let me know. Thanks! smiler
Som svar til Wen Hao Chuang

Re: Heads up on new CVS server and mirrors

av Skip Marshall -
We just tried to update one of our sites using anonymous on us.cvs.moodle.org. It asked for a password. Is anonymous access down?

Thanks,
Skip
Som svar til Skip Marshall

Re: Heads up on new CVS server and mirrors

av Wen Hao Chuang -
Hi Skip thanks for let us know. Could you please email our system administrator Taylor Judd (tjudd@sfsu.edu) for trouble-shooting? Thanks!
Som svar til Wen Hao Chuang

Re: Heads up on new CVS server and mirrors

av Wen Hao Chuang -
Taylor has fixed the anonymous access issue. Just a quick FYI.
So USA mirror site should be fully functional now.. smiler
Som svar til Wen Hao Chuang

Re: Heads up on new CVS server and mirrors

av Chardelle Busch -
Bilde av Core developers
Another question. Are the mirrors going to include the modules in contrib? I just tried to get something from contrib from the us mirror and they aren't there.

Also, I just noticed that all of the Browse CVS links in the Modules and plugins database are still pointing to sourceforge.
Som svar til Chardelle Busch

Re: Heads up on new CVS server and mirrors

av Anthony Borrow -
Bilde av Core developers Bilde av Plugin developers Bilde av Testers
Chardelle - I would think that contrib certainly should be available on the mirrors. Good catch on the Modules and Plugins. I wonder if MartinD or someone from Moodle HQ could go through and change all of the references from moodle.cvs.sourceforge.net to cvs.moodle.org. Peace - Anthony
Som svar til Chardelle Busch

Re: Heads up on new CVS server and mirrors

av Iñaki Arenaza -
Bilde av Core developers Bilde av Documentation writers Bilde av Peer reviewers Bilde av Plugin developers
If the mirror admins follow the instructions specified in the 'How to set up a CVS mirror' Moodle Docs page, then 'contrib' should definitely be there.

I can confirm that es.cvs.moodle.org includes it.

Saludos. Iñaki.
Som svar til Chardelle Busch

Re: Heads up on new CVS server and mirrors

av Wen Hao Chuang -
Chardelle, I just tried it on my local development machine and it works fine, our system admin (Taylor) also double checked and found the contrib folder was updated today, could you let taylor (tjudd@sfsu.edu) know more details about what was the problem that you encountered? Many thanks!

Also if anyone else who is using US mirror site please help us testing the site to see if there are any other glitches, really appreciate that! smiler

Som svar til Wen Hao Chuang

Re: Heads up on new CVS server and mirrors

av Chardelle Busch -
Bilde av Core developers
Sheesh, I just took another look and for some reason I had :ext:anonymous instead of :pserver:anonymous in the protocol?? Works now--thanks.
Som svar til Martin Dougiamas

Re: Heads up on new CVS server and mirrors

av Chardelle Busch -
Bilde av Core developers
>>>>1) I've fixed Moodle docs to remove all the Sourceforge references.<<<<

Except the Tortoise screenshots--could you update those too.

I still can't get this to work with Tortoise--either with a name and password, or with anonymous--maybe seeing the new setup in a screenshot will help?

I get this message:
q checkout -P moodle
CVSROOT=:pserver:anonymous@cvs.moodle.org:/cvsroot/moodle

connect to cvs.moodle.org:2401 failed: No connection could be made because the target machine actively refused it.

or

CVSROOT=:pserver:anonymous@SERVER.cvs.moodle.org:/cvsroot/moodle

Error connecting to host SERVER.cvs.moodle.org: No such host is known.


Som svar til Chardelle Busch

Re: Heads up on new CVS server and mirrors

av Iñaki Arenaza -
Bilde av Core developers Bilde av Documentation writers Bilde av Peer reviewers Bilde av Plugin developers

I still can't get this to work with Tortoise--either with a name and password, or with anonymous

Anonymous connections are not supported on the master CVS server. You need to use one of the mirrors for that.

Something like:

:pserver:anonymous@es.cvs.moodle.org:/cvsroot/moodle
:pserver:anonymous@eu.cvs.moodle.org:/cvsroot/moodle
:pserver:anonymous@uk.cvs.moodle.org:/cvsroot/moodle
:pserver:anonymous@us.cvs.moodle.org:/cvsroot/moodle

(depending on what mirror server you want to use) should do it. I have updated the TortoiseCVS screen shots to reflect the new settings.

Saludos. Iñaki.

Som svar til Iñaki Arenaza

Re: Heads up on new CVS server and mirrors

av Chardelle Busch -
Bilde av Core developers

Okay, thanks Inaki--I've got it now.

>>>>Anonymous connections are not supported on the master CVS server. <<<<

Hence the confusion, since the docs (and your newly posted screenshots--thanks) show this:

Copy this text into the CVSROOT field: :pserver:anonymous@SERVER.cvs.moodle.org:/cvsroot/moodle

If anonymous access isn't allowed--why is this in the docs?
Som svar til Chardelle Busch

Re: Heads up on new CVS server and mirrors

av Iñaki Arenaza -
Bilde av Core developers Bilde av Documentation writers Bilde av Peer reviewers Bilde av Plugin developers

If anonymous access isn't allowed--why is this in the docs?

Because a few lines above, just below the list of anonymous CVS mirrors, there is the following text:

"Replace the SERVER.cvs.moodle.org in the instructions below with the server you chose above!"

(so we don't need to repeat the instructions with every possible CVS mirror, and we don't specify only one and send everyone to that mirror, thus defeating the point of having several mirrors to spread the load).

[Edit: I have updated the docs to reflect this in the Unix and Windows instructions too.]

Saludos. Iñaki.

Som svar til Chardelle Busch

Dette foruminnlegget har blitt fjernet

Innholdet i dette foruminnlegget har blitt fjernet og er ikke lengre tilgjengelig.
Som svar til Martin Dougiamas

Re: Heads up on new CVS server and mirrors

av Gary Anderson -
It would probably be a good idea to point the link near the bottom of this site so that it points to http://cvs.moodle.org. I was just checking out the latest changes based on that link and noticed that it is still pointing to the old site.
Som svar til Martin Dougiamas

Re: Heads up on new CVS server and mirrors

av Martín Langhoff -

Yet another note for cvs mirror operators!

Shortly after going live with the new cvs server, rsync got set to publish CVSROOT, together with the rest if the repository. This was done for good reasons (to support the gitsters in the wild!). But that means that it pushes out the config file (CVSROOT/config) which has settings that probably won't match your server. Specifically, it tries to use /locks/ as the locks directory, which will break in most cases.

So, even if your mirror was usable initially, it may not be usable now. Depends on a few variables, probably a good idea to check. If you try a checkout or update and see a 'cannot stat /locks' error, you know you have a problem.

How to fix it?

  • Change your rsync line to also --exclude 'CVSROOT/config'
  • Remove CVSROOT/config or just comment out the LockDir line

I've updated the instructions in the wiki too blunker

Som svar til Martín Langhoff

Re: Heads up on new CVS server and mirrors

av Iñaki Arenaza -
Bilde av Core developers Bilde av Documentation writers Bilde av Peer reviewers Bilde av Plugin developers
We (es.cvs.moodle.org) are using cvsd with a chroot setup, which needs a different CVSROOT setup. So we are excluding the whole CVSROOT directory to start with. This had bitten us badly in the past though trist sort øye

Saludos. Iñaki.
Som svar til Martin Dougiamas

Re: Heads up on new CVS server and mirrors

av Michael Blake -
**Important Note**
Please discontinue sending requests to the Moodle Helpdesk for new CVS accounts or modifications. Instead, go here and click the "Apply for CVS access" tab to make your requests known. Thanks.