|
2013-04-17
§
|
| 23:39 |
<asher> |
synchronized wmf-config/db-eqiad.php 'pulling db1004' |
[production] |
| 23:20 |
<mwalker> |
synchronized php-1.22wmf2/extensions/ContributionReporting 'Finished update of CN and CR to latest' |
[production] |
| 23:19 |
<mwalker> |
synchronized php-1.22wmf2/extensions/CentralNotice/ |
[production] |
| 23:13 |
<hashar> |
If jenkins/zuul goes wild overnight: connect to gallium, killoff puppet in crontab then /etc/init.d/zuul stop and drop me an email. Will take of it whenever I wake up. |
[production] |
| 23:12 |
<mwalker> |
synchronized php-1.22wmf1/extensions/ContributionReporting/ |
[production] |
| 23:11 |
<mwalker> |
synchronized php-1.22wmf1/extensions/CentralNotice 'Beginning update of CentralNotice and ContributionTracking to latest' |
[production] |
| 22:59 |
<hashar> |
restarting Zuul |
[production] |
| 22:20 |
<hashar> |
Jenkins repointing all jobs to use the new Zuul repo ( /srv/ssd/zuul/git ) {{gerrit|59744}} |
[production] |
| 22:06 |
<hashar> |
jenkins restarted. Restarting Zuul. |
[production] |
| 21:20 |
<hashar> |
stopped Zuul. Will wait a bit till jenkins start up |
[production] |
| 21:19 |
<hashar> |
restarted Jenkins |
[production] |
| 21:19 |
<hashar> |
restarted Zuul |
[production] |
| 21:16 |
<hashar> |
finished migrating zuul git repositories ( rsync -av /var/lib/zuul/git /srv/ssd/zuul ) |
[production] |
| 21:08 |
<hashar> |
Zuul ETA: it is copying MobileFrontend extension right now so half way done |
[production] |
| 21:06 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wiktionaries to 1.22wmf2 |
[production] |
| 21:03 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikisource and wikiquote to 1.22wmf2 |
[production] |
| 21:01 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikibooks and wikiversity to 1.22wmf2 |
[production] |
| 21:00 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikidatawiki back to 1.22wmf1 |
[production] |
| 20:59 |
<hashar> |
stopping Jenkins that somehow restarted |
[production] |
| 20:59 |
<reedy> |
synchronized php-1.22wmf2/includes/db/DatabaseMysql.php 'moar' |
[production] |
| 20:57 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php |
[production] |
| 20:54 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikinews.dblist and special wikis to 1.22wmf2 |
[production] |
| 20:51 |
<reedy> |
synchronized php-1.22wmf2/includes/db/DatabaseMysql.php 'debugging' |
[production] |
| 20:49 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: wikivoyage, wikimania and wikimedia to 1.22wmf2 |
[production] |
| 20:44 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: Some wikis to create some noise |
[production] |
| 20:41 |
<reedy> |
synchronized php-1.22wmf2/includes/db/DatabaseMysql.php 'debugging' |
[production] |
| 20:29 |
<hashar> |
Switching zuul dir to /srv/ssd/zuul ( {{gerrit|58898}} and {{gerrit|58899}} ) |
[production] |
| 20:18 |
<hashar> |
stopping Zuul gracefully |
[production] |
| 20:16 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: Revert that due to large number of warnings... |
[production] |
| 20:14 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: fishbowl, private and special to 1.22wmf2 |
[production] |
| 19:56 |
<hashar> |
gallium slowness is partly due to the ssd install. The git repositories are on the slow raid where as the workspaces are on the ssd. That means `git clone` can't do hardlink anymore :( |
[production] |
| 19:43 |
<binasher> |
enwiki, dewiki, wikidata are fully on mariadb 5.5.30 |
[production] |
| 19:33 |
<hashar> |
jenkins: reducing number of executors from 10 to 6. |
[production] |
| 19:31 |
<hashar> |
jenkins gallium has a huge queue of jobs. investigating. |
[production] |
| 19:31 |
<hashar> |
jenkins / gallium has a huge queue of jobs. Investigating. |
[production] |
| 19:19 |
<asher> |
synchronized wmf-config/db-pmtpa.php 's1/s5 writeable from pmtpa' |
[production] |
| 19:17 |
<asher> |
synchronized wmf-config/db-eqiad.php 's1/5 writeable' |
[production] |
| 19:13 |
<asher> |
synchronized wmf-config/db-eqiad.php 's1/5 read-only' |
[production] |
| 19:12 |
<asher> |
synchronized wmf-config/db-pmtpa.php 'preparing for master swaps' |
[production] |
| 19:03 |
<aaron> |
synchronized php-1.22wmf2/maintenance/doMaintenance.php 'deployed 1437b57bd475e5ecb06800f9f64b14ccffd0dedf' |
[production] |
| 19:00 |
<aaron> |
synchronized php-1.22wmf2/maintenance/doMaintenance.php 'deployed 1306792ad24be5b8d17355c58da655eb88c2fcc6' |
[production] |
| 18:27 |
<asher> |
synchronized wmf-config/db-eqiad.php 'returning db1050' |
[production] |
| 18:17 |
<LeslieCarr> |
installing new linecard in cr2-eqiad , .1% chance of issues |
[production] |
| 18:16 |
<asher> |
synchronized wmf-config/db-eqiad.php 'pulling db1050' |
[production] |
| 17:49 |
<aaron> |
synchronized php-1.22wmf2/includes/User.php 'deployed 6a66776fd7afdf883ad6f82270453fc76833508b' |
[production] |
| 16:19 |
<^demon> |
running puppet on manganese (will restart gerrit) |
[production] |
| 13:04 |
<apergos> |
restarted icinga on neon (the usual: Could not create external command file '/var/lib/nagios/rw/nagios.cmd' as named pipe) |
[production] |