|
2015-04-01
§
|
| 06:43 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Wed Apr 1 06:42:24 UTC 2015 (duration 42m 23s) |
[production] |
| 06:26 |
<Krinkle> |
Apply puppetmaster::autosigner to integration-puppetmaster |
[releng] |
| 06:10 |
<_joe_> |
manually rotated and compressed syslog and apache logs on uranium, still being spammed by kafka brokers |
[production] |
| 05:51 |
<legoktm> |
deleting non-existent job workspaces from integration slaves |
[releng] |
| 05:42 |
<Krinkle> |
Free up space on integration-slave1001-1004 by removing obsolete phplint and qunit workspaces |
[releng] |
| 03:05 |
<LocalisationUpdate> |
completed (1.25wmf23) at 2015-04-01 03:04:00+00:00 |
[production] |
| 02:58 |
<l10nupdate> |
Synchronized php-1.25wmf23/cache/l10n: (no message) (duration: 08m 41s) |
[production] |
| 02:35 |
<LocalisationUpdate> |
completed (1.25wmf22) at 2015-04-01 02:34:41+00:00 |
[production] |
| 02:29 |
<l10nupdate> |
Synchronized php-1.25wmf22/cache/l10n: (no message) (duration: 08m 46s) |
[production] |
| 02:05 |
<Krinkle> |
Restarting Jenkins again.. |
[releng] |
| 01:35 |
<legoktm> |
started zuul on gallium |
[production] |
| 01:35 |
<legoktm> |
started zuul on gallium |
[releng] |
| 01:00 |
<Krinkle> |
Restarting Jenkins |
[releng] |
| 01:00 |
<Krinkle> |
Jenkins is unable to start Gearman connection (HTTP 503); |
[releng] |
| 01:00 |
<Krinkle> |
Force restarted Zuul, didn't help |
[releng] |
| 00:55 |
<Krinkle> |
Jenkins stuck. Builds are queued in Zuul but nothing is sent to Jenkins. |
[releng] |
| 00:40 |
<urandom> |
restarting cassandra on restbase1006 |
[production] |
| 00:40 |
<urandom> |
restarting cassandra on restbase1005 |
[production] |
| 00:35 |
<urandom> |
restarting cassandra on restbase1004 |
[production] |
| 00:33 |
<urandom> |
restarting cassandra on restbase1003 |
[production] |
| 00:30 |
<urandom> |
restarting cassandra on restbase1002 |
[production] |
| 00:12 |
<catrope> |
Synchronized php-1.25wmf23/extensions/Gather: SWAT (duration: 01m 07s) |
[production] |
| 00:11 |
<RoanKattouw> |
ssh: connect to host mw2213.codfw.wmnet port 22: Connection timed out |
[production] |
| 00:11 |
<catrope> |
Synchronized php-1.25wmf23/extensions/ImageMetrics: SWAT (duration: 01m 07s) |
[production] |
| 00:10 |
<catrope> |
Synchronized php-1.25wmf23/extensions/VisualEditor: SWAT (duration: 01m 07s) |
[production] |
| 00:05 |
<catrope> |
Synchronized php-1.25wmf22/extensions/Gather: SWAT (duration: 01m 06s) |
[production] |
|
2015-03-31
§
|
| 23:15 |
<urandom> |
restarting cassandra on restbase1001 |
[production] |
| 21:00 |
<greg-g> |
puppet-compiler02: This node is offline because Jenkins failed to launch the slave agent on it. |
[releng] |
| 20:15 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/200926 |
[releng] |
| 18:48 |
<legoktm> |
DEPLOYING https://gerrit.wikimedia.org/r/200327 |
[releng] |
| 18:39 |
<awight> |
rollback crm from b4268a60225ae11f2c2b58d3b1f1c44e282f9ec6 to 59f03df6b689ef443cc7b7e31e6f5b2986bc8bc9 |
[production] |
| 18:09 |
<twentyafterfour> |
mw2213.codfw.wmnet still timing out |
[production] |
| 18:07 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group1 to $VERSION, mw2213.codfe.wmnet failed, trying one more time |
[production] |
| 18:06 |
<twentyafterfour> |
sync_wikiversions failed for host mw2213.codfw.wmnet port 22: Connection timed out |
[production] |
| 18:04 |
<twentyafterfour> |
group1 to VERSION=1.25wmf23 |
[production] |
| 18:03 |
<twentyafterfour> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group1 to VERSION |
[production] |
| 17:54 |
<krenair> |
Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/200901/ (duration: 01m 06s) |
[production] |
| 17:20 |
<awight> |
update crm from 0e4a6ed961ca5a5882d42949c12f74c1d246b55e to b4268a60225ae11f2c2b58d3b1f1c44e282f9ec6 |
[production] |
| 16:59 |
<mutante> |
installing many package upgrades on wikitech-static |
[production] |
| 16:58 |
<awight> |
updated crm from 4c459f3dbf3c3466cdc26a351ba589f4f1aef587 to 0e4a6ed961ca5a5882d42949c12f74c1d246b55e |
[production] |
| 16:04 |
<krenair> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/196885/ (duration: 01m 06s) |
[production] |
| 15:55 |
<robh> |
ignore any alerts for wtp2001-2020, reinstalling |
[production] |
| 15:44 |
<thcipriani> |
primed keyholder on deployment-bastion to ensure jenkins-deploy can ssh |
[releng] |
| 15:37 |
<marktraceur> |
Synchronized wmf-config/db-codfw.php: [SWAT] [config] Remove another useless wgMasterWaitTimeout reference (duration: 01m 07s) |
[production] |
| 15:32 |
<marktraceur> |
Synchronized wmf-config/InitialiseSettings.php: [SWAT] [config] Enable ContentTranslation in bg, fr, mk, sh, and sl (duration: 01m 06s) |
[production] |
| 15:28 |
<marktraceur> |
Synchronized wmf-config/CommonSettings.php: [SWAT] [config] T90704: = true; (duration: 01m 13s) |
[production] |
| 15:24 |
<marktraceur> |
Synchronized wmf-config/CommonSettings.php: [SWAT] [config] Make Spam Blacklist global file protocol-relative (duration: 01m 13s) |
[production] |
| 15:21 |
<marktraceur> |
Synchronized wmf-config/InitialiseSettings.php: [SWAT] [config] Add autopatrol protection level to lvwiki (duration: 01m 13s) |
[production] |
| 15:10 |
<marktraceur> |
Synchronized wmf-config/InitialiseSettings.php: [SWAT] [config] Set to 0.30 at commons (duration: 01m 13s) |
[production] |
| 15:05 |
<marktraceur> |
Synchronized wmf-config/InitialiseSettings.php: [SWAT] [config] Add Draft namespace on zhwiki (duration: 01m 13s) |
[production] |