|
2014-05-23
§
|
| 18:22 |
<Jeff_Green> |
ran authdns-update to merge new wikimedia.community dns zone |
[production] |
| 17:02 |
<bd808> |
Starting rolling update of elasticsearch for logstash cluster |
[production] |
| 16:20 |
<bd808> |
restarted elasticsearch on logstash1002 |
[production] |
| 16:17 |
<bd808> |
Elasticsearch on logstash1002 dead due to OOM at 2014-05-23T00:34:03Z |
[production] |
| 14:52 |
<hashar> |
killed -9 a remaining Jenkins process |
[production] |
| 14:21 |
<_joe_> |
killed zuul server, as was stuck |
[production] |
| 13:50 |
<_joe_> |
killed & started jenkins, jvm stuck, unresponsive to jstack |
[production] |
| 13:17 |
<manybubbles> |
resarting jenkins because it seems stuck |
[production] |
| 11:05 |
<mark> |
Setup BFD on Zayo link between cr2-ulsfo and cr1-eqiad |
[production] |
| 11:01 |
<mark> |
Setup BFD on GTT link between cr1-ulsfo and cr2-eqiad |
[production] |
| 07:30 |
<_joe_> |
powercycling ms-be1007, unresponsive, console blank, no way to debug |
[production] |
| 04:17 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Fri May 23 04:16:15 UTC 2014 (duration 16m 14s) |
[production] |
| 03:23 |
<LocalisationUpdate> |
completed (1.24wmf6) at 2014-05-23 03:22:07+00:00 |
[production] |
| 02:39 |
<LocalisationUpdate> |
completed (1.24wmf5) at 2014-05-23 02:38:33+00:00 |
[production] |
|
2014-05-22
§
|
| 23:22 |
<mutante> |
osmium,mw1151 fixed UID of mwalker (605->2454) |
[production] |
| 23:16 |
<bd808> |
Ran sync-common manually on osmium and mw1151 |
[production] |
| 23:14 |
<mwalker> |
sync-dir failed for osmium and mw1151 |
[production] |
| 23:14 |
<mwalker> |
synchronized php-1.24wmf6/extensions/VisualEditor 'Syncing the extension manually because of scap failures on osium, mw1010, mw1070, mw1161, mw1201, and mw1151' |
[production] |
| 23:11 |
<mwalker> |
Finished scap: SWAT Update to VisualEditor {{gerrit|134941}} (duration: 03m 04s) |
[production] |
| 23:08 |
<mwalker> |
Started scap: SWAT Update to VisualEditor {{gerrit|134941}} |
[production] |
| 21:43 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Ifd048bafe0eb4af8765cee20a3d93d7663b1bcdf' |
[production] |
| 21:33 |
<reedy> |
synchronized multiversion/MWMultiVersion.php |
[production] |
| 21:29 |
<reedy> |
synchronized wmf-config/InitialiseSettings.php 'Iecdd8c5e60a142363b40e34d4fe2f27f0e5feef5' |
[production] |
| 21:22 |
<demon> |
synchronized wmf-config/InitialiseSettings.php 'touching' |
[production] |
| 21:21 |
<demon> |
synchronized wmf-config/flaggedrevs.php 'Removing FR from mw.org' |
[production] |
| 21:19 |
<demon> |
synchronized flaggedrevs.dblist 'Removing FR from mw.org' |
[production] |
| 20:10 |
<marktraceur> |
synchronized wmf-config/InitialiseSettings.php 'Sync for mediaviewer.dblist change' |
[production] |
| 20:06 |
<marktraceur> |
synchronized mediaviewer.dblist 'Enabling Media Viewer on itwiki and ruwiki by default' |
[production] |
| 20:04 |
<marktraceur> |
updated /a/common to {{Gerrit|I1c658bf65}}: Remove VE formula editor from BF whitelist (graduated) |
[production] |
| 19:54 |
<reedy> |
Purged l10n cache for 1.24wmf4 |
[production] |
| 19:54 |
<reedy> |
Purged l10n cache for 1.24wmf3 |
[production] |
| 19:54 |
<reedy> |
Purged l10n cache for 1.24wmf2 |
[production] |
| 19:53 |
<reedy> |
Purged l10n cache for 1.24wmf1 |
[production] |
| 19:53 |
<reedy> |
Purged l10n cache for 1.23wmf22 |
[production] |
| 19:52 |
<reedy> |
Purged l10n cache for 1.23wmf21 |
[production] |
| 19:38 |
<paravoid> |
cr1/2-ulsfo: BGP peering with AS11820 (WMF Corp HQ) |
[production] |
| 19:28 |
<Reedy> |
Ran patch-fr_page_rev-index.sql patch on fawiki |
[production] |
| 19:27 |
<Reedy> |
Created flaggedrevs_statistics table on fawiki |
[production] |
| 19:04 |
<reedy> |
synchronized wmf-config/ |
[production] |
| 18:30 |
<reedy> |
synchronized wmf-config/ 'I7a02f2615d98428b6f27514e75d935d36e44fcb1' |
[production] |
| 18:22 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group0 to 1.24wmf6 |
[production] |
| 18:05 |
<reedy> |
rebuilt wikiversions.cdb and synchronized wikiversions files: Wikipedias to 1.24wmf5 |
[production] |
| 17:17 |
<mutante> |
powercycling ms-be1012 |
[production] |
| 17:05 |
<reedy> |
Finished scap: testwiki to 1.24wmf6 and build l10n cache (duration: 28m 31s) |
[production] |
| 16:37 |
<reedy> |
Started scap: testwiki to 1.24wmf6 and build l10n cache |
[production] |
| 16:30 |
<mutante> |
maerlant - it was done for ~8d, old test host that didn't really do anything, revoked salt/pupppet certs, removing from Icinga.. |
[production] |
| 15:52 |
<anomie> |
synchronized wmf-config/InitialiseSettings.php 'SWAT: Fix typo in MultimediaViewer logging config [[gerrit:134837]]' |
[production] |
| 15:31 |
<anomie> |
synchronized php-1.24wmf5/extensions/MultimediaViewer/ 'SWAT: Deploy new MultimediaViewer logging to wmf5 wikis [[gerrit:134804]]' |
[production] |
| 15:22 |
<anomie> |
synchronized wmf-config/CommonSettings.php 'SWAT: Disable old MultimediaViewer logging and pre-enable new logging [[gerrit:134343]]' |
[production] |
| 15:21 |
<anomie> |
synchronized wmf-config/InitialiseSettings.php 'SWAT: Disable old MultimediaViewer logging and pre-enable new logging [[gerrit:134343]]' |
[production] |