|
2016-02-05
§
|
| 15:38 |
<_joe_> |
launched l10update cronjob manually, was not running since tin's reimaging |
[production] |
| 15:35 |
<andrewbogott> |
rebooting silver for kernel update - wikitech outage will ensue |
[production] |
| 15:33 |
<urandom> |
re-restarting restbase on restbase1002.eqiad.wmnet,restbase1005.eqiad.wmnet,restbase1006.eqiad.wmnet,restbase1009.eqiad.wmnet (prior restarts may have happened before puppet run) |
[production] |
| 15:29 |
<andrewbogott> |
rebooting holmium for kernel update |
[production] |
| 15:27 |
<andrewbogott> |
rebooting labcontrol1002 for kernel update |
[production] |
| 15:24 |
<bblack> |
cp3005 didn't come back online during rolling reboot, investigating (remains depooled) |
[production] |
| 15:22 |
<_joe_> |
initializing mediawiki repos on tin |
[production] |
| 15:22 |
<andrewbogott> |
rebooting labnet1001 for kernel update |
[production] |
| 15:15 |
<urandom> |
restbase rolling restart complete |
[production] |
| 15:08 |
<urandom> |
performing rolling restbase restart to apply config change (https://gerrit.wikimedia.org/r/#/c/268611/) |
[production] |
| 14:56 |
<urandom> |
forcing puppet run and bouncing restbase on restbase1001.eqiad.wmnet (https://gerrit.wikimedia.org/r/#/c/268611/) |
[production] |
| 14:41 |
<elukey> |
confctl mw1228.eqiad.wmnet: weight changed 10 => 20 |
[production] |
| 14:24 |
<moritzm> |
rebooting db2065 to db2070 for kernel update |
[production] |
| 14:20 |
<jynus> |
reimporting nlwiktionary revision into labs (expect some temporary lag on labs-s3) |
[production] |
| 14:06 |
<moritzm> |
rebooting db2060 to db2064 for kernel update |
[production] |
| 13:34 |
<bblack> |
starting rolling reboots of cp* (traffic cache hosts) for kernel updates |
[production] |
| 12:50 |
<moritzm> |
rebooting db2055 to db2059 for kernel update |
[production] |
| 12:38 |
<elukey> |
repooled mw1228.eqiad.wmnet |
[production] |
| 12:34 |
<moritzm> |
rebooting db2050 to db2054 for kernel update |
[production] |
| 12:15 |
<moritzm> |
rebooting db2045 to db2049 for kernel update |
[production] |
| 12:07 |
<jynus> |
reimporting nlwiktionary pages into labs |
[production] |
| 12:05 |
<l10nupdate@tin> |
LocalisationUpdate failed: git pull of core failed |
[production] |
| 12:05 |
<l10nupdate@tin> |
LocalisationUpdate failed: git clone of core failed |
[production] |
| 11:54 |
<moritzm> |
rebooting db2041 to db2044 for kernel update |
[production] |
| 11:37 |
<moritzm> |
rebooting db2038 to db2040 for kernel update |
[production] |
| 11:36 |
<godog> |
start swiftrepl replication pass of common thumbs eqiad -> codfw |
[production] |
| 10:15 |
<moritzm> |
rolling reboot of ocg* cluster |
[production] |
| 02:27 |
<mobrovac> |
restbase deploy end of caae1f7 |
[production] |
| 02:20 |
<mobrovac> |
restbase deploy start of caae1f7 |
[production] |
| 01:52 |
<TimStarling> |
deploying apache log format change following successful test on deployment-prep |
[production] |
| 01:47 |
<aude@mira> |
Finished scap: Re-add user rights messages in Echo (duration: 24m 37s) |
[production] |
| 01:22 |
<aude@mira> |
Started scap: Re-add user rights messages in Echo |
[production] |
| 01:20 |
<aude@mira> |
Synchronized php-1.27.0-wmf.12/extensions/Echo: Re-add user rights messages in Echo (duration: 01m 20s) |
[production] |
| 01:06 |
<aude@mira> |
Synchronized wmf-config/: Sync wikidata config changes for beta (duration: 01m 15s) |
[production] |
| 01:00 |
<mobrovac> |
restbase deploy end of 2aef1b67a0 |
[production] |
| 00:58 |
<aude@mira> |
Synchronized wmf-config/InitialiseSettings.php: Set $wgEnotifMinorEdits to true on huwiki (duration: 01m 16s) |
[production] |
| 00:52 |
<aude@mira> |
Synchronized wmf-config/InitialiseSettings.php: Add museumvictoria.com.au to $wgCopyUploadsDomains (duration: 01m 17s) |
[production] |
| 00:46 |
<aude@mira> |
Synchronized wmf-config/InitialiseSettings.php: Re-enable ShortUrl on maiwiki, bhwiki and orwikisource, after creating db table (duration: 01m 18s) |
[production] |
| 00:36 |
<aude@mira> |
Synchronized wmf-config/InitialiseSettings.php: revert shorturl changes (duration: 01m 17s) |
[production] |
| 00:29 |
<aude@mira> |
Synchronized wmf-config/InitialiseSettings.php: Enable ShortUrl on maiwiki, bhwiki and orwikisource (duration: 01m 17s) |
[production] |
| 00:26 |
<akosiaris> |
restart apache on mendelevium.eqiad.wmnet. seems there's a memory leak, need to investigate tomorrow |
[production] |
| 00:23 |
<aude@mira> |
Synchronized wmf-config/InitialiseSettings.php: Re-enable category watch on wikipedia and commons (duration: 01m 18s) |
[production] |
| 00:19 |
<mobrovac> |
restbase deploy start of 2aef1b67a0 on rb1001 |
[production] |