|
2014-08-26
§
|
| 08:28 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1036 (duration: 00m 06s) |
[production] |
| 05:41 |
<springle> |
xtrabackup clone db1036 to db1054 |
[production] |
| 05:39 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1036 while cloning (duration: 00m 06s) |
[production] |
| 05:28 |
<springle> |
upgrade & restart db1054, fs check |
[production] |
| 04:48 |
<demon> |
Synchronized wmf-config/InitialiseSettings-labs.php: (no message) (duration: 00m 06s) |
[production] |
| 04:27 |
<springle> |
labsdb1002 back up |
[production] |
| 04:07 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Tue Aug 26 04:06:34 UTC 2014 (duration 6m 33s) |
[production] |
| 03:23 |
<^d> |
restarting elasticsearch on elastic1001, elastic1003 and elastic1008. icinga may complain briefly. |
[production] |
| 03:11 |
<springle> |
filesystem issues on labsdb1002. stopped mysqld |
[production] |
| 03:05 |
<LocalisationUpdate> |
completed (1.24wmf18) at 2014-08-26 03:04:18+00:00 |
[production] |
| 02:34 |
<LocalisationUpdate> |
completed (1.24wmf17) at 2014-08-26 02:33:00+00:00 |
[production] |
|
2014-08-25
§
|
| 23:58 |
<ori> |
Synchronized wmf-config/InitialiseSettings.php: Add 'movefile' to 'eliminator' user group on jawiki (duration: 00m 03s) |
[production] |
| 23:53 |
<maxsem> |
Finished scap: SWAT: CentralNotice update (duration: 29m 58s) |
[production] |
| 23:23 |
<maxsem> |
Started scap: SWAT: CentralNotice update |
[production] |
| 23:19 |
<maxsem> |
Synchronized php-1.24wmf17/extensions/CentralNotice/: https://gerrit.wikimedia.org/r/#/c/156188/ (duration: 00m 05s) |
[production] |
| 23:17 |
<maxsem> |
Synchronized php-1.24wmf18/extensions/CentralNotice/: https://gerrit.wikimedia.org/r/#/c/156188/ (duration: 00m 04s) |
[production] |
| 23:15 |
<maxsem> |
Synchronized php-1.24wmf18/includes/htmlform/HTMLCheckField.php: https://gerrit.wikimedia.org/r/#/c/156015/ (duration: 00m 05s) |
[production] |
| 20:06 |
<subbu> |
deployed parsoid version 5b5a5ed5 |
[production] |
| 17:24 |
<godog> |
reboot ms-be1004 to pick up kernel upgrade |
[production] |
| 17:13 |
<godog> |
rebooting ms-be1002 to pick up updated kernel |
[production] |
| 16:54 |
<ottomata> |
stopping puppet on cp3021. Testing an increase of http://kafka.queue.buffering.max.ms/ in order to avoid dropping messages during broker metadata change (e.g. leader elections) |
[production] |
| 16:48 |
<hashar> |
Jenkins pooled in a new slave [https://integration.wikimedia.org/ci/computer/wdjenkins-node1/ wdjenkins-node1] that will be used to run Wikidata jenkins jobs. Work in progress with addshore. It is not running jobs yet. |
[production] |
| 16:47 |
<godog> |
reboot ms-be1011, xfsaild errors in dmesg |
[production] |
| 16:25 |
<hashar> |
Jenkins: disconnecting and reconnecting Gearman plugin from https://integration.wikimedia.org/ci/configure |
[production] |
| 16:06 |
<andrewbogott> |
wikitech deployment finished. Note that the OpenStackManager submodule is off of the MediaWiki branch because… the whole submodule setup there is a bit broken on account of a git bug that uses absolute paths to manage submodules. |
[production] |
| 16:01 |
<andrewbogott> |
deploying tiny OpenStackManager upgrade on wikitech |
[production] |
| 15:58 |
<ottomata> |
enabled elasticsearch shard allocation row awareness (via rest api) |
[production] |
| 12:45 |
<hashar> |
hard stopped/restarted Zuul (workflow config error) |
[production] |
| 12:27 |
<hashar> |
restarting zuul |
[production] |
| 10:15 |
<mark> |
setup cross-confederation BGP sessions from AS65001 (eqiad) to AS65002 (codfw) |
[production] |
| 05:35 |
<hoo> |
Synchronized wmf-config/InitialiseSettings.php: {{gerrit|156076}} - Remove centralnotice-admin right assignments on 3 wikis - Basically a noop (duration: 00m 06s) |
[production] |
| 03:15 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Mon Aug 25 03:14:13 UTC 2014 (duration 14m 12s) |
[production] |
| 02:27 |
<LocalisationUpdate> |
completed (1.24wmf18) at 2014-08-25 02:25:58+00:00 |
[production] |
| 02:15 |
<LocalisationUpdate> |
completed (1.24wmf17) at 2014-08-25 02:14:14+00:00 |
[production] |
|
2014-08-23
§
|
| 11:33 |
<mark> |
Manually removed IPv6 addresses from fenari |
[production] |
| 11:23 |
<mark> |
Deactivated IPv6 router-advertisement on cr2-pmtpa |
[production] |
| 11:21 |
<mark> |
Manually removed IPv6 address from mchenry |
[production] |
| 10:36 |
<springle> |
Synchronized wmf-config/db-eqiad.php: depool db1004. pool db1053. (duration: 00m 07s) |
[production] |
| 03:07 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Sat Aug 23 03:06:13 UTC 2014 (duration 6m 12s) |
[production] |
| 02:23 |
<LocalisationUpdate> |
completed (1.24wmf18) at 2014-08-23 02:21:59+00:00 |
[production] |
| 02:18 |
<LocalisationUpdate> |
completed (1.24wmf17) at 2014-08-23 02:17:28+00:00 |
[production] |
| 01:32 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1056 (duration: 00m 06s) |
[production] |
| 00:29 |
<ori> |
disabled puppet on osmium again to debug a leak; please don't re-enable |
[production] |