|
2015-09-03
§
|
| 15:15 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: es2 master switchover from es1006 to es1011 (eqiad) (duration: 00m 13s) |
[production] |
| 15:14 |
<jynus@tin> |
Synchronized wmf-config/db-codfw.php: es2 master switchover from es1006 to es1011 (codfw) (duration: 00m 12s) |
[production] |
| 15:05 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: (no message) (duration: 00m 13s) |
[production] |
| 15:04 |
<demon@tin> |
Synchronized php-1.26wmf21/extensions/Translate/: (no message) (duration: 00m 15s) |
[production] |
| 14:51 |
<jynus> |
performing es2 master switchover from es1006 to es1011 |
[production] |
| 14:33 |
<paravoid> |
rebooting msw1-eqiad |
[production] |
| 14:28 |
<twentyafterfour> |
restarted phd (phabricator daemon) to pick up new configuration |
[production] |
| 14:24 |
<paravoid> |
changing IPv6 RA interval/lifetime/virtual-router-only @ eqiad |
[production] |
| 14:21 |
<paravoid> |
rebooting msw1-codfw |
[production] |
| 13:17 |
<paravoid> |
upgrading mr1-esams and mr1-eqiad to newer junos |
[production] |
| 13:13 |
<godog> |
bounce carbon daemons on graphite1001 |
[production] |
| 12:42 |
<chasemp> |
unban elastic1001 and put back in service |
[production] |
| 12:24 |
<chasemp> |
move all shards off of elastic1001 |
[production] |
| 12:24 |
<chasemp> |
disable elastic1001 in lvs as we are gonig to try fw apply round #2 |
[production] |
| 11:01 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1028; increase the load of es1010, es1013 and es1017 (duration: 00m 12s) |
[production] |
| 10:45 |
<jynus> |
applying schema change for ContentTranslation on x1-master "wikishared" |
[production] |
| 10:02 |
<godog> |
reenable puppet on ms-be1* |
[production] |
| 09:16 |
<jynus> |
started profiling mysql queries at phabricator. Only a 1% overhead is expected. |
[production] |
| 09:12 |
<moritzm> |
updated rsyncd firewall rules (see https://gerrit.wikimedia.org/r/235425 for details) |
[production] |
| 09:12 |
<godog> |
stop puppet on ms-be1* after ferm rsync change |
[production] |
| 08:23 |
<godog> |
fixup current graphite retention T96662 |
[production] |
| 07:26 |
<moritzm> |
enabled ferm on dbstore* servers in codfw |
[production] |
| 06:29 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Sep 3 06:29:35 UTC 2015 (duration 29m 34s) |
[production] |
| 03:09 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.26wmf21) at 2015-09-03 03:09:20+00:00 |
[production] |
| 03:06 |
<l10nupdate@tin> |
Synchronized php-1.26wmf21/cache/l10n: l10nupdate for 1.26wmf21 (duration: 05m 32s) |
[production] |
| 02:45 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.26wmf20) at 2015-09-03 02:45:36+00:00 |
[production] |
| 02:39 |
<l10nupdate@tin> |
Synchronized php-1.26wmf20/cache/l10n: l10nupdate for 1.26wmf20 (duration: 10m 41s) |
[production] |
| 01:32 |
<krenair@tin> |
Synchronized wmf-config/interwiki.cdb: Updating interwiki cache (duration: 00m 12s) |
[production] |
| 00:36 |
<ori@tin> |
Synchronized php-1.26wmf21/includes/parser/Preprocessor_Hash.php: Idd1acd903: Decline to cache preprocessor items larger than 1 Mb (duration: 00m 11s) |
[production] |
| 00:36 |
<ori@tin> |
Synchronized php-1.26wmf20/includes/parser/Preprocessor_Hash.php: Idd1acd903: Decline to cache preprocessor items larger than 1 Mb (duration: 00m 13s) |
[production] |
| 00:27 |
<RoanKattouw> |
Deployed patch for T111029 |
[production] |
|
2015-09-02
§
|
| 23:57 |
<andyrussg@tin> |
Synchronized php-1.26wmf20/extensions/CentralNotice/: CentralNotice update (duration: 00m 13s) |
[production] |
| 23:33 |
<andyrussg@tin> |
Synchronized php-1.26wmf21/extensions/CentralNotice/: Update CentralNotice (duration: 00m 13s) |
[production] |
| 23:02 |
<andyrussg@tin> |
Finished scap: Update CentralNotice to 2.6.0 for wmf21 (duration: 48m 18s) |
[production] |
| 22:13 |
<andyrussg@tin> |
Started scap: Update CentralNotice to 2.6.0 for wmf21 |
[production] |
| 20:27 |
<arlolra> |
updated Parsoid to version 5f2fae6c |
[production] |
| 20:08 |
<twentyafterfour@tin> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.26wmf21 |
[production] |
| 20:02 |
<krinkle@tin> |
Synchronized php-1.26wmf21/resources/src/startup.js: Ie65427caee (duration: 00m 12s) |
[production] |
| 19:09 |
<mutante> |
restarted gitblit, stopped counting |
[production] |
| 19:07 |
<paravoid> |
upgrading mr1-codfw, mr1-ulsfo to newer junos |
[production] |
| 19:01 |
<urandom> |
bouncing Cassandra on restbase1001 to address bogus icinga process failure alert |
[production] |
| 18:52 |
<legoktm> |
deployed patch for T110553 |
[production] |
| 18:36 |
<twentyafterfour@tin> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group1 wikis to 1.26wmf21 |
[production] |
| 18:32 |
<cmjohnson1> |
replacing disk 10 on db1028 |
[production] |
| 18:13 |
<urandom> |
bouncing Cassandra on restbase1001 to apply temporary GC settings |
[production] |
| 17:50 |
<krenair@tin> |
Synchronized php-1.26wmf21/extensions/VisualEditor/modules/ve-mw/ui/inspectors: https://gerrit.wikimedia.org/r/#/c/235511/ (duration: 00m 12s) |
[production] |
| 17:07 |
<ori@tin> |
Synchronized php-1.26wmf21/extensions/UniversalLanguageSelector: 78a5908fd9: Updated mediawiki/core Project: mediawiki/extensions/UniversalLanguageSelector (duration: 00m 16s) |
[production] |
| 17:07 |
<ori@tin> |
Synchronized php-1.26wmf20/extensions/UniversalLanguageSelector: 2154acc529: Updated mediawiki/core Project: mediawiki/extensions/UniversalLanguageSelector (duration: 00m 13s) |
[production] |
| 16:25 |
<mutante> |
restarting NTP on lvs2004 |
[production] |
| 16:12 |
<jynus> |
setting BBU auto-learn mode to warn only (disabled if not possible) on all database hosts |
[production] |