|
2015-09-03
§
|
| 12:42 |
<chasemp> |
unban elastic1001 and put back in service |
[production] |
| 12:24 |
<chasemp> |
move all shards off of elastic1001 |
[production] |
| 12:24 |
<chasemp> |
disable elastic1001 in lvs as we are gonig to try fw apply round #2 |
[production] |
| 11:01 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1028; increase the load of es1010, es1013 and es1017 (duration: 00m 12s) |
[production] |
| 10:45 |
<jynus> |
applying schema change for ContentTranslation on x1-master "wikishared" |
[production] |
| 10:02 |
<godog> |
reenable puppet on ms-be1* |
[production] |
| 09:16 |
<jynus> |
started profiling mysql queries at phabricator. Only a 1% overhead is expected. |
[production] |
| 09:12 |
<moritzm> |
updated rsyncd firewall rules (see https://gerrit.wikimedia.org/r/235425 for details) |
[production] |
| 09:12 |
<godog> |
stop puppet on ms-be1* after ferm rsync change |
[production] |
| 08:23 |
<godog> |
fixup current graphite retention T96662 |
[production] |
| 07:26 |
<moritzm> |
enabled ferm on dbstore* servers in codfw |
[production] |
| 07:09 |
<valhallasw`cloud> |
and just re-running puppet solves the issue. Sigh. |
[tools] |
| 07:09 |
<valhallasw`cloud> |
last message in puppet.log.1.gz is Error: /Stage[main]/Toollabs::Exec_environ/Package[fonts-ipafont-gothic]/ensure: change from 00303-5 to latest failed: Could not get latest version: Execution of '/usr/bin/apt-cache policy fonts-ipafont-gothic' returned 100: fonts-ipafont-gothic: (...) E: Cache is out of sync, can't x-ref a package file |
[tools] |
| 07:07 |
<valhallasw`cloud> |
err, is empty. |
[tools] |
| 07:07 |
<valhallasw`cloud> |
uppet failure on tools-exec-1215 is CRITICAL 66.67% of data above the critical threshold -- but /var/log/puppet.log doesn't exist?! |
[tools] |
| 06:29 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Sep 3 06:29:35 UTC 2015 (duration 29m 34s) |
[production] |
| 05:46 |
<ircnotifier> |
legoktm: Deployed 1564da8bd2a53f9899e93497f03ba13e4a6b734f Forrestbot → ReleaseTaggerBot wb2-irc |
[tools.wikibugs] |
| 05:40 |
<legoktm> |
switched over config to use "ReleaseTaggerBot" account |
[tools.forrestbot] |
| 03:09 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.26wmf21) at 2015-09-03 03:09:20+00:00 |
[production] |
| 03:06 |
<l10nupdate@tin> |
Synchronized php-1.26wmf21/cache/l10n: l10nupdate for 1.26wmf21 (duration: 05m 32s) |
[production] |
| 02:45 |
<l10nupdate@tin> |
LocalisationUpdate completed (1.26wmf20) at 2015-09-03 02:45:36+00:00 |
[production] |
| 02:39 |
<l10nupdate@tin> |
Synchronized php-1.26wmf20/cache/l10n: l10nupdate for 1.26wmf20 (duration: 10m 41s) |
[production] |
| 02:30 |
<bd808> |
Added Jforrester as project member |
[tools.forrestbot] |
| 01:32 |
<krenair@tin> |
Synchronized wmf-config/interwiki.cdb: Updating interwiki cache (duration: 00m 12s) |
[production] |
| 00:51 |
<Krinkle> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/235656 |
[releng] |
| 00:36 |
<ori@tin> |
Synchronized php-1.26wmf21/includes/parser/Preprocessor_Hash.php: Idd1acd903: Decline to cache preprocessor items larger than 1 Mb (duration: 00m 11s) |
[production] |
| 00:36 |
<ori@tin> |
Synchronized php-1.26wmf20/includes/parser/Preprocessor_Hash.php: Idd1acd903: Decline to cache preprocessor items larger than 1 Mb (duration: 00m 13s) |
[production] |
| 00:27 |
<RoanKattouw> |
Deployed patch for T111029 |
[production] |
| 00:08 |
<Krinkle> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/235641 |
[releng] |
|
2015-09-02
§
|
| 23:57 |
<andyrussg@tin> |
Synchronized php-1.26wmf20/extensions/CentralNotice/: CentralNotice update (duration: 00m 13s) |
[production] |
| 23:33 |
<andyrussg@tin> |
Synchronized php-1.26wmf21/extensions/CentralNotice/: Update CentralNotice (duration: 00m 13s) |
[production] |
| 23:02 |
<andyrussg@tin> |
Finished scap: Update CentralNotice to 2.6.0 for wmf21 (duration: 48m 18s) |
[production] |
| 22:13 |
<andyrussg@tin> |
Started scap: Update CentralNotice to 2.6.0 for wmf21 |
[production] |
| 20:27 |
<arlolra> |
updated Parsoid to version 5f2fae6c |
[production] |
| 20:08 |
<twentyafterfour@tin> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group0 wikis to 1.26wmf21 |
[production] |
| 20:02 |
<krinkle@tin> |
Synchronized php-1.26wmf21/resources/src/startup.js: Ie65427caee (duration: 00m 12s) |
[production] |
| 19:09 |
<mutante> |
restarted gitblit, stopped counting |
[production] |
| 19:07 |
<paravoid> |
upgrading mr1-codfw, mr1-ulsfo to newer junos |
[production] |
| 19:01 |
<urandom> |
bouncing Cassandra on restbase1001 to address bogus icinga process failure alert |
[production] |
| 18:52 |
<legoktm> |
deployed patch for T110553 |
[production] |
| 18:36 |
<twentyafterfour@tin> |
rebuilt wikiversions.cdb and synchronized wikiversions files: group1 wikis to 1.26wmf21 |
[production] |
| 18:32 |
<cmjohnson1> |
replacing disk 10 on db1028 |
[production] |
| 18:21 |
<jzerebecki> |
reloading zuul for e0e78c7..3a1658e |
[releng] |
| 18:15 |
<jzerebecki> |
reloaded zuul for 327dcb6..e0e78c7 |
[releng] |
| 18:13 |
<urandom> |
bouncing Cassandra on restbase1001 to apply temporary GC settings |
[production] |
| 17:50 |
<krenair@tin> |
Synchronized php-1.26wmf21/extensions/VisualEditor/modules/ve-mw/ui/inspectors: https://gerrit.wikimedia.org/r/#/c/235511/ (duration: 00m 12s) |
[production] |
| 17:07 |
<ori@tin> |
Synchronized php-1.26wmf21/extensions/UniversalLanguageSelector: 78a5908fd9: Updated mediawiki/core Project: mediawiki/extensions/UniversalLanguageSelector (duration: 00m 16s) |
[production] |
| 17:07 |
<ori@tin> |
Synchronized php-1.26wmf20/extensions/UniversalLanguageSelector: 2154acc529: Updated mediawiki/core Project: mediawiki/extensions/UniversalLanguageSelector (duration: 00m 13s) |
[production] |
| 16:34 |
<hashar_> |
nodepool .deb package bumped to 0.1.1 . Pending upload to apt.wikimedia.org |
[releng] |
| 16:34 |
<hashar_> |
nodepool database backend has been setup by ops (thank you Jaime) |
[releng] |