|
2017-05-05
§
|
| 10:58 |
<akosiaris@tin> |
Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 02s) |
[production] |
| 10:58 |
<akosiaris@tin> |
Started deploy [librenms/librenms@b25a5e9]: (no justification provided) |
[production] |
| 10:57 |
<akosiaris@tin> |
Finished deploy [librenms/librenms@b25a5e9]: (no justification provided) (duration: 00m 13s) |
[production] |
| 10:57 |
<akosiaris@tin> |
Started deploy [librenms/librenms@b25a5e9]: (no justification provided) |
[production] |
| 09:00 |
<elukey> |
re-arm keyholder on mira (new scap key added for librenms) |
[production] |
| 08:48 |
<elukey> |
re-arming keyholder on naos |
[production] |
| 08:46 |
<godog> |
swift codfw-prod: ms-be2001 - ms-be2012 weight 700 - T162785 |
[production] |
| 07:49 |
<marostegui> |
Deploy alter table on wikidatawiki.wb_terms - dbstore1002 - https://phabricator.wikimedia.org/T162539 https://phabricator.wikimedia.org/T163548 |
[production] |
| 07:11 |
<marostegui> |
Deploy alter table on wikidatawiki.wb_terms - dbstore2001 - https://phabricator.wikimedia.org/T162539 https://phabricator.wikimedia.org/T163548 |
[production] |
| 06:45 |
<ema> |
starting cache_upload upgrades to varnish 4.1.6-1wm1 |
[production] |
| 05:55 |
<marostegui> |
Deploy alter table on wikidatawiki.wb_terms - db2052 - T162539 T163548 |
[production] |
| 05:55 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2059, depool db2052 - T162539 T163548 (duration: 00m 40s) |
[production] |
| 04:21 |
<mutante> |
scheduled long downtime for mailman I/O stats on fermium - until we find better ways to deal with the normal spikes causing alerts |
[production] |
| 02:38 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Fri May 5 02:38:35 UTC 2017 (duration 5m 14s) |
[production] |
| 02:33 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.21) (duration: 08m 29s) |
[production] |
| 01:26 |
<urandom> |
T163292: starting bootstrap of restbase1018-b |
[production] |
|
2017-05-04
§
|
| 20:06 |
<maxsem@tin> |
Synchronized php-1.29.0-wmf.21/extensions/JsonConfig: https://gerrit.wikimedia.org/r/#/c/351749/ (duration: 00m 40s) |
[production] |
| 19:01 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: T164407 [[gerrit:351923|wgCognateReadOnly false for medium wikis]] (duration: 00m 39s) |
[production] |
| 18:18 |
<addshore@tin> |
Synchronized wmf-config/InitialiseSettings.php: T164407 [[gerrit:351911|wgCognateReadOnly false for small wikis]] (duration: 00m 40s) |
[production] |
| 17:32 |
<bblack> |
nginx upgrading to 1.11.10-1+wmf1 on cache_maps |
[production] |
| 17:30 |
<thcipriani@tin> |
Synchronized php-1.29.0-wmf.21/extensions/Cognate: [[gerrit:351886|Add stats tracking for CognateRepo method usage]] (duration: 00m 39s) |
[production] |
| 17:01 |
<thcipriani@tin> |
Synchronized wmf-config: Revert revert [[gerrit:351868|Enable Cognate for Wiktionary in Read Only mode]] T164407 (duration: 00m 40s) |
[production] |
| 16:59 |
<thcipriani@tin> |
Synchronized php-1.29.0-wmf.21/extensions/Cognate/src/CognateStore.php: [[gerrit:351881|Construct DBReadOnlyError with null db]] (duration: 00m 39s) |
[production] |
| 16:55 |
<urandom> |
T163292: Starting bootstrap of restbase1018-a |
[production] |
| 16:49 |
<thcipriani@tin> |
Synchronized wmf-config: Revert [[gerrit:351868|Enable Cognate for Wiktionary in Read Only mode]] T164407 (duration: 00m 40s) |
[production] |
| 16:42 |
<thcipriani@tin> |
Synchronized wmf-config: [[gerrit:351868|Enable Cognate for Wiktionary in Read Only mode]] T164407 (duration: 00m 40s) |
[production] |
| 16:29 |
<thcipriani@tin> |
Synchronized php-1.29.0-wmf.21/extensions/Cognate: SWAT: [[gerrit:351867|Add read only mode]] T164407 (duration: 00m 56s) |
[production] |
| 16:18 |
<bblack> |
nginx upgraded to 1.11.10-1+wmf1 on all cache_misc |
[production] |
| 16:14 |
<thcipriani@tin> |
Synchronized README: test tin is back (duration: 01m 06s) |
[production] |
| 16:09 |
<filippo@tin> |
scap aborted: README (duration: 00m 28s) |
[production] |
| 16:09 |
<filippo@tin> |
Started scap: README |
[production] |
| 16:03 |
<urandom> |
T160759: restoring default Cassandra tombstone_threshold in eqiad |
[production] |
| 16:00 |
<godog> |
switch deployment server back to tin.eqiad.wmnet |
[production] |
| 15:57 |
<jynus@naos> |
Synchronized wmf-config/db-eqiad.php: Remove all read traffic from x1, es2 & es3-master-eqiad (duration: 01m 08s) |
[production] |
| 15:45 |
<oblivian@puppetmaster1001> |
conftool action : set/pooled=false; selector: dnsdisc=swift-rw,name=codfw |
[production] |
| 15:45 |
<bblack> |
nginx upgraded to 1.11.10-1+wmf1 on cp1051 (cache_misc) |
[production] |
| 15:42 |
<bblack> |
nginx upgraded to 1.11.10-1+wmf1 on cp1045 (cache_misc) |
[production] |
| 15:36 |
<godog> |
run-puppet-agent on cache_upload in codfw/swift for swift a/p in codfw |
[production] |
| 15:34 |
<chasemp> |
add cwd to acl*procurement-review for phab S4 |
[production] |
| 15:32 |
<godog> |
run-puppet-agent on cache_upload in codfw/swift for swift a/a |
[production] |
| 15:31 |
<oblivian:> |
Setting swift-rw in eqiad UP |
[production] |
| 15:31 |
<oblivian:> |
Setting switft-rw in codfw DOWN |
[production] |
| 15:16 |
<marostegui> |
Deploy alter table on wikidatawiki.wb_terms - db2059- https://phabricator.wikimedia.org/T162539 https://phabricator.wikimedia.org/T163548 |
[production] |
| 15:15 |
<chasemp> |
labsdb1003 maintain-views --databases ptwikimedia,pawikisourcewbwikimedia,dtywiki --replace-all --debug T164103 |
[production] |
| 15:14 |
<marostegui@naos> |
Synchronized wmf-config/db-codfw.php: Repool db2066, depool db2059 - T162539 T163548 (duration: 01m 06s) |
[production] |
| 15:03 |
<marostegui@naos> |
Synchronized wmf-config/db-eqiad.php: Restore db1070 original weight - T160392 (duration: 00m 57s) |
[production] |
| 14:46 |
<oblivian:> |
Setting wdqs in codfw UP |
[production] |
| 14:44 |
<oblivian:> |
Setting restbase-async in eqiad DOWN |
[production] |
| 14:43 |
<oblivian:> |
Setting restbase in codfw DOWN |
[production] |
| 14:43 |
<_joe_> |
forcing a puppet run on cache (text,maps, misc) in eqiad/codfw to complete the switchback |
[production] |