5151-5200 of 10000 results (72ms)
2018-04-17 §
05:24 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1114 (duration: 00m 58s) [production]
05:21 <marostegui> Deploy schema change on db1092 - T187089 T185128 T153182 [production]
05:19 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1092 for alter table (duration: 00m 58s) [production]
05:11 <marostegui> Stop MySQL and reboot db1114 to boot up with the new kernel [production]
05:10 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1114 (duration: 00m 59s) [production]
02:32 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.29) (duration: 05m 27s) [production]
01:09 <krinkle@tin> Synchronized wmf-config/CommonSettings.php: no-op Ib39022b2c37b033d (duration: 01m 00s) [production]
2018-04-16 §
23:57 <eileen> update civicrm revision changed from b3326dbf70 to 64b26ad377, config revision is 853fcc9111 [production]
21:03 <mobrovac@tin> Synchronized php-1.31.0-wmf.29/extensions/EventBus/includes/JobQueueEventBus.php: Use the correct way of calculating the domain from the wiki, file 2/2 - T192198 (duration: 00m 58s) [production]
21:02 <mobrovac@tin> Synchronized php-1.31.0-wmf.29/extensions/EventBus/includes/EventBus.php: Use the correct way of calculating the domain from the wiki, file 1/2 - T192198 (duration: 00m 59s) [production]
20:34 <imarlier@tin> Finished deploy [performance/navtiming@64d9c90]: null deploy (duration: 00m 02s) [production]
20:33 <imarlier@tin> Started deploy [performance/navtiming@64d9c90]: null deploy [production]
20:13 <mobrovac@tin> Synchronized php-1.31.0-wmf.29/extensions/EventBus/includes/EventBus.php: Revert using the wiki of the job runner, file 2/2 (duration: 00m 58s) [production]
20:12 <mobrovac@tin> Synchronized php-1.31.0-wmf.29/extensions/EventBus/includes/JobQueueEventBus.php: Revert using the wiki of the job runner, file 1/2 (duration: 00m 58s) [production]
19:47 <mobrovac@tin> Synchronized php-1.31.0-wmf.29/extensions/EventBus/includes/JobQueueEventBus.php: Use the wiki set in the JobQueue when creating the event, file 2/2 - T192198 (duration: 00m 59s) [production]
19:46 <mobrovac@tin> Synchronized php-1.31.0-wmf.29/extensions/EventBus/includes/EventBus.php: Use the wiki set in the JobQueue when creating the event, file 1/2 - T192198 (duration: 01m 00s) [production]
18:28 <ottomata> temporarily stopping puppet on kafka200[123] to apply MirrorMaker --new.consumer https://gerrit.wikimedia.org/r/#/c/424344/ T190940 [production]
18:03 <ottomata> restarting main <-> main DC kafka mirror maker instances to blacklist job and cp topics T190940 T167039 [production]
17:11 <moritzm> upgraded HHVM on mediawiki-jobrunner03 to a build with a patch for the MEMC_VAL_COMPRESSION_ZLIB flag in the memcached module (T184854) [production]
15:53 <akosiaris> restart hhvm on mw2252 [production]
15:29 <ppchelko@tin> Finished deploy [cpjobqueue/deploy@2a720fc]: Log HTML for PHP fatal errors from MW (duration: 01m 01s) [production]
15:28 <ppchelko@tin> Started deploy [cpjobqueue/deploy@2a720fc]: Log HTML for PHP fatal errors from MW [production]
15:25 <moritzm> upgraded HHVM on mediawiki-deployment-07 to a build with a patch for the MEMC_VAL_COMPRESSION_ZLIB flag in the memcached module (T184854) [production]
15:07 <jynus> start reimage of es3-codfw master, es2017 [production]
15:01 <vgutierrez@neodymium> conftool action : set/pooled=yes; selector: name=hydrogen.wikimedia.org,service=pdns_recursor [production]
14:53 <vgutierrez> restart pybal on lvs1003 - T187766 [production]
14:49 <vgutierrez> restart pybal on lvs2003 - T187766 [production]
14:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool db1114 in API - T191996 (duration: 00m 58s) [production]
14:42 <vgutierrez> restart pybal on lvs1006 - T187766 [production]
14:39 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: cluster=wdqs-internal [production]
14:29 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Give more API traffic to db1114 (duration: 00m 57s) [production]
14:25 <vgutierrez> restarting pybal on lvs2006 - T187766 [production]
14:13 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1114 in API (duration: 00m 58s) [production]
14:12 <moritzm> upgraded HHVM on mediawiki-deployment-09 to a build with a patch for the MEMC_VAL_COMPRESSION_ZLIB flag in the memcached module (T184854) [production]
14:06 <jynus> start reimage of es2-codfw master, es2016 [production]
14:05 <hashar> restarted Jenkins for plugin upgrade T192261 [production]
14:03 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore main traffic original weight for db1114 (duration: 00m 58s) [production]
13:47 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1114 (duration: 00m 58s) [production]
13:32 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool es1017 (duration: 00m 58s) [production]
13:31 <marostegui> Stop MySQL on db1114 to reboot with another kernel - T191996 [production]
13:30 <godog> roll-restart swift-proxy in codfw and eqiad - T188062 [production]
13:28 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1114 (duration: 00m 54s) [production]
13:18 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1087 (duration: 00m 59s) [production]
12:12 <vgutierrez@neodymium> conftool action : set/pooled=no; selector: name=hydrogen.wikimedia.org,service=pdns_recursor [production]
12:11 <vgutierrez> Depool and reimage hydrogen as stretch - T187090 [production]
11:50 <vgutierrez@neodymium> conftool action : set/pooled=yes; selector: name=acamar.wikimedia.org,service=pdns_recursor [production]
11:11 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore db1114 original weight (duration: 00m 59s) [production]
10:50 <moritzm> reimaging mw1299 (job runner) to stretch [production]
10:23 <ariel@tin> Finished deploy [dumps/dumps@4706d30]: show full stacktrace for dump job errors (duration: 00m 04s) [production]
10:23 <ariel@tin> Started deploy [dumps/dumps@4706d30]: show full stacktrace for dump job errors [production]