101-150 of 10000 results (23ms)
2020-06-17 §
10:30 <liw@deploy1001> rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.37 [production]
09:44 <marostegui@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:42 <marostegui@cumin2001> START - Cookbook sre.hosts.downtime [production]
09:40 <hnowlan> killing stale changeprop instances running on scb hosts [production]
09:16 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.37/extensions/Flow/: T255608 Revert 'Hooks: Use PageMoveComplete instead of TitleMoveCompleting' (duration: 01m 05s) [production]
09:15 <marostegui@cumin2001> dbctl commit (dc=all): 'Fully repool db1113:3315, db1113:3316', diff saved to https://phabricator.wikimedia.org/P11558 and previous config saved to /var/cache/conftool/dbconfig/20200617-091509-marostegui.json [production]
09:11 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.37/includes/HookContainer/DeprecatedHooks.php: T255608 Revert 'Hard deprecate the hook' (duration: 01m 05s) [production]
09:02 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T247943 Install MediaModeration extension - II: Add flag to IS (duration: 01m 05s) [production]
08:56 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:56 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
08:52 <marostegui@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:49 <marostegui@cumin2001> START - Cookbook sre.hosts.downtime [production]
08:47 <marostegui@cumin2001> dbctl commit (dc=all): 'Slowly repool db1113:3315, db1113:3316', diff saved to https://phabricator.wikimedia.org/P11557 and previous config saved to /var/cache/conftool/dbconfig/20200617-084751-marostegui.json [production]
08:44 <marostegui@cumin2001> dbctl commit (dc=all): 'Slowly repool db1113:3315, db1113:3316', diff saved to https://phabricator.wikimedia.org/P11556 and previous config saved to /var/cache/conftool/dbconfig/20200617-084402-marostegui.json [production]
08:43 <jforrester@deploy1001> Synchronized php-1.35.0-wmf.37/includes/EditPage.php: T255177 T255614 Do not return internal edit status from EditPage (duration: 01m 08s) [production]
08:31 <marostegui@cumin2001> dbctl commit (dc=all): 'Slowly repool db1113:3315, db1113:3316', diff saved to https://phabricator.wikimedia.org/P11554 and previous config saved to /var/cache/conftool/dbconfig/20200617-083120-marostegui.json [production]
08:30 <godog> start logstash on logstash7 - T255243 [production]
08:29 <moritzm> prune nginx from remaining mw* servers in codfw T255565 [production]
08:23 <marostegui@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
08:20 <marostegui@cumin2001> START - Cookbook sre.hosts.downtime [production]
08:10 <godog> stop logstash temporarily on logstash7 hosts to test increased es shards - T255243 [production]
08:05 <marostegui@cumin2001> dbctl commit (dc=all): 'Depool db1113:3315 db1113:3316', diff saved to https://phabricator.wikimedia.org/P11553 and previous config saved to /var/cache/conftool/dbconfig/20200617-080511-marostegui.json [production]
07:53 <elukey> reboot kafka-jumbo1009 for kernel upgrades [production]
06:40 <elukey> reboot krb1001 for kernel upgrades [production]
06:24 <elukey> reboot an-master100[1,2] for kernel upgrades [production]
06:23 <XioNoX> set lacp active on cr2-esams:ae2 - T253970 [production]
06:15 <tstarling@deploy1001> Synchronized wmf-config/PoolCounterSettings.php: test fast stale mode on testwiki T250248 (duration: 01m 17s) [production]
06:03 <elukey> reboot an-conf100[1-3] for kernel upgrades [production]
05:45 <elukey> reboot stat1007/8 for kernel upgrades [production]
05:45 <elukey> clean up old systemd timer config on an-coord1001 (came up after the last reboot) [production]
05:42 <volker-e@deploy1001> Finished deploy [design/style-guide@37c67dd]: Deploy design/style-guide: (duration: 00m 05s) [production]
05:42 <volker-e@deploy1001> Started deploy [design/style-guide@37c67dd]: Deploy design/style-guide: [production]
05:34 <marostegui@cumin2001> dbctl commit (dc=all): 'Fully repool db1090:3312, db1090:3317', diff saved to https://phabricator.wikimedia.org/P11552 and previous config saved to /var/cache/conftool/dbconfig/20200617-053421-marostegui.json [production]
05:29 <marostegui> Deploy schema change on s7 codfw (lag will appear) - T250066 [production]
05:28 <marostegui@cumin2001> dbctl commit (dc=all): 'Slowly repool db1090:3312, db1090:3317', diff saved to https://phabricator.wikimedia.org/P11551 and previous config saved to /var/cache/conftool/dbconfig/20200617-052809-marostegui.json [production]
05:22 <marostegui@cumin2001> dbctl commit (dc=all): 'Slowly repool db1090:3312, db1090:3317', diff saved to https://phabricator.wikimedia.org/P11550 and previous config saved to /var/cache/conftool/dbconfig/20200617-052202-marostegui.json [production]
05:19 <marostegui@cumin2001> dbctl commit (dc=all): 'Slowly repool db1090:3312, db1090:3317', diff saved to https://phabricator.wikimedia.org/P11549 and previous config saved to /var/cache/conftool/dbconfig/20200617-051916-marostegui.json [production]
05:10 <marostegui@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
05:08 <marostegui@cumin2001> START - Cookbook sre.hosts.downtime [production]
04:51 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db1090:3312, db1090:3317 for reimage', diff saved to https://phabricator.wikimedia.org/P11548 and previous config saved to /var/cache/conftool/dbconfig/20200617-045105-marostegui.json [production]
04:44 <marostegui> Reload pt-kill on labsdb analytics host to pick up new config [production]
04:38 <marostegui@cumin2001> dbctl commit (dc=all): 'Depool db1129', diff saved to https://phabricator.wikimedia.org/P11547 and previous config saved to /var/cache/conftool/dbconfig/20200617-043826-marostegui.json [production]
01:43 <shdubsh> restart elasticsearch on logstash1011 [production]
2020-06-16 §
23:43 <crusnov@deploy1001> Finished deploy [netbox/deploy@5251cf1]: Deploying Netbox to netbox-dev T253140 (duration: 00m 05s) [production]
23:43 <crusnov@deploy1001> Started deploy [netbox/deploy@5251cf1]: Deploying Netbox to netbox-dev T253140 [production]
23:35 <ebernhardson@deploy1001> Synchronized wmf-config/InitialiseSettings.php: cirrus: update ML models for ko and zh, drop ja (duration: 01m 00s) [production]
23:34 <ebernhardson@deploy1001> sync-file aborted: cirrus: update ML models for ko and zh, drop ja (duration: 00m 04s) [production]
22:40 <krinkle@deploy1001> Synchronized src/Noc/: (no justification provided) (duration: 01m 04s) [production]
22:31 <krinkle@deploy1001> Synchronized docroot/noc: (no justification provided) (duration: 01m 05s) [production]
21:12 <krinkle@deploy1001> Synchronized php-1.35.0-wmf.37/extensions/WikimediaEvents/modules/: I67794c6c7192571 (duration: 01m 04s) [production]