501-550 of 10000 results (19ms)
2020-06-19 §
08:00 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
07:59 <marostegui@cumin2001> dbctl commit (dc=all): 'Depool db1093', diff saved to https://phabricator.wikimedia.org/P11601 and previous config saved to /var/cache/conftool/dbconfig/20200619-075907-marostegui.json [production]
07:54 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
07:52 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
07:47 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
07:47 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
07:44 <marostegui@cumin2001> dbctl commit (dc=all): 'Repool db1098:3316', diff saved to https://phabricator.wikimedia.org/P11600 and previous config saved to /var/cache/conftool/dbconfig/20200619-074420-marostegui.json [production]
07:39 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
07:28 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
07:23 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
07:22 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
07:16 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
07:15 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
07:10 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
07:09 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
07:03 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
07:02 <moritzm> rebooting ganeti nodes in eqiad for kernel security updates [production]
06:57 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
06:51 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single [production]
06:47 <moritzm> force reinstall of memcached 1.6 deb packages to ensure that the override is used in addition to the unmodified systemd unit from the deb T233933 [production]
06:39 <marostegui@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
06:36 <marostegui@cumin2001> START - Cookbook sre.hosts.downtime [production]
06:19 <marostegui> Stop mysql on db2132 to reimage m1 codfw master - T254556 [production]
06:19 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2075 db2111', diff saved to https://phabricator.wikimedia.org/P11599 and previous config saved to /var/cache/conftool/dbconfig/20200619-061922-marostegui.json [production]
06:05 <marostegui@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
06:02 <marostegui@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
06:01 <marostegui@cumin2001> START - Cookbook sre.hosts.downtime [production]
06:00 <marostegui@cumin2001> START - Cookbook sre.hosts.downtime [production]
05:54 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db1112', diff saved to https://phabricator.wikimedia.org/P11598 and previous config saved to /var/cache/conftool/dbconfig/20200619-055430-marostegui.json [production]
05:41 <marostegui@cumin2001> dbctl commit (dc=all): 'Depool db2075 and db2111 for reimage', diff saved to https://phabricator.wikimedia.org/P11597 and previous config saved to /var/cache/conftool/dbconfig/20200619-054118-marostegui.json [production]
05:34 <marostegui@cumin1001> dbctl commit (dc=all): 'Repool db2108', diff saved to https://phabricator.wikimedia.org/P11596 and previous config saved to /var/cache/conftool/dbconfig/20200619-053402-marostegui.json [production]
05:25 <marostegui@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
05:23 <marostegui@cumin2001> START - Cookbook sre.hosts.downtime [production]
04:44 <marostegui@cumin1001> dbctl commit (dc=all): 'Depool db2108 for reimage', diff saved to https://phabricator.wikimedia.org/P11595 and previous config saved to /var/cache/conftool/dbconfig/20200619-044440-marostegui.json [production]
04:39 <marostegui@cumin2001> dbctl commit (dc=all): 'Depool db1098:3316', diff saved to https://phabricator.wikimedia.org/P11594 and previous config saved to /var/cache/conftool/dbconfig/20200619-043956-marostegui.json [production]
04:35 <marostegui@cumin2001> dbctl commit (dc=all): 'Depool db1112', diff saved to https://phabricator.wikimedia.org/P11593 and previous config saved to /var/cache/conftool/dbconfig/20200619-043554-marostegui.json [production]
2020-06-18 §
22:30 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: EventLogging to EventGate: - SearchSatisfaction on all wikis - T249261 (duration: 00m 56s) [production]
21:14 <volans> start check-homer-diff.service on cumin2001 after merging the fix r/606526 [production]
20:17 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: EventLogging to EventGate: - SearchSatisfaction on all wikis - T249261 (duration: 00m 57s) [production]
19:44 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: EventLogging to EventGate: - SearchSatisfaction on group1 wikis - T249261 (duration: 00m 57s) [production]
18:53 <wkandek@cumin1001> conftool action : set/pooled=yes; selector: name=mw2339.codfw.wmnet [production]
18:35 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
18:32 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
17:16 <wkandek@cumin1001> conftool action : set/pooled=no; selector: name=mw2339.codfw.wmnet [production]
17:14 <wkandek@cumin1001> conftool action : set/pooled=yes; selector: name=mw2339.codfw.wmnet [production]
17:12 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2339.codfw.wmnet [production]
16:51 <maryum> reindex suspended until deployment of code [production]
16:49 <hnowlan> Shut off non-dockerised deployment-prep instance of changeprop [production]
16:15 <maryum> reindexing French wiki in Elasticsearch [production]
15:37 <Reedy> creatd bot_passwords tables on officeiwki and otrs_wikiwiki T254925 T246489 [production]