451-500 of 10000 results (57ms)
2019-12-04 ยง
17:13 <bblack@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
17:11 <bblack@cumin1001> START - Cookbook sre.hosts.downtime [production]
17:09 <bblack@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
17:07 <bblack@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:49 <bblack@cumin1001> conftool action : set/pooled=no; selector: name=dns[12]001.wikimedia.org [production]
16:48 <bblack> dns[12]001 - reimaging to buster [production]
16:48 <rzl@cumin1001> conftool action : set/pooled=yes; selector: dc=codfw,service=nginx,name=mw2267.codfw.wmnet,cluster=jobrunner [production]
16:48 <rzl@cumin1001> conftool action : set/pooled=yes; selector: dc=codfw,service=apache2,name=mw2267.codfw.wmnet,cluster=jobrunner [production]
16:48 <rzl@cumin1001> conftool action : set/pooled=yes; selector: dc=codfw,service=nginx,name=mw2267.codfw.wmnet,cluster=videoscaler [production]
16:48 <rzl@cumin1001> conftool action : set/pooled=yes; selector: dc=codfw,service=apache2,name=mw2267.codfw.wmnet,cluster=videoscaler [production]
16:48 <rzl@cumin1001> conftool action : set/pooled=yes; selector: name=mw2272.codfw.wmnet,dc=codfw,service=nginx,cluster=appserver [production]
16:48 <rzl@cumin1001> conftool action : set/pooled=yes; selector: name=mw2272.codfw.wmnet,dc=codfw,service=apache2,cluster=appserver [production]
16:48 <rzl@cumin1001> conftool action : set/pooled=yes; selector: name=mw2273.codfw.wmnet,dc=codfw,cluster=appserver,service=nginx [production]
16:48 <rzl@cumin1001> conftool action : set/pooled=yes; selector: name=mw2273.codfw.wmnet,dc=codfw,cluster=appserver,service=apache2 [production]
16:33 <ejegg> updated fundraising CiviCRM from 970b7b214b to 6812488f3a [production]
16:32 <effie> enagle puppet on mwdebug1001 [production]
16:32 <effie> enagle puppet on mw1348 [production]
16:30 <rzl@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:28 <rzl@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:25 <effie> disable puppet on mw1348 [production]
15:57 <papaul> rebooting ms-fe2007 for HW maintenance [production]
15:49 <rzl@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:47 <rzl@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:29 <moritzm> installing mariadb 10.3 updates from Buster 10.2 point release (client libs/tools only) [production]
15:28 <mobrovac@deploy1001> Finished deploy [restbase/deploy@f4b752e]: Parsoid: Set title when sending html2html reqs; Mirror 6% of html2html reqs to Parsoid/PHP - T239768 T239643 (duration: 16m 02s) [production]
15:26 <bblack@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:24 <bblack@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:19 <ejegg> updated fundraising CiviCRM from 0f51030071 to 970b7b214b [production]
15:15 <ejegg> disabled debug logging for Ingenico on payments-wiki [production]
15:12 <mobrovac@deploy1001> Started deploy [restbase/deploy@f4b752e]: Parsoid: Set title when sending html2html reqs; Mirror 6% of html2html reqs to Parsoid/PHP - T239768 T239643 [production]
15:09 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.5/extensions/Wikibase/repo/includes/ParserOutput/FullEntityParserOutputGenerator.php: T229407, part II (duration: 01m 02s) [production]
15:07 <rzl@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:07 <ladsgroup@deploy1001> Synchronized php-1.35.0-wmf.5/extensions/Wikibase/repo/includes/ParserOutput/FullEntityParserOutputGenerator.php: T229407 (duration: 01m 00s) [production]
15:05 <rzl@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:53 <marostegui@cumin1001> dbctl commit (dc=all): 'Set db2135 as master for s10 in codfw', diff saved to https://phabricator.wikimedia.org/P9806 and previous config saved to /var/cache/conftool/dbconfig/20191204-145349-marostegui.json [production]
14:51 <marostegui@cumin1001> dbctl commit (dc=all): 'Pool db2135 in m5 codfw', diff saved to https://phabricator.wikimedia.org/P9805 and previous config saved to /var/cache/conftool/dbconfig/20191204-145145-marostegui.json [production]
14:40 <rzl@cumin1001> conftool action : set/pooled=yes; selector: service=apache2,cluster=appserver,dc=codfw,name=mw2274.codfw.wmnet [production]
14:40 <rzl@cumin1001> conftool action : set/pooled=yes; selector: service=nginx,cluster=appserver,dc=codfw,name=mw2274.codfw.wmnet [production]
14:31 <moritzm> test ldap-corp2001 as LDAP server on mx2001 [production]
14:24 <bblack> ns2 authdns: re-route from ganeti3003 to dns3001 - T236479 [production]
14:10 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=dns5001.wikimedia.org [production]
14:04 <bblack@cumin1001> conftool action : set/pooled=yes; selector: name=dns[34]001.wikimedia.org [production]
13:59 <rzl@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:57 <rzl@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:54 <bblack@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:52 <bblack@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:52 <bblack@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:50 <bblack@cumin1001> START - Cookbook sre.hosts.downtime [production]
13:45 <bblack@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
13:43 <bblack@cumin1001> START - Cookbook sre.hosts.downtime [production]