751-800 of 10000 results (28ms)
2021-01-15 §
10:55 <jiji@cumin1001> START - Cookbook sre.hosts.reboot-single for host mc2036.codfw.wmnet [production]
10:53 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-conf1003.eqiad.wmnet [production]
10:53 <vgutierrez> re-enable puppet on acme-chief clients [production]
10:53 <jynus> rolling restart of dbprov2* hosts [production]
10:52 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host acmechief1001.eqiad.wmnet [production]
10:52 <_joe_> rebuilding the docker images coredns,nutcracker,prometheus-statsd-exporter,service-checker,wmfdebug to use wikimedia-buster as a base [production]
10:51 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-conf1001.eqiad.wmnet [production]
10:48 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single for host acmechief1001.eqiad.wmnet [production]
10:46 <vgutierrez> disable puppet on acme-chief clients [production]
10:45 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-conf1001.eqiad.wmnet [production]
10:43 <effie> reboot mc2036 - T269596 [production]
10:40 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host acmechief-test1001.eqiad.wmnet [production]
10:27 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single for host acmechief-test1001.eqiad.wmnet [production]
10:26 <vgutierrez@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host acmechief-test2001.codfw.wmnet [production]
10:21 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single for host acmechief-test2001.codfw.wmnet [production]
10:10 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host an-test-client1001.eqiad.wmnet [production]
10:07 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single for host an-test-client1001.eqiad.wmnet [production]
10:02 <vgutierrez@cumin1001> END (FAIL) - Cookbook sre.hosts.reboot-single (exit_code=1) [production]
09:58 <reedy@deploy1001> Synchronized php-1.36.0-wmf.26/extensions/GrowthExperiments/includes/NewcomerTasks/TaskSuggester/CacheDecorator.php: T272103 (duration: 00m 57s) [production]
09:49 <vgutierrez@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
09:36 <vgutierrez> rolling restart acme-chief servers to catch up on kernel upgrades [production]
09:24 <jynus> rolling restart of dbprov1* hosts [production]
09:18 <godog> swift codfw-prod: more weight to ms-be20[58-61] - T269337 [production]
09:07 <moritzm> installing bast5002 T257324 [production]
08:45 <moritzm> installing bast4003 T257324 [production]
08:39 <marostegui> Restart clouddb1013-clouddb1020 [production]
08:28 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
08:28 <ryankemper> WDQS puppet run successful [production]
08:15 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
08:15 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
08:01 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
07:59 <elukey@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) [production]
07:57 <elukey@cumin1001> START - Cookbook sre.hosts.reboot-single [production]
03:49 <eileen> civicrm revision changed from f417a510a5 to 4220fc8177, config revision is f08249ecf9 [production]
2021-01-14 §
23:35 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2236.codfw.wmnet [production]
23:13 <jforrester@deploy1001> Synchronized wmf-config/InitialiseSettings.php: T272094 Change enwiki logo to 20th Birthday Celebration one (duration: 00m 56s) [production]
23:10 <jforrester@deploy1001> Synchronized static/images/project-logos/enwiki20-2x.png: T272094 Sync out logo before going live, 3/3 (duration: 00m 55s) [production]
23:09 <jforrester@deploy1001> Synchronized static/images/project-logos/enwiki20-1.5x.png: T272094 Sync out logo before going live, 2/3 (duration: 00m 55s) [production]
23:07 <jforrester@deploy1001> Synchronized static/images/project-logos/enwiki20.png: T272094 Sync out logo before going live, 1/3 (duration: 01m 02s) [production]
23:02 <mutante> Happy 20th Birthday Wikipedia - https://20.wikipedia.org - https://gerrit.wikimedia.org/r/656268 [production]
22:55 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2236.codfw.wmnet [production]
22:38 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2270.codfw.wmnet [production]
22:38 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2268.codfw.wmnet [production]
22:38 <dzahn@cumin1001> conftool action : set/pooled=yes; selector: name=mw2269.codfw.wmnet [production]
22:32 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2269.codfw.wmnet [production]
22:32 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2270.codfw.wmnet [production]
22:32 <dzahn@cumin1001> conftool action : set/pooled=no; selector: name=mw2268.codfw.wmnet [production]
22:04 <thcipriani> restart apache on gerrit1001 [production]
21:57 <dzahn@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on mw2236.codfw.wmnet with reason: REIMAGE [production]
21:55 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on mw2236.codfw.wmnet with reason: REIMAGE [production]