3751-3800 of 10000 results (75ms)
2019-06-04 ยง
16:25 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:14 <bblack> repool cp3035 (still varnish-be, but freshly installed!) [production]
16:13 <jbond@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:13 <jbond@cumin1001> START - Cookbook sre.hosts.downtime [production]
16:12 <jbond42> starting rolling reboots of mw1* [production]
16:09 <bblack@cumin1001> conftool action : set/pooled=no; selector: name=cp3045.esams.wmnet [production]
16:08 <bblack> depool cp3045 for reimage - T222937 [production]
15:56 <reedy@deploy1001> Synchronized wmf-config/CommonSettings.php: JADE - T212182 (duration: 00m 53s) [production]
15:55 <reedy@deploy1001> Synchronized wmf-config/extension-list: JADE - T212182 (duration: 00m 53s) [production]
15:52 <reedy@deploy1001> Synchronized php-1.34.0-wmf.7/extensions/Jade: Consistency (duration: 01m 08s) [production]
15:50 <otto@deploy1001> Synchronized wmf-config/CommonSettings.php: Configure eventgate-main EventService. No-op in prod. T211248 (duration: 01m 19s) [production]
15:41 <bblack> reboot cp3035 post-reimage [production]
15:27 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings-labs.php: Use eventgate-main in beta. No-op in prod. T211248 (duration: 00m 49s) [production]
15:18 <zfilipin@deploy1001> rebuilt and synchronized wikiversions files: group0 to 1.34.0-wmf.8 [production]
15:13 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:13 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
15:13 <moritzm> draining ganeti1003 for eventual reboot to MDS-enabled Linux kernel [production]
15:13 <zfilipin@deploy1001> Finished scap: testwiki to php-1.34.0-wmf.8 and rebuild l10n cache (duration: 29m 46s) [production]
15:04 <moritzm> failover Ganeti master in eqiad to ganeti1001 [production]
14:51 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:51 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
14:51 <bblack> depool cp3035 for ATS reimage - T222937 [production]
14:43 <zfilipin@deploy1001> Started scap: testwiki to php-1.34.0-wmf.8 and rebuild l10n cache [production]
14:41 <zfilipin@deploy1001> Pruned MediaWiki: 1.34.0-wmf.5 [keeping static files] (duration: 01m 38s) [production]
14:39 <zfilipin@deploy1001> Pruned MediaWiki: 1.34.0-wmf.4 [keeping static files] (duration: 01m 34s) [production]
14:36 <zfilipin@deploy1001> Pruned MediaWiki: 1.34.0-wmf.3 (duration: 11m 02s) [production]
13:53 <jbond42> restart mtail on lithium [production]
13:46 <fsero@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
13:46 <fsero@cumin1001> START - Cookbook sre.hosts.decommission [production]
13:30 <jbond42> starting rolling reboots of mw1* [production]
13:12 <moritzm> draining ganeti1008 for eventual reboot to MDS-enabled Linux kernel [production]
12:57 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
12:57 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
12:22 <Urbanecm> ran mwscript deleteBatch.php --wiki=sawikisource -r '[[:phab:T214553|T214553]]: deleting useless red [production]
12:13 <akosiaris> restart pybal on lvs2003, lvs1015 for sessionstore LVS configuration. T220401 [production]
12:09 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Repool db2046 (duration: 00m 46s) [production]
12:04 <akosiaris> restart pybal on lvs2006 for sessionstore LVS configuration. T220401 [production]
11:40 <akosiaris> restart pybal on lvs1015 for sessionstore LVS configuration. T220401 [production]
11:39 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.7/includes/: T221577 / 1286d131c01886 (duration: 01m 04s) [production]
11:39 <jijiki> enabling puppet on mc1* [production]
11:38 <Urbanecm> run mwscript namespaceDupes.php --wiki=kuwiktionary --fix (T224327) [production]
11:37 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[:gerrit:514239|Custom namespaces for ku.wiktionary]] (T224327) (duration: 00m 46s) [production]
11:35 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[:gerrit:507931|Add localized project logo for sahwikiquote]] (2/2, T222065) (duration: 00m 47s) [production]
11:33 <urbanecm@deploy1001> Synchronized static/images/project-logos/: [[:gerrit:507931|Add localized project logo for sahwikiquote]] (1/2, T222065) (duration: 00m 47s) [production]
11:31 <jijiki> enabling puppet on mc2* [production]
11:29 <Urbanecm> running mwscript namespaceDupes.php --wiki=sawikisource --add-prefix=T214553 --fix (T214553) [production]
11:28 <Urbanecm> run mwscript namespaceDupes.php --wiki=thwiki --fix (T216322) [production]
11:28 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[:gerrit:486221|Add Author namespace in Sanskrit Wikisource]] (T214553) (duration: 00m 46s) [production]
11:24 <urbanecm@deploy1001> Synchronized wmf-config/CommonSettings.php: [[:gerrit:495918|Create new protection levels for dewiktionary]] (2/2, T216885) (duration: 00m 47s) [production]
11:23 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[:gerrit:495918|Create new protection levels for dewiktionary]] (1/2, T216885) (duration: 00m 47s) [production]