2401-2450 of 10000 results (58ms)
2021-04-15 ยง
18:39 <jdrewniak@deploy1002> Synchronized private/readme.php: Config: [[gerrit:679614|Add $wgWMEVectorPrefDiffSalt to private/readme (T261842)]] (duration: 01m 08s) [production]
18:32 <jdrewniak@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:679613|Add mediawiki.pref_diff stream to wgEventLoggingStreamNames/wgEventStreams (T261842)]] (duration: 01m 18s) [production]
17:18 <cmjohnson@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
17:09 <cmjohnson@cumin1001> START - Cookbook sre.dns.netbox [production]
16:42 <crusnov@cumin1001> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
16:34 <crusnov@cumin1001> START - Cookbook sre.dns.netbox [production]
16:27 <ariel@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1027.eqiad.wmnet [production]
16:21 <ryankemper> T280108 T267927 Current wdqs transfers in progress: `wqds1004`->`wdqs1005`, `wdqs2008`->`wdqs2001` [production]
16:21 <ariel@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1027.eqiad.wmnet [production]
16:17 <ryankemper@cumin2001> START - Cookbook sre.wdqs.data-transfer [production]
16:17 <ariel@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1026.eqiad.wmnet [production]
16:17 <ryankemper@cumin2001> START - Cookbook sre.wdqs.data-transfer [production]
16:17 <ryankemper> T280108 T267927 Merged https://gerrit.wikimedia.org/r/c/operations/cookbooks/+/679702 and ran puppet-agent on `cumin2001` before next round of wdqs `data-transfer`s [production]
16:12 <ariel@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1026.eqiad.wmnet [production]
16:08 <ariel@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1025.eqiad.wmnet [production]
16:02 <ariel@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1025.eqiad.wmnet [production]
15:26 <otto@deploy1002> Finished deploy [analytics/refinery@497f6a5] (hadoop-test): (no justification provided) (duration: 04m 44s) [production]
15:21 <otto@deploy1002> Started deploy [analytics/refinery@497f6a5] (hadoop-test): (no justification provided) [production]
15:09 <elukey@deploy1002> Finished deploy [analytics/refinery@497f6a5]: Regular analytics weekly train (duration: 13m 12s) [production]
15:09 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dns1002.wikimedia.org [production]
15:03 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host dns1002.wikimedia.org [production]
14:59 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dns1001.wikimedia.org [production]
14:56 <elukey@deploy1002> Started deploy [analytics/refinery@497f6a5]: Regular analytics weekly train [production]
14:53 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host dns1001.wikimedia.org [production]
14:50 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dns5002.wikimedia.org [production]
14:47 <jayme> imported etcd-mirror_0.0.5-1 to buster-wikimedia [production]
14:43 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host dns5002.wikimedia.org [production]
14:41 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dns5001.wikimedia.org [production]
14:37 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wtp1048.eqiad.wmnet with reason: REIMAGE [production]
14:35 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wtp1047.eqiad.wmnet with reason: REIMAGE [production]
14:35 <jiji@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on wtp1048.eqiad.wmnet with reason: REIMAGE [production]
14:34 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host dns5001.wikimedia.org [production]
14:33 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on wtp1046.eqiad.wmnet with reason: REIMAGE [production]
14:33 <jiji@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on wtp1047.eqiad.wmnet with reason: REIMAGE [production]
14:32 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dns2002.wikimedia.org [production]
14:31 <jiji@cumin1001> START - Cookbook sre.hosts.downtime for 2:00:00 on wtp1046.eqiad.wmnet with reason: REIMAGE [production]
14:27 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host dns2002.wikimedia.org [production]
14:24 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dns2001.wikimedia.org [production]
14:19 <ppchelko@deploy1002> Finished deploy [restbase/deploy@4755f50]: T271983, try again (duration: 07m 45s) [production]
14:18 <jmm@cumin2001> START - Cookbook sre.hosts.reboot-single for host dns2001.wikimedia.org [production]
14:17 <ariel@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1024.eqiad.wmnet [production]
14:12 <ppchelko@deploy1002> Started deploy [restbase/deploy@4755f50]: T271983, try again [production]
14:11 <ppchelko@deploy1002> Finished deploy [restbase/deploy@4755f50]: T271983 (duration: 11m 15s) [production]
14:09 <ariel@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1024.eqiad.wmnet [production]
14:00 <ppchelko@deploy1002> Started deploy [restbase/deploy@4755f50]: T271983 [production]
13:56 <jiji@cumin1001> conftool action : set/pooled=yes; selector: name=wtp104[5-7].eqiad.wmnet [production]
13:55 <hnowlan@cumin1001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host restbase1023.eqiad.wmnet [production]
13:54 <andrewbogott> upgrading packages and mediawiki on wikitech-static [production]
13:53 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) for host dns4002.wikimedia.org [production]
13:48 <hnowlan@cumin1001> START - Cookbook sre.hosts.reboot-single for host restbase1023.eqiad.wmnet [production]