6201-6250 of 10000 results (82ms)
2019-06-28 §
08:43 <elukey> roll restart of eventstreams on all scb2* nodes, service now working (kafka transport failures logged) [production]
08:02 <moritzm> updating openssl packages on mw1265 [production]
07:57 <ema> pool cp2005 w/ ATS backend T226637 [production]
07:11 <_joe_> upgrading php-wikidiff2 on the mw canaries, only on php7 - T223391 [production]
07:05 <ema> depool cp2005 and reimage as upload_ats T226637 [production]
01:22 <Krinkle> Killing arclamp-log on webperf1002, no flame graphs for three days, presumably mwlog/redis connection dropped again. T215740 [production]
2019-06-27 §
23:28 <catrope@deploy1001> Synchronized php-1.34.0-wmf.11/extensions/TimedMediaHandler/: T226748 (duration: 00m 50s) [production]
23:26 <catrope@deploy1001> Synchronized php-1.34.0-wmf.11/extensions/GrowthExperiments/includes/HomepageHooks.php: Fix JS error on Special:Homepage (duration: 00m 50s) [production]
23:25 <brion> roan is fixing deploy of T226748 which failed to include the patch (whoops) [production]
21:58 <cdanis> cdanis@cp1075.eqiad.wmnet ~ % sudo -i varnish-backend-restart [production]
21:44 <brion> deploying fix for TMH jobqueue bug T226748 [production]
20:31 <jforrester@deploy1001> Synchronized php-1.34.0-wmf.11/extensions/MobileFrontend/resources/dist: T221191: Log editor switches to visualeditorfeatureuse (duration: 00m 50s) [production]
20:18 <ladsgroup@deploy1001> Synchronized php-1.34.0-wmf.11/extensions/Wikibase: [[gerrit:519492|Avoid inserting a new addUsage job when the current usage stays untouched (duration: 01m 14s) [production]
19:23 <Urbanecm> run namespaceDupes.php for wikis in P8674 (T173070) [production]
19:23 <jhuneidi@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.34.0-wmf.11 refs T220736 [production]
19:16 <ppchelko@deploy1001> Finished deploy [restbase/deploy@ff6f302]: Use new projects and new config layout T220855 (duration: 11m 21s) [production]
19:04 <ppchelko@deploy1001> Started deploy [restbase/deploy@ff6f302]: Use new projects and new config layout T220855 [production]
18:52 <Urbanecm> Morning SWAT done for real [production]
18:51 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[:gerrit:519484|Tidy up GroupOverrides]] (T173070) (duration: 00m 56s) [production]
18:49 <urbanecm@deploy1001> Synchronized dblists/commonsuploads.dblist: [[:gerrit:Tidy up GroupOverrides]], part 1 (T173070) (duration: 00m 57s) [production]
18:48 <Urbanecm> foreachwiki namespaceDupes.php --fix done (T173070) [production]
18:46 <Urbanecm> Reopen Morning SWAT [production]
18:33 <legoktm> gerrit set-account --active '"Dzahn"' [production]
18:33 <Urbanecm> Morning SWAT done, namespaceDupes.php still running for T173070 [production]
18:29 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[:gerrit:519180|Tidy up groupOverrides]] (T185898) (duration: 00m 56s) [production]
18:22 <urbanecm@deploy1001> Synchronized dblists/commonsuploads.dblist: [[:gerrit:519475|Remove several wikis from commonsuploads.dblist]] (T185898) (duration: 00m 57s) [production]
18:20 <urbanecm@deploy1001> Synchronized dblists/commonsuploads.dblist: [[:gerrit:516623|Restrict uploading on wikimaniawiki]] (T225505) (duration: 00m 56s) [production]
18:18 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[:gerrit:516623|Restrict uploading on wikimaniawiki]], [[:gerrit:519477|Add + in front of wikimaniawiki in GroupOverrides]] (T225505) (duration: 00m 57s) [production]
18:13 <herron> kafka2001 -> kafka-main2001 migration complete. re-enabling alerting on kafka-main2001, and moving kafka2001 to role::spare::system T225005 [production]
18:08 <Urbanecm> running namespaceDupes.php across all wikis in tmux on mwmaint1002 (T173070) [production]
18:06 <ppchelko@deploy1001> Finished deploy [restbase/deploy@ff6f302]: Use new projects and new config layout T220855, restbase1016 (duration: 01m 41s) [production]
18:05 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[:gerrit:519257|Revert "Revert "Set default aliases for Project_talk namespace""]] (T173070) (duration: 00m 57s) [production]
18:05 <ppchelko@deploy1001> Started deploy [restbase/deploy@ff6f302]: Use new projects and new config layout T220855, restbase1016 [production]
18:05 <robh@cumin1001> END (PASS) - Cookbook sre.hosts.decommission (exit_code=0) [production]
18:04 <robh@cumin1001> START - Cookbook sre.hosts.decommission [production]
18:03 <ppchelko@deploy1001> Finished deploy [restbase/deploy@ff6f302]: Use new projects and new config layout T220855, restbase1016 (duration: 00m 08s) [production]
18:03 <ppchelko@deploy1001> Started deploy [restbase/deploy@ff6f302]: Use new projects and new config layout T220855, restbase1016 [production]
18:01 <ppchelko@deploy1001> Finished deploy [restbase/deploy@ff6f302]: Use new projects and new config layout T220855, rb2009 only, fixed mathoid config (duration: 02m 19s) [production]
17:59 <ppchelko@deploy1001> Started deploy [restbase/deploy@ff6f302]: Use new projects and new config layout T220855, rb2009 only, fixed mathoid config [production]
17:55 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.11/extensions/WikimediaIncubator/includes/WikimediaIncubator.php: T204883 / 93643b44a52ea7 (duration: 01m 00s) [production]
17:26 <ppchelko@deploy1001> Finished deploy [restbase/deploy@da50001]: Use new projects and new config layout T220855, rb2009 only (duration: 02m 38s) [production]
17:23 <ppchelko@deploy1001> Started deploy [restbase/deploy@da50001]: Use new projects and new config layout T220855, rb2009 only [production]
17:21 <arturo> imported gpg keys 9DC858229FC7DD38854AE2D88D81803C0EBFCD88 and 54A647F9048D5688D7DA2ABE6A030B21BA07F4FB into install1002 for T215975 [production]
17:14 <ejegg> updated fundraising tools from da82ed111d to 3089c0ec76 [production]
16:42 <jynus> repool labsdb1011 T222978 [production]
16:39 <ema> pool cp2002 w/ ATS backend T226637 [production]
14:43 <herron> beginning replacement of kafka2001 with kafka-main2001 T225005 [production]
14:33 <akosiaris> push newer calico outgoing policy rules. T225005 [production]
14:28 <XioNoX> push RPKI classification to Dallas - T220669 [production]
14:23 <Reedy> running `mwscript extensions/TimedMediaHandler/maintenance/requeueTranscodes.php --wiki=commonswiki --audio --missing --throttle` in screen as me on mwmaint1002 T226713 [production]