1-50 of 10000 results (22ms)
2020-05-12 ยง
23:09 <ryankemper@cumin2001> END (FAIL) - Cookbook sre.wdqs.data-transfer (exit_code=99) [production]
23:06 <ryankemper@cumin2001> START - Cookbook sre.wdqs.data-transfer [production]
20:15 <hashar@deploy1001> Synchronized php-1.35.0-wmf.32/includes/revisionlist/RevisionItemBase.php: Fix RevisionItemBase::getId to actually return an int, as intended - T252076 (duration: 01m 06s) [production]
19:55 <dpifke@deploy1001> Finished deploy [performance/navtiming@48110b9]: Fixes swapped dc/host labels - T238086 (duration: 00m 05s) [production]
19:55 <dpifke@deploy1001> Started deploy [performance/navtiming@48110b9]: Fixes swapped dc/host labels - T238086 [production]
19:05 <hashar@deploy1001> rebuilt and synchronized wikiversions files: group0 wikis to 1.35.0-wmf.32 [production]
18:41 <legoktm> started codereview-archiver script in screen on mwmaint1002 [production]
18:23 <otto@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
18:23 <otto@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
18:17 <otto@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
18:17 <otto@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
18:14 <otto@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'canary' . [production]
18:14 <otto@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'eventgate-analytics-external' for release 'production' . [production]
17:49 <bblack> 'gdnsdctl replace' on all authdns to load new maxmind data [production]
17:43 <bblack> updating maxmind database on puppetmasters (usually automated weekly; we're mid-cycle) [production]
17:10 <James_F> Running AbuseFilter updateVarDumps on testwikis on mwmaint1002 T246539 [production]
16:55 <James_F> Running AbuseFilter updateVarDumps on closed wikis on mwmaint1002 T246539 [production]
16:55 <mstyles@deploy1001> Finished deploy [wdqs/wdqs@f617307]: v0.3.31 (duration: 14m 53s) [production]
16:40 <mstyles@deploy1001> Started deploy [wdqs/wdqs@f617307]: v0.3.31 [production]
16:35 <hnowlan@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'changeprop' for release 'staging' . [production]
15:48 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:48 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:48 <andrew@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:48 <andrew@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:34 <filippo@cumin1001> conftool action : set/pooled=true; selector: dnsdisc=thanos-query [production]
15:15 <akosiaris@deploy1001> helmfile [STAGING] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
15:15 <akosiaris@deploy1001> helmfile [EQIAD] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
15:14 <akosiaris@deploy1001> helmfile [CODFW] Ran 'sync' command on namespace 'kube-system' for release 'calico-policy-controller' . [production]
15:13 <sukhe@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:13 <sukhe@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:12 <dzahn@cumin1001> END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) [production]
15:12 <dzahn@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:09 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:09 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
15:07 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:05 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:04 <moritzm> installing 4.9.118 Linux updates on Buster nodes (reboots happening later) [production]
15:02 <moritzm> upgrading contint2001 to openjdk-8 u252 [production]
15:01 <godog> bounce pybal on lvs2010 and lvs2009 - T252186 [production]
14:40 <moritzm> imported openjdk-8 u252 forward port for buster-wikimedia component/jdk8 [production]
14:39 <ema> rolling thumbor upgrade to 2.8-1+deb10u1 T252509 T219569 T236240 [production]
14:39 <andrewbogott> rebuilding cloudcontrol1003 and 1004 [production]
14:38 <hashar> 1.35.0-wmf.22 is on test wikis. Will be pushed to group0 later today during the american window (19:00 - 21:00 UTC) # T249964 [production]
14:34 <ema> thumbor2001: repool [production]
14:33 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: EventLogging to EventGate: - Test everywhere, SearchSatisfaction on testwiki only - T249261 (duration: 01m 06s) [production]
14:33 <ema> thumbor2001: upgrade python-thumbor-wikimedia to 2.8-1+deb10u1 T252509 T219569 T236240 [production]
14:23 <moritzm> installing Java security updates on WDQS hosts [production]
14:20 <hashar@deploy1001> Finished scap: testwikis wikis to 1.35.0-wmf.32 (duration: 72m 04s) [production]
14:05 <aborrero@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:05 <aborrero@cumin1001> START - Cookbook sre.hosts.downtime [production]