3301-3350 of 10000 results (40ms)
2021-10-20 ยง
19:24 <ebernhardson@deploy1002> Finished deploy [search/mjolnir/deploy@985a139]: bulk_daemon: detect cross-cluste config from old and new locations (duration: 00m 46s) [production]
19:24 <ebernhardson@deploy1002> Started deploy [search/mjolnir/deploy@985a139]: bulk_daemon: detect cross-cluste config from old and new locations [production]
19:09 <mutante> disabling puppet on mw* for a minute to deploy a change [production]
18:41 <otto@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
18:41 <otto@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . [production]
18:31 <otto@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-main' for release 'canary' . [production]
18:30 <otto@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
18:24 <otto@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'eventgate-main' for release 'production' . [production]
17:28 <mutante> [krb1001:~] $ sudo manage_principals.py create statwithlatte --email_address=naray-ctr@wikimedia.org - T293810 [production]
17:27 <mutante> [krb1001:~] $ sudo manage_principals.py create statwithlatte --email_address=naray-ctr@wikimedia.org [production]
17:11 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
17:05 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
17:01 <razzi@deploy1002> Finished deploy [analytics/refinery@9e3295f]: Regular analytics weekly train [analytics/refinery@9e3295f] (duration: 23m 42s) [production]
17:00 <hashar@deploy1002> Synchronized php-1.38.0-wmf.5/extensions/Wikibase/client: Update deprecated calls to ParserOutput in ShortDescHandler - T293860 (duration: 01m 03s) [production]
16:56 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
16:53 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
16:53 <hashar@deploy1002> Synchronized php-1.38.0-wmf.5/extensions/LiquidThreads/pages/LqtDiscussionPager.php: Remove deprecated usage of setProperty - T293895 (duration: 01m 03s) [production]
16:49 <hashar@deploy1002> Synchronized php-1.38.0-wmf.5/extensions/GeoCrumbs: Replace use of deprecated ParserOutput:getProperty() - T293894 (duration: 01m 09s) [production]
16:44 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
16:41 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
16:37 <razzi@deploy1002> Started deploy [analytics/refinery@9e3295f]: Regular analytics weekly train [analytics/refinery@9e3295f] [production]
16:36 <razzi> deploy refinery change for https://phabricator.wikimedia.org/T287084 [production]
16:13 <jbond> upload cas_6.4.2-1_amd64.deb [production]
15:42 <volans@cumin2002> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
15:38 <volans@cumin2002> START - Cookbook sre.dns.netbox [production]
14:57 <moritzm> installing modsecurity-crs security updates on Buster [production]
14:48 <moritzm> installing xmlgraphics-commons security updates on Buster [production]
14:46 <moritzm> installing irssi security updates on Buster [production]
14:44 <elukey@deploy1002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-draftquality' for release 'main' . [production]
14:44 <elukey@deploy1002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-editquality' for release 'main' . [production]
14:35 <moritzm> installing commons-io security updates on Buster [production]
14:27 <ema> cp3062: test higher vsl_space values T293879 [production]
14:27 <kevinbazira@deploy1002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-draftquality' for release 'main' . [production]
14:12 <moritzm> installing ruby2.3 security updates [production]
13:40 <moritzm> installing apache2 security updates on buster [production]
13:27 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:24 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
13:21 <hashar@deploy1002> Synchronized php: group1 wikis to 1.38.0-wmf.5 refs T281169 (duration: 01m 02s) [production]
13:20 <hashar@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.38.0-wmf.5 refs T281169 [production]
13:11 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on 7 hosts with reason: Schema change s3 T277116 [production]
13:11 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 3:00:00 on 7 hosts with reason: Schema change s3 T277116 [production]
13:04 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp3062.esams.wmnet,service=ats-tls [production]
13:04 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp3062.esams.wmnet,service=varnish-fe [production]
12:51 <ema> cp3062: bump vsl_space from 80M (default) to 512M T293879 - varnish restart needed [production]
12:37 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3:00:00 on 14 hosts with reason: Schema change s1 T277116 [production]
12:36 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 3:00:00 on 14 hosts with reason: Schema change s1 T277116 [production]
12:17 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:09 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:02 <urbanecm@deploy1002> Finished scap: 802d3b7: e4f7f85: CreateAccountCampaign: Support for recurring donors (T293699) (duration: 25m 19s) [production]
11:57 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]