5501-5550 of 10000 results (49ms)
2021-10-26 ยง
15:07 <topranks> Running homer against cr3-esams to create new temp GRE tunnel to asw1-b12-drmrs [production]
15:02 <cdanis@cumin1001> END (PASS) - Cookbook sre.network.cf (exit_code=0) [production]
15:02 <cdanis@cumin1001> START - Cookbook sre.network.cf [production]
14:55 <topranks> Adding static route on cr3-esams to asw1-b12-drmrs Telia link IP to allow GRE to be built. [production]
13:50 <elukey> ran "Capirca Host Definition" script on netbox - output https://netbox.wikimedia.org/extras/scripts/results/1787315/ [production]
13:45 <urbanecm@deploy1002> Synchronized php-1.38.0-wmf.5/extensions/Wikibase: 7723cf724df9ede49129443e43336e93efcd7a41: RecentChangeFactory: Add missing rc_logid value (T293885) (duration: 01m 02s) [production]
13:40 <elukey> ran "Capirca Host Definition" script on netbox-next to get up-to-date aqs_group host definition - result https://netbox-next.wikimedia.org/extras/scripts/results/894348/ [production]
13:24 <kart_> Updated cxserver to 2021-10-25-123807-production (T217747, T218217, T292421) [production]
13:19 <kartik@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'cxserver' for release 'production' . [production]
13:13 <kartik@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'cxserver' for release 'production' . [production]
13:05 <kartik@deploy1002> helmfile [staging] Ran 'sync' command on namespace 'cxserver' for release 'staging' . [production]
13:05 <hashar@deploy1002> Pruned MediaWiki: 1.38.0-wmf.4 (duration: 31m 07s) [production]
12:35 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:35 <hashar> scap clean --delete 1.38.0-wmf.4 # T293947 [production]
12:32 <hashar> Applied security patches to 1.38.0-wmf.6 # T293947 [production]
12:32 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:31 <hashar> scap prep 1.38.0-wmf.6 # T293947 [production]
12:16 <jbond> upload cas_6.4.2-1+wmf10u3_amd64 [production]
12:07 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
12:04 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:55 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:52 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:51 <urbanecm@deploy1002> Finished scap: c131f32e5e0804c8f5c2ec768b334c81a1b35151: Add namespace translations for [ami] Amis and [pwn] Paiwan (T292414, T292415) (duration: 02m 25s) [production]
11:49 <urbanecm@deploy1002> Started scap: c131f32e5e0804c8f5c2ec768b334c81a1b35151: Add namespace translations for [ami] Amis and [pwn] Paiwan (T292414, T292415) [production]
11:13 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
11:13 <urbanecm@deploy1002> Synchronized logos/config.yaml: 575a6a66b279c3d2d8974ffcc4911cc5b927be47: Fix HD logo size in some wikis (T250731; 2/2) (duration: 00m 55s) [production]
11:13 <urbanecm@deploy1002> Synchronized static/images/project-logos/: 575a6a66b279c3d2d8974ffcc4911cc5b927be47: Fix HD logo size in some wikis (T250731; 1/2) (duration: 00m 57s) [production]
11:09 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:46 <jbond> upload cas_6.4.2-1+wmf10u2_amd64.deb [production]
10:40 <mvernon@cumin2002> conftool action : set/pooled=true; selector: name=codfw,dnsdisc=swift [production]
10:39 <mvernon@cumin2002> conftool action : set/pooled=true; selector: name=codfw,dnsdisc=swift-ro [production]
10:09 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:07 <oblivian@deploy1002> Synchronized tests/WmfConfigServicesTest.php: Switching back graphite to eqiad (duration: 00m 55s) [production]
10:06 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
10:06 <oblivian@deploy1002> Synchronized wmf-config/ProductionServices.php: Switching back graphite to eqiad (duration: 01m 04s) [production]
09:49 <godog> bounce superset on an-tool1005 to pick up statsd changes - T247963 [production]
09:49 <godog> bounce superset on an-tool1010 to pick up statsd changes - T247963 [production]
09:47 <godog> bounce navtiming on webperf1001 to pick up statsd changes - T247963 [production]
09:40 <godog> flip back write traffic to graphite1004 (all but mediawiki) - T247963 [production]
09:27 <godog> move read traffic back to graphite1004 - T247963 [production]
08:37 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
08:33 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
08:33 <ema> upload varnish_6.0.8-1wm2 to component/varnish6 on apt.wm.org T293879 [production]
08:31 <urbanecm@deploy1002> Synchronized php-1.38.0-wmf.5/extensions/GrowthExperiments/maintenance: 91316ed5714c4426a29fefded5c4db08dbba48bb: Add purgeExpiredMentorStatus.php (T280307) (duration: 00m 56s) [production]
08:24 <mwdebug-deploy@deploy1002> helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
08:21 <mwdebug-deploy@deploy1002> helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . [production]
07:21 <elukey@deploy1002> helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-articlequality' for release 'main' . [production]
07:07 <effie> pool mw1319 and mw1312 [production]
07:05 <effie> pool wtp1026.eqiad.wmnet [production]
06:36 <marostegui@cumin1001> dbctl commit (dc=all): 'db1109 (re)pooling @ 100%: After upgrade', diff saved to https://phabricator.wikimedia.org/P17606 and previous config saved to /var/cache/conftool/dbconfig/20211026-063647-root.json [production]