|
2021-10-26
ยง
|
| 15:07 |
<topranks> |
Running homer against cr3-esams to create new temp GRE tunnel to asw1-b12-drmrs |
[production] |
| 15:02 |
<cdanis@cumin1001> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
| 15:02 |
<cdanis@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
| 14:55 |
<topranks> |
Adding static route on cr3-esams to asw1-b12-drmrs Telia link IP to allow GRE to be built. |
[production] |
| 13:50 |
<elukey> |
ran "Capirca Host Definition" script on netbox - output https://netbox.wikimedia.org/extras/scripts/results/1787315/ |
[production] |
| 13:45 |
<urbanecm@deploy1002> |
Synchronized php-1.38.0-wmf.5/extensions/Wikibase: 7723cf724df9ede49129443e43336e93efcd7a41: RecentChangeFactory: Add missing rc_logid value (T293885) (duration: 01m 02s) |
[production] |
| 13:40 |
<elukey> |
ran "Capirca Host Definition" script on netbox-next to get up-to-date aqs_group host definition - result https://netbox-next.wikimedia.org/extras/scripts/results/894348/ |
[production] |
| 13:24 |
<kart_> |
Updated cxserver to 2021-10-25-123807-production (T217747, T218217, T292421) |
[production] |
| 13:19 |
<kartik@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'cxserver' for release 'production' . |
[production] |
| 13:13 |
<kartik@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'cxserver' for release 'production' . |
[production] |
| 13:05 |
<kartik@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'cxserver' for release 'staging' . |
[production] |
| 13:05 |
<hashar@deploy1002> |
Pruned MediaWiki: 1.38.0-wmf.4 (duration: 31m 07s) |
[production] |
| 12:35 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 12:35 |
<hashar> |
scap clean --delete 1.38.0-wmf.4 # T293947 |
[production] |
| 12:32 |
<hashar> |
Applied security patches to 1.38.0-wmf.6 # T293947 |
[production] |
| 12:32 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 12:31 |
<hashar> |
scap prep 1.38.0-wmf.6 # T293947 |
[production] |
| 12:16 |
<jbond> |
upload cas_6.4.2-1+wmf10u3_amd64 |
[production] |
| 12:07 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 12:04 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 11:55 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 11:52 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 11:51 |
<urbanecm@deploy1002> |
Finished scap: c131f32e5e0804c8f5c2ec768b334c81a1b35151: Add namespace translations for [ami] Amis and [pwn] Paiwan (T292414, T292415) (duration: 02m 25s) |
[production] |
| 11:49 |
<urbanecm@deploy1002> |
Started scap: c131f32e5e0804c8f5c2ec768b334c81a1b35151: Add namespace translations for [ami] Amis and [pwn] Paiwan (T292414, T292415) |
[production] |
| 11:13 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 11:13 |
<urbanecm@deploy1002> |
Synchronized logos/config.yaml: 575a6a66b279c3d2d8974ffcc4911cc5b927be47: Fix HD logo size in some wikis (T250731; 2/2) (duration: 00m 55s) |
[production] |
| 11:13 |
<urbanecm@deploy1002> |
Synchronized static/images/project-logos/: 575a6a66b279c3d2d8974ffcc4911cc5b927be47: Fix HD logo size in some wikis (T250731; 1/2) (duration: 00m 57s) |
[production] |
| 11:09 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 10:46 |
<jbond> |
upload cas_6.4.2-1+wmf10u2_amd64.deb |
[production] |
| 10:40 |
<mvernon@cumin2002> |
conftool action : set/pooled=true; selector: name=codfw,dnsdisc=swift |
[production] |
| 10:39 |
<mvernon@cumin2002> |
conftool action : set/pooled=true; selector: name=codfw,dnsdisc=swift-ro |
[production] |
| 10:09 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 10:07 |
<oblivian@deploy1002> |
Synchronized tests/WmfConfigServicesTest.php: Switching back graphite to eqiad (duration: 00m 55s) |
[production] |
| 10:06 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 10:06 |
<oblivian@deploy1002> |
Synchronized wmf-config/ProductionServices.php: Switching back graphite to eqiad (duration: 01m 04s) |
[production] |
| 09:49 |
<godog> |
bounce superset on an-tool1005 to pick up statsd changes - T247963 |
[production] |
| 09:49 |
<godog> |
bounce superset on an-tool1010 to pick up statsd changes - T247963 |
[production] |
| 09:47 |
<godog> |
bounce navtiming on webperf1001 to pick up statsd changes - T247963 |
[production] |
| 09:40 |
<godog> |
flip back write traffic to graphite1004 (all but mediawiki) - T247963 |
[production] |
| 09:27 |
<godog> |
move read traffic back to graphite1004 - T247963 |
[production] |
| 08:37 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 08:33 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 08:33 |
<ema> |
upload varnish_6.0.8-1wm2 to component/varnish6 on apt.wm.org T293879 |
[production] |
| 08:31 |
<urbanecm@deploy1002> |
Synchronized php-1.38.0-wmf.5/extensions/GrowthExperiments/maintenance: 91316ed5714c4426a29fefded5c4db08dbba48bb: Add purgeExpiredMentorStatus.php (T280307) (duration: 00m 56s) |
[production] |
| 08:24 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 08:21 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 07:21 |
<elukey@deploy1002> |
helmfile [ml-serve-eqiad] Ran 'sync' command on namespace 'revscoring-articlequality' for release 'main' . |
[production] |
| 07:07 |
<effie> |
pool mw1319 and mw1312 |
[production] |
| 07:05 |
<effie> |
pool wtp1026.eqiad.wmnet |
[production] |
| 06:36 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1109 (re)pooling @ 100%: After upgrade', diff saved to https://phabricator.wikimedia.org/P17606 and previous config saved to /var/cache/conftool/dbconfig/20211026-063647-root.json |
[production] |