|
2021-10-26
ยง
|
| 19:16 |
<cmjohnson@cumin1001> |
END (FAIL) - Cookbook sre.hosts.reimage (exit_code=99) for host cloudcephosd1021.eqiad.wmnet with OS bullseye |
[production] |
| 19:12 |
<twentyafterfour@deploy1002> |
Started scap: testwikis wikis to 1.38.0-wmf.6 refs T293947 |
[production] |
| 18:47 |
<cmjohnson@cumin1001> |
START - Cookbook sre.hosts.reimage for host cloudcephosd1021.eqiad.wmnet with OS bullseye |
[production] |
| 17:52 |
<ryankemper@deploy1002> |
Finished deploy [wdqs/wdqs@e908052] (wcqs): Deploy 0.3.90 to WCQS (duration: 01m 34s) |
[production] |
| 17:50 |
<ryankemper@deploy1002> |
Started deploy [wdqs/wdqs@e908052] (wcqs): Deploy 0.3.90 to WCQS |
[production] |
| 17:09 |
<ryankemper@deploy1002> |
Finished deploy [wdqs/wdqs@e908052] (wcqs): Deploy 0.3.90 to WCQS (duration: 02m 37s) |
[production] |
| 17:06 |
<ryankemper@deploy1002> |
Started deploy [wdqs/wdqs@e908052] (wcqs): Deploy 0.3.90 to WCQS |
[production] |
| 17:05 |
<ryankemper@deploy1002> |
Finished deploy [wdqs/wdqs@e908052] (wcqs): Deploy 0.3.90 to WCQS (duration: 1100m 51s) |
[production] |
| 16:25 |
<cdanis@cumin1001> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
| 16:25 |
<cdanis@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
| 16:24 |
<mutante> |
[mwmaint1002:~] $ sudo systemctl start mediawiki_job_wikidata_resubmit_changes_for_dispatch |
[production] |
| 16:23 |
<mutante> |
mwmaint1002 - running puppet, created new mw periodic job from gerrit:732972 (T294031) |
[production] |
| 16:07 |
<cmooney@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 16:04 |
<cmooney@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 15:45 |
<lucaswerkmeister-wmde@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . |
[production] |
| 15:41 |
<lucaswerkmeister-wmde@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'production' . |
[production] |
| 15:38 |
<lucaswerkmeister-wmde@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'changeprop-jobqueue' for release 'staging' . |
[production] |
| 15:27 |
<cdanis@cumin1001> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
| 15:27 |
<cdanis@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
| 15:07 |
<topranks> |
Running homer against cr3-esams to create new temp GRE tunnel to asw1-b12-drmrs |
[production] |
| 15:02 |
<cdanis@cumin1001> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
| 15:02 |
<cdanis@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
| 14:55 |
<topranks> |
Adding static route on cr3-esams to asw1-b12-drmrs Telia link IP to allow GRE to be built. |
[production] |
| 13:50 |
<elukey> |
ran "Capirca Host Definition" script on netbox - output https://netbox.wikimedia.org/extras/scripts/results/1787315/ |
[production] |
| 13:45 |
<urbanecm@deploy1002> |
Synchronized php-1.38.0-wmf.5/extensions/Wikibase: 7723cf724df9ede49129443e43336e93efcd7a41: RecentChangeFactory: Add missing rc_logid value (T293885) (duration: 01m 02s) |
[production] |
| 13:40 |
<elukey> |
ran "Capirca Host Definition" script on netbox-next to get up-to-date aqs_group host definition - result https://netbox-next.wikimedia.org/extras/scripts/results/894348/ |
[production] |
| 13:24 |
<kart_> |
Updated cxserver to 2021-10-25-123807-production (T217747, T218217, T292421) |
[production] |
| 13:19 |
<kartik@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'cxserver' for release 'production' . |
[production] |
| 13:13 |
<kartik@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'cxserver' for release 'production' . |
[production] |
| 13:05 |
<kartik@deploy1002> |
helmfile [staging] Ran 'sync' command on namespace 'cxserver' for release 'staging' . |
[production] |
| 13:05 |
<hashar@deploy1002> |
Pruned MediaWiki: 1.38.0-wmf.4 (duration: 31m 07s) |
[production] |
| 12:35 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 12:35 |
<hashar> |
scap clean --delete 1.38.0-wmf.4 # T293947 |
[production] |
| 12:32 |
<hashar> |
Applied security patches to 1.38.0-wmf.6 # T293947 |
[production] |
| 12:32 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 12:31 |
<hashar> |
scap prep 1.38.0-wmf.6 # T293947 |
[production] |
| 12:16 |
<jbond> |
upload cas_6.4.2-1+wmf10u3_amd64 |
[production] |
| 12:07 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 12:04 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 11:55 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 11:52 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 11:51 |
<urbanecm@deploy1002> |
Finished scap: c131f32e5e0804c8f5c2ec768b334c81a1b35151: Add namespace translations for [ami] Amis and [pwn] Paiwan (T292414, T292415) (duration: 02m 25s) |
[production] |
| 11:49 |
<urbanecm@deploy1002> |
Started scap: c131f32e5e0804c8f5c2ec768b334c81a1b35151: Add namespace translations for [ami] Amis and [pwn] Paiwan (T292414, T292415) |
[production] |
| 11:13 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 11:13 |
<urbanecm@deploy1002> |
Synchronized logos/config.yaml: 575a6a66b279c3d2d8974ffcc4911cc5b927be47: Fix HD logo size in some wikis (T250731; 2/2) (duration: 00m 55s) |
[production] |
| 11:13 |
<urbanecm@deploy1002> |
Synchronized static/images/project-logos/: 575a6a66b279c3d2d8974ffcc4911cc5b927be47: Fix HD logo size in some wikis (T250731; 1/2) (duration: 00m 57s) |
[production] |
| 11:09 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 10:46 |
<jbond> |
upload cas_6.4.2-1+wmf10u2_amd64.deb |
[production] |
| 10:40 |
<mvernon@cumin2002> |
conftool action : set/pooled=true; selector: name=codfw,dnsdisc=swift |
[production] |
| 10:39 |
<mvernon@cumin2002> |
conftool action : set/pooled=true; selector: name=codfw,dnsdisc=swift-ro |
[production] |