|
2021-08-17
§
|
| 07:59 |
<mutante> |
mw1384 - start failed ferm service |
[production] |
| 07:59 |
<jelto@cumin1001> |
conftool action : set/weight=30; selector: name=mw1450.eqiad.wmnet |
[production] |
| 07:52 |
<mutante> |
mw1451 through mw1455 - fresh hardware pooled the first time as appservers |
[production] |
| 07:50 |
<dzahn@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw145[1-5].eqiad.wmnet |
[production] |
| 07:49 |
<dzahn@cumin1001> |
conftool action : set/pooled=no; selector: name=mw145[1-5].eqiad.wmnet |
[production] |
| 07:48 |
<dzahn@cumin1001> |
conftool action : set/weight=30; selector: name=mw145[1-5].eqiad.wmnet |
[production] |
| 07:44 |
<marostegui> |
Drop aft_feedback tables on x1 T250715 |
[production] |
| 07:39 |
<jelto@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw1450.eqiad.wmnet |
[production] |
| 07:39 |
<jelto@cumin1001> |
conftool action : set/pooled=yes; selector: name=mw144[7-9].eqiad.wmnet |
[production] |
| 06:57 |
<tstarling@deploy1002> |
Synchronized php-1.37.0-wmf.18/extensions/SecurePoll/includes/Entities/Election.php: T288924 (duration: 00m 57s) |
[production] |
| 06:56 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 06:55 |
<tstarling@deploy1002> |
Synchronized php-1.37.0-wmf.18/extensions/SecurePoll/cli/dump.php: T288924 (duration: 00m 58s) |
[production] |
| 06:54 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 05:59 |
<TimStarling> |
foreachwikiindblist securepollglobal mysql.php --write -- -e 'insert into securepoll_properties (pr_entity,pr_key,pr_value) select el_entity,'\''mobile-jump-url'\'','\''https://vote.m.wikimedia.org/wiki/Special:SecurePoll'\'' from securepoll_elections where el_title='\''DWalden STV Election Test 456'\'' limit 1;' |
[production] |
| 05:47 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 05:43 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 05:37 |
<tstarling@deploy1002> |
Finished scap: collected SecurePoll maintenance scripts and bug fix (duration: 04m 12s) |
[production] |
| 05:36 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 05:35 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 05:33 |
<tstarling@deploy1002> |
Started scap: collected SecurePoll maintenance scripts and bug fix |
[production] |
| 05:28 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 05:27 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 03:11 |
<eileen> |
civicrm revision changed from 175a3101f7 to 66568246a2, config revision is 7bdc78073d |
[production] |
| 02:39 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 02:37 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 02:05 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 02:04 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 00:44 |
<eileen> |
civicrm revision changed from ba0c7705bb to 175a3101f7, config revision is 7bdc78073d |
[production] |
| 00:14 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 00:12 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 00:07 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: eccdd3ed3fda1abee9a4c57719afd0d1faae41c3: Growth mentor dashboard: Enable on testwiki (T278920) (duration: 00m 59s) |
[production] |
|
2021-08-16
§
|
| 23:20 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 23:20 |
<urbanecm> |
Evening B&C window done |
[production] |
| 23:19 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 23:18 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: a14868bbdf442eede5711576c4b4da51df0ccd77: Enable NewUserMessage on hiwiktionary (T287091) (duration: 01m 00s) |
[production] |
| 23:15 |
<eileen> |
civicrm revision changed from 1e32084622 to ba0c7705bb, config revision is 7bdc78073d |
[production] |
| 22:13 |
<bblack> |
dns[1235]002: upgrade gdnsd package to 3.8.0-1~wmf1 |
[production] |
| 21:31 |
<bblack> |
authdns1001: upgrade gdnsd package to 3.8.0-1~wmf1 |
[production] |
| 21:28 |
<bblack> |
dns4002: upgrade gdnsd package to 3.8.0-1~wmf1 |
[production] |
| 20:38 |
<bstorm@cumin1001> |
END (PASS) - Cookbook wmcs.wikireplicas.add_wiki (exit_code=0) |
[production] |
| 20:38 |
<bstorm@cumin1001> |
Added views for new wiki: labswiki T287442 |
[production] |
| 20:37 |
<bstorm@cumin1001> |
START - Cookbook wmcs.wikireplicas.add_wiki |
[production] |
| 20:36 |
<bstorm@cumin1001> |
END (FAIL) - Cookbook wmcs.wikireplicas.add_wiki (exit_code=99) |
[production] |
| 20:36 |
<bstorm@cumin1001> |
START - Cookbook wmcs.wikireplicas.add_wiki |
[production] |
| 20:35 |
<bstorm@cumin1001> |
END (FAIL) - Cookbook wmcs.wikireplicas.add_wiki (exit_code=99) |
[production] |
| 20:35 |
<bstorm@cumin1001> |
START - Cookbook wmcs.wikireplicas.add_wiki |
[production] |
| 18:48 |
<dancy> |
Restarted Jenkins due to stuck jobs. |
[production] |
| 18:17 |
<cmjohnson@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 18:15 |
<cmjohnson@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 17:52 |
<cmjohnson@cumin1001> |
END (FAIL) - Cookbook sre.hosts.downtime (exit_code=99) for 2:00:00 on mw1453.eqiad.wmnet with reason: REIMAGE |
[production] |