|
2020-06-24
ยง
|
| 20:41 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.38 |
[production] |
| 20:41 |
<brennen> |
train 1.35.0-wmf.38: attempting to roll forward to group1 after php-fpm restart on mw1287 (T256305, T254175) |
[production] |
| 20:32 |
<cdanis> |
restarting php-fpm on mw1287 T256305 |
[production] |
| 20:32 |
<bsitzmann@deploy1001> |
helmfile [CODFW] Ran 'sync' command on namespace 'mobileapps' for release 'production' . |
[production] |
| 20:30 |
<bsitzmann@deploy1001> |
helmfile [EQIAD] Ran 'sync' command on namespace 'mobileapps' for release 'production' . |
[production] |
| 20:28 |
<bsitzmann@deploy1001> |
helmfile [STAGING] Ran 'sync' command on namespace 'mobileapps' for release 'staging' . |
[production] |
| 20:14 |
<halfak@deploy1001> |
Finished deploy [ores/deploy@1b87365]: T254505 (duration: 14m 08s) |
[production] |
| 20:09 |
<bsitzmann@deploy1001> |
Finished deploy [mobileapps/deploy@80c763d]: Update mobileapps to a413db4f (duration: 03m 37s) |
[production] |
| 20:06 |
<bsitzmann@deploy1001> |
Started deploy [mobileapps/deploy@80c763d]: Update mobileapps to a413db4f |
[production] |
| 20:00 |
<halfak@deploy1001> |
Started deploy [ores/deploy@1b87365]: T254505 |
[production] |
| 19:38 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Revert Migrate SearchSatisfaction from EventLogging to EventGate on group1 - T249261 (duration: 01m 06s) |
[production] |
| 19:17 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: Revert group1 wikis to 1.35.0-wmf.37 |
[production] |
| 19:11 |
<brennen@deploy1001> |
Synchronized php: group1 wikis to 1.35.0-wmf.38 (duration: 01m 04s) |
[production] |
| 19:10 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.38 |
[production] |
| 19:01 |
<brennen> |
train 1.35.0-wmf.38: finished triage meeting, clear to proceed to group 1 (T254175) |
[production] |
| 18:53 |
<joal@deploy1001> |
Finished deploy [analytics/refinery@1112749] (thin): Regular analytics weekly train THIN [analytics/refinery@1112749] (duration: 00m 09s) |
[production] |
| 18:53 |
<joal@deploy1001> |
Started deploy [analytics/refinery@1112749] (thin): Regular analytics weekly train THIN [analytics/refinery@1112749] |
[production] |
| 18:53 |
<joal@deploy1001> |
Finished deploy [analytics/refinery@1112749]: Regular analytics weekly train [analytics/refinery@1112749] (duration: 05m 50s) |
[production] |
| 18:49 |
<Urbanecm> |
Morning B&C deploy window is done |
[production] |
| 18:48 |
<cstone> |
payments-wiki revision changed from 28ad76dcd7 to 91852dbc9b |
[production] |
| 18:47 |
<Urbanecm> |
mwscript namespaceDupes.php --wiki=guwiki --fix (T255358) |
[production] |
| 18:47 |
<joal@deploy1001> |
Started deploy [analytics/refinery@1112749]: Regular analytics weekly train [analytics/refinery@1112749] |
[production] |
| 18:46 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: 2a1dfc5: Set namespace aliases for guwiki (T255358) (duration: 01m 05s) |
[production] |
| 18:42 |
<Urbanecm> |
mwscript namespaceDupes.php --wiki=banwiki --add-prefix=T255941 --fix (T255941) |
[production] |
| 18:41 |
<Urbanecm> |
Run mwscript namespaceDupes.php --wiki=banwiki --fix (T255941) |
[production] |
| 18:41 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: c6d6c85: Set WP as a NS_PROJECT alias for banwiki (T255941) (duration: 01m 06s) |
[production] |
| 18:38 |
<Urbanecm> |
Run mwscript namespaceDupes.php dewiktionary --fix (T256242) |
[production] |
| 18:38 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: 2b93e0f: Define Rekonstruktion NS for dewiktionary (T256242) (duration: 01m 05s) |
[production] |
| 18:29 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: dea9214: Revert "IS: Cleanup some redundant rows." (T256279) (duration: 01m 05s) |
[production] |
| 18:25 |
<ppchelko@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: EventBus: Emit kafka purges for everything gerrit:607298 (duration: 01m 05s) |
[production] |
| 18:19 |
<ppchelko@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Enable MediaModeration on group0 gerrit:607327 (duration: 01m 04s) |
[production] |
| 18:08 |
<ppchelko@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Enable click tracking in Vector on beta cluster gerrit:607136 IS.php (duration: 01m 05s) |
[production] |
| 18:06 |
<ppchelko@deploy1001> |
Synchronized wmf-config/InitialiseSettings-labs.php: Enable click tracking in Vector on beta cluster gerrit:607136 IS-labs.php (duration: 01m 07s) |
[production] |
| 17:31 |
<elukey> |
update archiva-ci user's password in Jenkins credentials plugin |
[production] |
| 16:56 |
<elukey> |
update archiva-deploy user's password in Jenkins credentials plugin |
[production] |
| 16:46 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@5f08f32]: Release PCS endpoints updates, feeds timed out, redo (duration: 05m 11s) |
[production] |
| 16:41 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@5f08f32]: Release PCS endpoints updates, feeds timed out, redo |
[production] |
| 16:40 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@5f08f32]: Release PCS endpoints updates, take 2 (duration: 14m 11s) |
[production] |
| 16:34 |
<brennen@deploy1001> |
Finished scap: (no justification provided) (duration: 60m 22s) |
[production] |
| 16:30 |
<elukey@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 16:27 |
<elukey@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 16:26 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@5f08f32]: Release PCS endpoints updates, take 2 |
[production] |
| 16:17 |
<elukey> |
reimage db1108 to debian Buster - T234826 |
[production] |
| 15:53 |
<ppchelko@deploy1001> |
Finished deploy [restbase/deploy@386b736]: Revert (duration: 27m 21s) |
[production] |
| 15:38 |
<brennen> |
previous scap sync for T256151 - [[gerrit:607379]] and [[gerrit:607380]] |
[production] |
| 15:36 |
<kormat@cumin1001> |
dbctl commit (dc=all): 'Pool db1088 @ 100% into s6 T255927', diff saved to https://phabricator.wikimedia.org/P11652 and previous config saved to /var/cache/conftool/dbconfig/20200624-153604-kormat.json |
[production] |
| 15:34 |
<brennen@deploy1001> |
Started scap: (no justification provided) |
[production] |
| 15:25 |
<ppchelko@deploy1001> |
Started deploy [restbase/deploy@386b736]: Revert |
[production] |
| 15:24 |
<ppchelko@deploy1001> |
deploy aborted: Release updates to PCS endpoints (duration: 05m 04s) |
[production] |
| 15:20 |
<jayme> |
rolling restart of swift-proxy on thanos-fe[2001-2003].codfw.wmnet,thanos-fe[1001-1003].eqiad.wmnet - T256020 |
[production] |