|
2021-10-07
ยง
|
| 21:35 |
<urbanecm> |
Password reset for SUL User:LA2-bot (T292793) |
[production] |
| 20:43 |
<brennen@deploy1002> |
rebuilt and synchronized wikiversions files: all wikis to 1.38.0-wmf.3 |
[production] |
| 20:37 |
<brennen@deploy1002> |
rebuilt and synchronized wikiversions files: all wikis to 1.38.0-wmf.2 refs T281167 |
[production] |
| 20:35 |
<cmooney@cumin1001> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
| 20:35 |
<cmooney@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
| 20:23 |
<krinkle@deploy1002> |
Synchronized php-1.38.0-wmf.3/extensions/Gadgets/: I7c858b8c4bc (duration: 00m 56s) |
[production] |
| 20:01 |
<urbanecm@deploy1002> |
Synchronized php-1.38.0-wmf.3/extensions/Echo/: 8a7ff05ba28f302adb581bf430a868bb815b4ffd: Revert "Use namespaced CentralAuthSessionProvider" (duration: 00m 57s) |
[production] |
| 19:45 |
<urbanecm@deploy1002> |
Synchronized php-1.38.0-wmf.3/extensions/CentralAuth/: c01c2e4983bad8582ddd62aeb35ac9be852d493b: Revert "Namespace session providers" (duration: 00m 57s) |
[production] |
| 19:44 |
<urbanecm> |
Backporting https://gerrit.wikimedia.org/r/c/mediawiki/extensions/CentralAuth/+/727489, https://gerrit.wikimedia.org/r/c/mediawiki/extensions/Echo/+/727487 in an unsafe way -- exceptions at testwikis expected, wmf.3 is not deployed elsewhere, so this should be ok |
[production] |
| 19:37 |
<brennen@deploy1002> |
rebuilt and synchronized wikiversions files: Revert all wikis to 1.38.0-wmf.2 (T281167) |
[production] |
| 19:33 |
<brennen> |
1.38.0-wmf.3 train (T281167): variously blocked, rolling back to testwikis for safe deploy of backports |
[production] |
| 19:14 |
<brennen@deploy1002> |
rebuilt and synchronized wikiversions files: Revert group2 wikis to 1.38.0-wmf.2 |
[production] |
| 19:07 |
<brennen@deploy1002> |
rebuilt and synchronized wikiversions files: all wikis to 1.38.0-wmf.3 refs T281167 |
[production] |
| 19:03 |
<brennen> |
1.38.0-wmf.3 train (T281167): unblocked, rolling to all wikis |
[production] |
| 18:50 |
<urbanecm> |
[urbanecm@mwmaint1002 /srv/mediawiki/php]$ mwscript extensions/GrowthExperiments/maintenance/initWikiConfig.php --wiki=test2wiki |
[production] |
| 18:46 |
<sukhe> |
running authdns-update for T292537 |
[production] |
| 18:29 |
<urbanecm> |
Morning B&C window done |
[production] |
| 18:28 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 4a946c046ae17a520f8d3463a16b1435ceb4856c: Deploy Growth mentor dashboard to pilot wikis (T278920) (duration: 01m 04s) |
[production] |
| 18:23 |
<urbanecm@deploy1002> |
Synchronized dblists/growthexperiments.dblist: 87e300137c14451949fac12c3ec89319305a423e: Deploy Growth features to test2wiki (duration: 01m 03s) |
[production] |
| 18:21 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 87e300137c14451949fac12c3ec89319305a423e: Deploy Growth features to test2wiki (duration: 01m 04s) |
[production] |
| 18:20 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 31770f2b3660e7d7490c0a9ab66285c1f069732d: shwiki: Deploy Growth features to newcomers (T278240) (duration: 01m 04s) |
[production] |
| 18:15 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: 33526dfed148068585289f5ac501feda72068fd9: Stream config changes for android_daily_stats schema (T286000) (duration: 01m 06s) |
[production] |
| 18:10 |
<ejegg> |
updated payments-wiki from 6d3560d083 to 030b11da1a |
[production] |
| 18:07 |
<arnoldokoth> |
gitlab2001 re-image complete (T283076) |
[production] |
| 17:30 |
<mutante> |
rebooting gitlab2001.wikimedia.org |
[production] |
| 16:56 |
<arnoldokoth> |
down timing gitlab2001 for re-imaging (T283076) |
[production] |
| 16:47 |
<dzahn@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on gitlab2001.wikimedia.org with reason: reimage |
[production] |
| 16:47 |
<dzahn@cumin1001> |
START - Cookbook sre.hosts.downtime for 2:00:00 on gitlab2001.wikimedia.org with reason: reimage |
[production] |
| 16:32 |
<hnowlan> |
roll restarting maps cassandra instances for java updates |
[production] |
| 16:19 |
<ayounsi@cumin2002> |
END (PASS) - Cookbook sre.network.cf (exit_code=0) |
[production] |
| 16:19 |
<ayounsi@cumin2002> |
START - Cookbook sre.network.cf |
[production] |
| 16:18 |
<ayounsi@cumin1001> |
END (FAIL) - Cookbook sre.network.cf (exit_code=99) |
[production] |
| 16:18 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
| 16:18 |
<ayounsi@cumin1001> |
END (FAIL) - Cookbook sre.network.cf (exit_code=99) |
[production] |
| 16:18 |
<ayounsi@cumin1001> |
START - Cookbook sre.network.cf |
[production] |
| 15:07 |
<hashar@deploy1002> |
Finished deploy [gerrit/gerrit@13cef9f]: Gerrit to 3.3.6 on gerrit1001 (duration: 00m 08s) |
[production] |
| 15:07 |
<hashar@deploy1002> |
Started deploy [gerrit/gerrit@13cef9f]: Gerrit to 3.3.6 on gerrit1001 |
[production] |
| 14:50 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 14:49 |
<hashar@deploy1002> |
Finished deploy [gerrit/gerrit@13cef9f]: Gerrit to 3.3.6 on gerrit2001 (duration: 00m 10s) |
[production] |
| 14:49 |
<hashar@deploy1002> |
Started deploy [gerrit/gerrit@13cef9f]: Gerrit to 3.3.6 on gerrit2001 |
[production] |
| 14:48 |
<hashar> |
Upgrading Gerrit replica to 3.3.6 # T290236 |
[production] |
| 14:48 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 14:34 |
<mwdebug-deploy@deploy1002> |
helmfile [codfw] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 14:31 |
<mwdebug-deploy@deploy1002> |
helmfile [eqiad] Ran 'sync' command on namespace 'mwdebug' for release 'pinkunicorn' . |
[production] |
| 13:56 |
<jiji@deploy1002> |
helmfile [eqiad] DONE helmfile.d/admin 'apply'. |
[production] |
| 13:46 |
<jiji@deploy1002> |
helmfile [eqiad] START helmfile.d/admin 'apply'. |
[production] |
| 13:39 |
<cmjohnson@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 13:30 |
<jiji@deploy1002> |
helmfile [codfw] DONE helmfile.d/admin 'apply'. |
[production] |
| 13:29 |
<jiji@deploy1002> |
helmfile [codfw] START helmfile.d/admin 'apply'. |
[production] |
| 13:29 |
<hashar> |
restarting CI Jenkins for git plugin update |
[production] |