2021-05-24
§
|
06:49 |
<majavah> |
remove scfc kubernetes admin access after bd808 removed tools.admin membership to avoid maintain-kubeusers crashes when it expires |
[tools] |
06:19 |
<legoktm> |
reloaded zuul for https://gerrit.wikimedia.org/r/693639 |
[releng] |
05:27 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1149 - schema change', diff saved to https://phabricator.wikimedia.org/P16159 and previous config saved to /var/cache/conftool/dbconfig/20210524-052747-marostegui.json |
[production] |
05:13 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1142 (re)pooling @ 100%: Repool db1142', diff saved to https://phabricator.wikimedia.org/P16158 and previous config saved to /var/cache/conftool/dbconfig/20210524-051345-root.json |
[production] |
05:09 |
<legoktm> |
restarting mailman3 on lists1001, bounce runner crashed |
[production] |
04:58 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1142 (re)pooling @ 75%: Repool db1142', diff saved to https://phabricator.wikimedia.org/P16157 and previous config saved to /var/cache/conftool/dbconfig/20210524-045841-root.json |
[production] |
04:43 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1142 (re)pooling @ 50%: Repool db1142', diff saved to https://phabricator.wikimedia.org/P16156 and previous config saved to /var/cache/conftool/dbconfig/20210524-044337-root.json |
[production] |
04:38 |
<marostegui@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db1135.eqiad.wmnet with reason: Schema change |
[production] |
04:38 |
<marostegui@cumin1001> |
START - Cookbook sre.hosts.downtime for 5:00:00 on db1135.eqiad.wmnet with reason: Schema change |
[production] |
04:36 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1135', diff saved to https://phabricator.wikimedia.org/P16155 and previous config saved to /var/cache/conftool/dbconfig/20210524-043654-marostegui.json |
[production] |
04:28 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'db1142 (re)pooling @ 25%: Repool db1142', diff saved to https://phabricator.wikimedia.org/P16154 and previous config saved to /var/cache/conftool/dbconfig/20210524-042834-root.json |
[production] |
2021-05-23
§
|
23:20 |
<bd808> |
Removed scfc from co-maintainers (monitoring emails bouncing) |
[tools.admin] |
21:17 |
<wm-bot> |
<bd808> Add #wikipedia-nl freenode<->libera.chat (T283430) |
[tools.bridgebot] |
16:09 |
<bd808> |
Added majavah as co-maintainer |
[tools.bridgebot] |
14:25 |
<urbanecm@deploy1002> |
Synchronized wmf-config/InitialiseSettings.php: EMERGENCY: f752f8b80c57a5b7e41b91873b3eac388535ac46: enwiktionary: Raise AF emergency disable treshold+count (T283460) (duration: 00m 57s) |
[production] |
10:17 |
<wm-bot> |
<lucaswerkmeister> deployed ab07154319 (restore batch links on index, working around Chromium layout issue) |
[tools.ranker] |
10:04 |
<wm-bot> |
<lucaswerkmeister> rolled back to dc734361cf (layout issues in Chromium, investigating) |
[tools.ranker] |
09:57 |
<wm-bot> |
<lucaswerkmeister> deployed ffa1c2a5a8 (batch mode on index page) |
[tools.ranker] |
09:52 |
<wm-bot> |
<lucaswerkmeister> deployed dc734361cf (only mypy comments but restarted the webservice anyways just in case) |
[tools.ranker] |
08:19 |
<legoktm> |
added tgr as project admin |
[mailman] |
01:45 |
<bstorm> |
manually pulling updated singleuser images because I hate waiting to test things |
[paws] |
01:36 |
<bstorm> |
update latest tag for singleuser image to b894471 for https://github.com/toolforge/paws/pull/69 |
[paws] |
00:56 |
<bstorm> |
deploying changes for https://github.com/toolforge/paws/pull/67 |
[paws] |
2021-05-22
§
|
22:13 |
<legoktm> |
reset 2FA for User:Yuvipanda on wikitech |
[production] |
22:05 |
<wm-bot> |
<lucaswerkmeister> pulled 11922d2df5 (README update, no webservice restart) |
[tools.translate-link] |
22:04 |
<wm-bot> |
<lucaswerkmeister> pulled efa1cecac0 (README update, no webservice restart) |
[tools.ranker] |
21:38 |
<wm-bot> |
<lucaswerkmeister> deployed d829336d71 (“show” mode and other improvements) |
[tools.translate-link] |
21:21 |
<wm-bot> |
<poslovitch> Mom, am I really on TV? |
[tools.lingua-libre-bot] |
21:20 |
<wm-bot> |
<poslovitch> Mom, am I really on TV? |
[tools.lingua-libre-bot] |
21:07 |
<ryankemper> |
[WDQS] Pooled `wdqs1006` (caught up on lag), de-pooled `wdqs1013` (8 hours) |
[production] |
20:58 |
<wm-bot> |
<jeanfred> Deploy 258aae9a |
[tools.integraality] |
20:57 |
<wm-bot> |
<jeanfred> Deploy 67c42f43 |
[tools.integraality] |
20:57 |
<wm-bot> |
<jeanfred> Deploy d170ea1 |
[tools.integraality] |
20:24 |
<wm-bot> |
<jeanfred> Deploy 2f39621 |
[tools.integraality] |
20:21 |
<wm-bot> |
<jeanfred> Deploy b52079f |
[tools.integraality] |
19:34 |
<wm-bot> |
<legoktm> dologmsg now logs to LiberaChat relay! |
[tools.admin] |
17:28 |
<wm-bot> |
<jeanfred> Deploy 8ffbad82c3 (T279236) |
[tools.integraality] |
16:57 |
<wm-bot> |
<jeanfred> Deploy 6de2308 and c436760 (T279236) |
[tools.integraality] |
16:53 |
<wm-bot> |
<lucaswerkmeister> deployed 1b957ac4e0 (more robust message matching) |
[tools.translate-link] |
16:35 |
<urbanecm> |
[urbanecm@mwmaint1002 ~]$ mwscript deleteEqualMessages.php cswiki --delete |
[production] |
16:06 |
<wm-bot> |
<jeanfred> Deploy 0966be04 (T279236) |
[tools.integraality] |
15:59 |
<wm-bot> |
<jeanfred> Deploy 9727a01c |
[tools.integraality] |
14:52 |
<wm-bot> |
<lucaswerkmeister> deployed 2e020b7d3e (first version with useful index page; first-ever version was about twenty minutes earlier, forgot to log it) |
[tools.translate-link] |
14:47 |
<majavah> |
manually remove jeh admin certificates and from maintain-kubeusers configmap T282725 |
[tools] |
14:33 |
<wm-bot> |
<peterbowman> Migrate webservice to k8s (445ea07) |
[tools.pbbot] |
14:32 |
<majavah> |
manually remove valhallasw yuvipanda admin certificates and from configmap and restart maintain-kubeusers pod T282725 |
[tools] |
14:02 |
<wm-bot> |
<jeanfred> Deploy 69048ef |
[tools.integraality] |
13:00 |
<wm-bot> |
<jeanfred> Deploy 633eeb0f |
[tools.integraality] |
12:59 |
<wm-bot> |
<jeanfred> Deploy d4fa363 (T283287) |
[tools.integraality] |
10:32 |
<wm-bot> |
<lucaswerkmeister> deployed 38b8f68887 (cross-links between batch modes) |
[tools.ranker] |