4351-4400 of 10000 results (35ms)
2024-03-18 §
20:22 <urbanecm@deploy2002> Finished scap: Backport for [[gerrit:1011454|Throttle: add event (T360357)]], [[gerrit:1012425|[phase 4] Projects with < 50 user scripts no longer share skin scripts (T301212)]] (duration: 16m 26s) [production]
20:08 <urbanecm@deploy2002> rhinosf1 and urbanecm and jdlrobson: Backport for [[gerrit:1011454|Throttle: add event (T360357)]], [[gerrit:1012425|[phase 4] Projects with < 50 user scripts no longer share skin scripts (T301212)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
20:05 <urbanecm@deploy2002> Started scap: Backport for [[gerrit:1011454|Throttle: add event (T360357)]], [[gerrit:1012425|[phase 4] Projects with < 50 user scripts no longer share skin scripts (T301212)]] [production]
14:05 <jmm@cumin2002> END (PASS) - Cookbook sre.misc-clusters.roll-restart-restbase (exit_code=0) rolling restart_daemons on P{restbase102[4-5]*} and A:restbase [production]
14:04 <jmm@cumin2002> START - Cookbook sre.misc-clusters.roll-restart-restbase rolling restart_daemons on P{restbase102[4-5]*} and A:restbase [production]
08:37 <root@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging PEarley (WMF) out of all services on: 2210 hosts [production]
08:37 <root@cumin2002> START - Cookbook sre.idm.logout Logging PEarley (WMF) out of all services on: 2210 hosts [production]
2024-03-14 §
21:21 <mutante> LDAP - removed kcv-wikimf from group wmf (T358658) [production]
19:14 <reedy@deploy2002> Synchronized wmf-config/CommonSettings.php: T303135 (duration: 12m 24s) [production]
15:28 <Lucas_WMDE> STOP persistRevisionThreadItems on viwiki for T315510, restarting to pick up wmf.22 [production]
09:23 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group2 wikis to 1.42.0-wmf.22 refs T354440 [production]
04:23 <tstarling@deploy2002> Synchronized wmf-config/CommonSettings.php: reverting for now due to slow query T355034 (duration: 12m 28s) [production]
2024-03-13 §
16:01 <hashar@deploy2002> Synchronized php: group1 wikis to 1.42.0-wmf.22 refs T354440 (duration: 11m 46s) [production]
15:49 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group1 wikis to 1.42.0-wmf.22 refs T354440 [production]
10:26 <hashar@deploy2002> rebuilt and synchronized wikiversions files: Revert "group1 wikis to 1.42.0-wmf.22" - T354440 T360014 [production]
09:42 <hashar@deploy2002> Synchronized php: group1 wikis to 1.42.0-wmf.22 refs T354440 (duration: 12m 18s) [production]
09:30 <hashar@deploy2002> rebuilt and synchronized wikiversions files: group1 wikis to 1.42.0-wmf.22 refs T354440 [production]
2024-03-12 §
09:47 <jnuche@deploy2002> rebuilt and synchronized wikiversions files: group0 wikis to 1.42.0-wmf.22 refs T354440 [production]
09:10 <eoghan@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on gitlab1004.wikimedia.org with reason: Silencing alerts for switchover prep [production]
09:10 <eoghan@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on gitlab1004.wikimedia.org with reason: Silencing alerts for switchover prep [production]
09:10 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2210 (re)pooling @ 4%: Post clone', diff saved to https://phabricator.wikimedia.org/P58735 and previous config saved to /var/cache/conftool/dbconfig/20240312-091026-arnaudb.json [production]
09:10 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2209 (re)pooling @ 4%: Post clone', diff saved to https://phabricator.wikimedia.org/P58734 and previous config saved to /var/cache/conftool/dbconfig/20240312-091025-arnaudb.json [production]
08:52 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2205 (re)pooling @ 4%: Post clone', diff saved to https://phabricator.wikimedia.org/P58728 and previous config saved to /var/cache/conftool/dbconfig/20240312-085215-arnaudb.json [production]
08:52 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2206 (re)pooling @ 4%: Post clone', diff saved to https://phabricator.wikimedia.org/P58727 and previous config saved to /var/cache/conftool/dbconfig/20240312-085214-arnaudb.json [production]
08:52 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2208 (re)pooling @ 4%: Post clone', diff saved to https://phabricator.wikimedia.org/P58726 and previous config saved to /var/cache/conftool/dbconfig/20240312-085214-arnaudb.json [production]
04:02 <mwpresync@deploy2002> Finished scap: testwikis wikis to 1.42.0-wmf.22 refs T354440 (duration: 56m 47s) [production]
03:06 <mwpresync@deploy2002> Started scap: testwikis wikis to 1.42.0-wmf.22 refs T354440 [production]
03:03 <mwpresync@deploy2002> Pruned MediaWiki: 1.42.0-wmf.19 (duration: 03m 24s) [production]
2024-03-11 §
14:51 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1179 (re)pooling @ 4%: Post upgrade', diff saved to https://phabricator.wikimedia.org/P58707 and previous config saved to /var/cache/conftool/dbconfig/20240311-145111-arnaudb.json [production]
2024-03-08 §
10:30 <fabfur@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on cp4037.ulsfo.wmnet with reason: T358109 [production]
10:30 <fabfur@cumin2002> START - Cookbook sre.hosts.downtime for 4:00:00 on cp4037.ulsfo.wmnet with reason: T358109 [production]
2024-03-07 §
16:20 <jnuche@deploy2002> rebuilt and synchronized wikiversions files: group2 wikis to 1.42.0-wmf.21 refs T354439 [production]
14:33 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on clouddb[1016,1020-1021].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
14:33 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on clouddb[1016,1020-1021].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
11:23 <jnuche@deploy2002> Synchronized php: group1 wikis to 1.42.0-wmf.21 refs T354439 (duration: 10m 13s) [production]
11:13 <jnuche@deploy2002> rebuilt and synchronized wikiversions files: group1 wikis to 1.42.0-wmf.21 refs T354439 [production]
09:18 <jnuche@deploy2002> rebuilt and synchronized wikiversions files: group2 wikis to 1.42.0-wmf.21 refs T354439 [production]
2024-03-06 §
13:27 <jnuche@deploy2002> rebuilt and synchronized wikiversions files: group1 wikis to 1.42.0-wmf.21 refs T354439 [production]
2024-03-05 §
14:44 <jnuche@deploy2002> rebuilt and synchronized wikiversions files: group0 wikis to 1.42.0-wmf.21 refs T354439 [production]
14:35 <fabfur@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on dns2004.wikimedia.org with reason: T355873 [production]
14:35 <fabfur@cumin2002> START - Cookbook sre.hosts.downtime for 4:00:00 on dns2004.wikimedia.org with reason: T355873 [production]
14:31 <jnuche@deploy2002> Finished scap: testwikis wikis to 1.42.0-wmf.21 refs T354439 (duration: 42m 08s) [production]
13:49 <jnuche@deploy2002> Started scap: testwikis wikis to 1.42.0-wmf.21 refs T354439 [production]
11:30 <jnuche@deploy2002> sync-world aborted: testwikis wikis to 1.42.0-wmf.21 refs T354439 (duration: 34m 15s) [production]
10:56 <jnuche@deploy2002> Started scap: testwikis wikis to 1.42.0-wmf.21 refs T354439 [production]
10:53 <jnuche@deploy2002> Pruned MediaWiki: 1.42.0-wmf.18 (duration: 03m 25s) [production]
2024-03-04 §
15:44 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on db2132.codfw.wmnet with reason: Silence for maintenance [production]
15:43 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4 days, 0:00:00 on db2132.codfw.wmnet with reason: Silence for maintenance [production]
2024-03-01 §
20:40 <mutante> phabricator - added to WMF-NDA (group 61): Loren Johnson, Jonathan Fraine, Kris Litson, Lena Meintrup (all WMDE staff appearing in NDA spreadsheet) T358578 [production]
20:35 <mutante> phabricator - added to WMF-NDA (group 61): Aline Bruenger, Corinna Hillebrand, Kai Nissen, Christoph Jauera (all WMDE staff appearing in NDA spreadsheet) T358578 [production]