1751-1800 of 10000 results (32ms)
2024-09-04 §
17:52 <dancy@deploy1003> Started scap sync-world: testwikis to 1.43.0-wmf.21 refs T373640 [production]
17:16 <dancy@deploy1003> rebuilt and synchronized wikiversions files: group0 to 1.43.0-wmf.21 refs T373640 [production]
16:13 <swfrench-wmf> running homer 'cr*codfw*' commit 'T374018' [production]
10:37 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2218.codfw.wmnet with reason: Maintenance [production]
10:36 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db2218.codfw.wmnet with reason: Maintenance [production]
09:48 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
09:48 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1181.eqiad.wmnet with reason: Maintenance [production]
08:36 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1170.eqiad.wmnet with reason: Maintenance [production]
08:36 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1170.eqiad.wmnet with reason: Maintenance [production]
07:56 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db2214.codfw.wmnet with reason: Maintenance [production]
07:56 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db2214.codfw.wmnet with reason: Maintenance [production]
07:10 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1173.eqiad.wmnet with reason: Maintenance [production]
07:09 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1173.eqiad.wmnet with reason: Maintenance [production]
2024-09-03 §
21:42 <swfrench-wmf> running homer 'cr*codfw*' commit 'T372878' [production]
21:31 <swfrench-wmf> running homer 'lsw1-b3-codfw*' commit 'T372878' [production]
20:44 <swfrench-wmf> running homer 'lsw1-b3-codfw*' commit 'T372878' [production]
19:06 <dancy@deploy1003> Finished scap sync-world: testwikis to 1.43.0-wmf.21 refs T373640 (duration: 08m 11s) [production]
18:58 <dancy@deploy1003> Started scap sync-world: testwikis to 1.43.0-wmf.21 refs T373640 [production]
18:13 <dancy@deploy1003> rebuilt and synchronized wikiversions files: group0 to 1.43.0-wmf.21 refs T373640 [production]
08:56 <jnuche@deploy1003> Finished scap sync-world: testwikis to 1.43.0-wmf.21 refs T373640 (duration: 45m 42s) [production]
08:10 <jnuche@deploy1003> Started scap sync-world: testwikis to 1.43.0-wmf.21 refs T373640 [production]
07:57 <moritzm> move LDAP user cn=ncreasy from cn=nda to cn=wmf [production]
04:00 <mwpresync@deploy1003> Pruned MediaWiki: 1.43.0-wmf.18 (duration: 00m 47s) [production]
2024-09-02 §
07:33 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1206 (re)pooling @ 4%: post replag depool', diff saved to https://phabricator.wikimedia.org/P68510 and previous config saved to /var/cache/conftool/dbconfig/20240902-073306-arnaudb.json [production]
06:35 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1206.eqiad.wmnet with reason: replag [production]
06:35 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1206.eqiad.wmnet with reason: replag [production]
2024-08-30 §
16:59 <swfrench-wmf> running homer 'cr*codfw*' commit 'T372878' [production]
16:40 <swfrench-wmf> running homer 'lsw1-b3-codfw*' commit 'T372878' [production]
16:21 <claime> flipping BGP flag to true in netbox for ml-serve-ctrl100[1-2],ml-serve100[1-4],dse-k8s-ctrl100[1-2],dse-k8s-worker100[1-4] [production]
2024-08-29 §
08:41 <hashar@deploy1003> rebuilt and synchronized wikiversions files: group2 to 1.43.0-wmf.20 refs T366965 [production]
2024-08-28 §
22:23 <swfrench-wmf> running homer 'cr*codfw*' commit 'T372878' [production]
22:14 <swfrench-wmf> running homer 'lsw1-b3-codfw*' commit 'T372878' [production]
08:37 <hashar@deploy1003> rebuilt and synchronized wikiversions files: group1 to 1.43.0-wmf.20 refs T366965 [production]
2024-08-27 §
22:15 <swfrench-wmf> running homer 'cr*codfw*' commit 'T372878' [production]
22:07 <swfrench-wmf> pooled / uncordoned wikikube-worker2046.codfw.wmnet - T372878 [production]
22:04 <swfrench-wmf> Running homer 'lsw1-a8-codfw*' commit 'T372878' [production]
12:18 <hashar@deploy1003> rebuilt and synchronized wikiversions files: group0 to 1.43.0-wmf.20 refs T366965 [production]
11:20 <hashar@deploy1003> Finished scap sync-world: testwikis to 1.43.0-wmf.20 refs T366965 (duration: 47m 15s) [production]
10:33 <hashar@deploy1003> Started scap sync-world: testwikis to 1.43.0-wmf.20 refs T366965 [production]
10:26 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1161 (re)pooling @ 4%: post upgrade repooling', diff saved to https://phabricator.wikimedia.org/P67877 and previous config saved to /var/cache/conftool/dbconfig/20240827-102638-arnaudb.json [production]
10:16 <hashar@deploy1003> scap failed: CalledProcessError Command '/usr/local/bin/mwscript rebuildLocalisationCache.php --wiki=aawiki --force-version "1.43.0-wmf.20" --no-progress --store-class=LCStoreCDB --threads=22 --lang en --quiet ' returned non-zero exit status 1. (duration: 00m 02s) [production]
10:16 <hashar@deploy1003> Started scap sync-world: testwikis to 1.43.0-wmf.20 refs T366965 [production]
10:13 <hashar@deploy1003> scap failed: PermissionError [Errno 13] Permission denied: '/srv/mediawiki-staging/php-1.43.0-wmf.20/cache/gitinfo' (duration: 00m 00s) [production]
10:13 <hashar@deploy1003> Started scap sync-world: testwikis to 1.43.0-wmf.20 refs T366965 [production]
10:06 <hashar@deploy1003> scap failed: CalledProcessError Command '/usr/local/bin/mwscript rebuildLocalisationCache.php --wiki=aawiki --force-version "1.43.0-wmf.20" --no-progress --store-class=LCStoreCDB --threads=22 --lang en --quiet ' returned non-zero exit status 1. (duration: 00m 02s) [production]
10:06 <hashar@deploy1003> Started scap sync-world: testwikis to 1.43.0-wmf.20 refs T366965 [production]
09:25 <hashar> train: fast forwarded mediawiki/core wmf/1.43.0-wmf.20 from 1faf18d6570 to ef87455d7c3 # T366965 [production]
04:01 <mwpresync@deploy1003> Pruned MediaWiki: 1.43.0-wmf.17 (duration: 01m 28s) [production]
2024-08-26 §
22:36 <swfrench-wmf> running homer 'cr*codfw*' commit 'T372878' (remove old BGP session config for kubernetes2018, kubernetes2025) [production]
22:12 <swfrench-wmf> ran homer 'lsw1-a8-codfw*' commit 'T372878' [production]