3301-3350 of 10000 results (37ms)
2024-09-03 §
19:06 <dancy@deploy1003> Finished scap sync-world: testwikis to 1.43.0-wmf.21 refs T373640 (duration: 08m 11s) [production]
18:58 <dancy@deploy1003> Started scap sync-world: testwikis to 1.43.0-wmf.21 refs T373640 [production]
18:13 <dancy@deploy1003> rebuilt and synchronized wikiversions files: group0 to 1.43.0-wmf.21 refs T373640 [production]
08:56 <jnuche@deploy1003> Finished scap sync-world: testwikis to 1.43.0-wmf.21 refs T373640 (duration: 45m 42s) [production]
08:10 <jnuche@deploy1003> Started scap sync-world: testwikis to 1.43.0-wmf.21 refs T373640 [production]
07:57 <moritzm> move LDAP user cn=ncreasy from cn=nda to cn=wmf [production]
04:00 <mwpresync@deploy1003> Pruned MediaWiki: 1.43.0-wmf.18 (duration: 00m 47s) [production]
2024-09-02 §
07:33 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1206 (re)pooling @ 4%: post replag depool', diff saved to https://phabricator.wikimedia.org/P68510 and previous config saved to /var/cache/conftool/dbconfig/20240902-073306-arnaudb.json [production]
06:35 <arnaudb@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1206.eqiad.wmnet with reason: replag [production]
06:35 <arnaudb@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1206.eqiad.wmnet with reason: replag [production]
2024-08-30 §
16:59 <swfrench-wmf> running homer 'cr*codfw*' commit 'T372878' [production]
16:40 <swfrench-wmf> running homer 'lsw1-b3-codfw*' commit 'T372878' [production]
16:21 <claime> flipping BGP flag to true in netbox for ml-serve-ctrl100[1-2],ml-serve100[1-4],dse-k8s-ctrl100[1-2],dse-k8s-worker100[1-4] [production]
2024-08-29 §
08:41 <hashar@deploy1003> rebuilt and synchronized wikiversions files: group2 to 1.43.0-wmf.20 refs T366965 [production]
2024-08-28 §
22:23 <swfrench-wmf> running homer 'cr*codfw*' commit 'T372878' [production]
22:14 <swfrench-wmf> running homer 'lsw1-b3-codfw*' commit 'T372878' [production]
08:37 <hashar@deploy1003> rebuilt and synchronized wikiversions files: group1 to 1.43.0-wmf.20 refs T366965 [production]
2024-08-27 §
22:15 <swfrench-wmf> running homer 'cr*codfw*' commit 'T372878' [production]
22:07 <swfrench-wmf> pooled / uncordoned wikikube-worker2046.codfw.wmnet - T372878 [production]
22:04 <swfrench-wmf> Running homer 'lsw1-a8-codfw*' commit 'T372878' [production]
12:18 <hashar@deploy1003> rebuilt and synchronized wikiversions files: group0 to 1.43.0-wmf.20 refs T366965 [production]
11:20 <hashar@deploy1003> Finished scap sync-world: testwikis to 1.43.0-wmf.20 refs T366965 (duration: 47m 15s) [production]
10:33 <hashar@deploy1003> Started scap sync-world: testwikis to 1.43.0-wmf.20 refs T366965 [production]
10:26 <arnaudb@cumin1002> dbctl commit (dc=all): 'db1161 (re)pooling @ 4%: post upgrade repooling', diff saved to https://phabricator.wikimedia.org/P67877 and previous config saved to /var/cache/conftool/dbconfig/20240827-102638-arnaudb.json [production]
10:16 <hashar@deploy1003> scap failed: CalledProcessError Command '/usr/local/bin/mwscript rebuildLocalisationCache.php --wiki=aawiki --force-version "1.43.0-wmf.20" --no-progress --store-class=LCStoreCDB --threads=22 --lang en --quiet ' returned non-zero exit status 1. (duration: 00m 02s) [production]
10:16 <hashar@deploy1003> Started scap sync-world: testwikis to 1.43.0-wmf.20 refs T366965 [production]
10:13 <hashar@deploy1003> scap failed: PermissionError [Errno 13] Permission denied: '/srv/mediawiki-staging/php-1.43.0-wmf.20/cache/gitinfo' (duration: 00m 00s) [production]
10:13 <hashar@deploy1003> Started scap sync-world: testwikis to 1.43.0-wmf.20 refs T366965 [production]
10:06 <hashar@deploy1003> scap failed: CalledProcessError Command '/usr/local/bin/mwscript rebuildLocalisationCache.php --wiki=aawiki --force-version "1.43.0-wmf.20" --no-progress --store-class=LCStoreCDB --threads=22 --lang en --quiet ' returned non-zero exit status 1. (duration: 00m 02s) [production]
10:06 <hashar@deploy1003> Started scap sync-world: testwikis to 1.43.0-wmf.20 refs T366965 [production]
09:25 <hashar> train: fast forwarded mediawiki/core wmf/1.43.0-wmf.20 from 1faf18d6570 to ef87455d7c3 # T366965 [production]
04:01 <mwpresync@deploy1003> Pruned MediaWiki: 1.43.0-wmf.17 (duration: 01m 28s) [production]
2024-08-26 §
22:36 <swfrench-wmf> running homer 'cr*codfw*' commit 'T372878' (remove old BGP session config for kubernetes2018, kubernetes2025) [production]
22:12 <swfrench-wmf> ran homer 'lsw1-a8-codfw*' commit 'T372878' [production]
2024-08-23 §
15:17 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 14:00:00 on db2186.codfw.wmnet with reason: Maintenance [production]
15:17 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 4 days, 14:00:00 on db2186.codfw.wmnet with reason: Maintenance [production]
13:32 <jayme@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on kafka-main2001.codfw.wmnet with reason: Decom next week [production]
13:32 <jayme@cumin1002> START - Cookbook sre.hosts.downtime for 4 days, 0:00:00 on kafka-main2001.codfw.wmnet with reason: Decom next week [production]
2024-08-22 §
20:19 <swfrench-wmf> imported wikidiff2_1.14.1-2+wmf11u2 into component/php81 - T372507 [production]
20:18 <swfrench-wmf> imported php-wmerrors_2.0.0-1+wmf11u2 into component/php81 - T372507 [production]
20:17 <swfrench-wmf> imported php-luasandbox_4.1.2-1+wmf11u2 into component/php81 - T372507 [production]
08:16 <aklapper@deploy1003> rebuilt and synchronized wikiversions files: group2 to 1.43.0-wmf.19 refs T366964 [production]
2024-08-21 §
18:21 <swfrench-wmf> imported php-memcached_3.2.0++-1+wmf11u1 into component/php81 - T372507 [production]
18:13 <swfrench-wmf> imported php-redis_6.0.2-1+wmf11u1 into component/php81 - T372507 [production]
17:56 <swfrench-wmf> imported php-igbinary_3.2.15-1+wmf11u1 into component/php81 - T372507 [production]
17:37 <swfrench-wmf> imported xdebug_3.3.2-1+wmf11u1 into component/php81 - T372507 [production]
17:36 <swfrench-wmf> imported wikidiff2_1.14.1-2+wmf11u1 into component/php81 - T372507 [production]
17:35 <swfrench-wmf> imported tideways_5.0.4-16+wmf11u1 into component/php81 - T372507 [production]
17:34 <swfrench-wmf> imported php-yaml_2.2.3-2+wmf11u1 into component/php81 - T372507 [production]
17:34 <swfrench-wmf> imported php-wmerrors_2.0.0-1+wmf11u1 into component/php81 - T372507 [production]