5001-5050 of 10000 results (50ms)
2023-05-05 §
18:25 <brennen> train 1.41.0-wmf.7 (T330213): trying revert for T336008, T336022 [production]
2023-05-04 §
20:57 <brennen@deploy1002> Synchronized php: group1 wikis to 1.41.0-wmf.7 refs T330213 (duration: 06m 02s) [production]
20:51 <brennen@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.41.0-wmf.7 refs T330213 [production]
18:16 <brennen@deploy1002> rebuilt and synchronized wikiversions files: group2 wikis to 1.41.0-wmf.7 refs T330213 [production]
18:08 <brennen> train 1.41.0-wmf.7 (T330213): logs fairly quiet and no current blockers, rolling to group2 [production]
04:47 <ryankemper@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on 6 hosts with reason: Rolling reboot for T335835 [production]
04:47 <ryankemper@cumin1001> START - Cookbook sre.hosts.downtime for 4:00:00 on 6 hosts with reason: Rolling reboot for T335835 [production]
04:39 <ryankemper@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on relforge[1003-1004].eqiad.wmnet with reason: Rolling reboot T335835 [production]
04:38 <ryankemper@cumin1001> START - Cookbook sre.hosts.downtime for 4:00:00 on relforge[1003-1004].eqiad.wmnet with reason: Rolling reboot T335835 [production]
04:30 <ryankemper@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on 50 hosts with reason: Rolling reboot of eqiad for T335835 [production]
04:29 <ryankemper@cumin1001> START - Cookbook sre.hosts.downtime for 4:00:00 on 50 hosts with reason: Rolling reboot of eqiad for T335835 [production]
2023-05-03 §
18:22 <brennen@deploy1002> Synchronized php: group1 wikis to 1.41.0-wmf.7 refs T330213 (duration: 06m 18s) [production]
18:16 <brennen@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.41.0-wmf.7 refs T330213 [production]
18:08 <brennen> train 1.41.0-wmf.7 (T330213): logs quiet and no current blockers, rolling to group1 [production]
11:02 <marostegui> Reboot dbproxy200[1-4] [production]
09:44 <marostegui@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 4:00:00 on db1110.eqiad.wmnet with reason: Moving to m3 T335092 [production]
09:44 <marostegui@cumin1001> START - Cookbook sre.hosts.downtime for 4 days, 4:00:00 on db1110.eqiad.wmnet with reason: Moving to m3 T335092 [production]
07:58 <marostegui@cumin1001> dbctl commit (dc=all): 'db1213:3316 (re)pooling @ 4%: Pooling db1213:3316 T326669', diff saved to https://phabricator.wikimedia.org/P47308 and previous config saved to /var/cache/conftool/dbconfig/20230503-075828-root.json [production]
07:58 <marostegui@cumin1001> dbctl commit (dc=all): 'db1213:3315 (re)pooling @ 4%: Pooling db1213:3315 T326669', diff saved to https://phabricator.wikimedia.org/P47307 and previous config saved to /var/cache/conftool/dbconfig/20230503-075818-root.json [production]
2023-05-02 §
18:11 <brennen@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.41.0-wmf.7 refs T330213 [production]
18:03 <brennen> train 1.41.0-wmf.7 (T330213): (correction: group0 today) [production]
18:01 <brennen> train 1.41.0-wmf.7 (T330213): no current blockers, rolling to group1 with `scap train` [production]
03:54 <mwpresync@deploy1002> Pruned MediaWiki: 1.41.0-wmf.5 (duration: 02m 17s) [production]
03:51 <mwpresync@deploy1002> Finished scap: testwikis wikis to 1.41.0-wmf.7 refs T330213 (duration: 49m 21s) [production]
03:02 <mwpresync@deploy1002> Started scap: testwikis wikis to 1.41.0-wmf.7 refs T330213 [production]
2023-04-27 §
18:47 <jhuneidi@deploy1002> rebuilt and synchronized wikiversions files: group2 wikis to 1.41.0-wmf.6 refs T330212 [production]
15:29 <krinkle@deploy1002> Synchronized wmf-config/mc.php: Ia174ea2b0645 (duration: 06m 05s) [production]
11:41 <krinkle@deploy1002> Synchronized wmf-config/: I195978cbd61d80 (duration: 06m 29s) [production]
09:29 <moritzm> imported wmf-certificates to bookworm-wikimedia T330495 [production]
2023-04-26 §
18:16 <jhuneidi@deploy1002> Synchronized php: group1 wikis to 1.41.0-wmf.6 refs T330212 (duration: 06m 04s) [production]
18:10 <jhuneidi@deploy1002> rebuilt and synchronized wikiversions files: group1 wikis to 1.41.0-wmf.6 refs T330212 [production]
2023-04-25 §
18:18 <jhuneidi@deploy1002> rebuilt and synchronized wikiversions files: group0 wikis to 1.41.0-wmf.6 refs T330212 [production]
15:02 <inflatador> [WDQS Deploy] Restarted `wdqs-updater` across all hosts, 4 hosts at a time: `sudo -E cumin -b 4 'A:wdqs-all' 'systemctl restart wdqs-updater'` [production]
03:52 <mwpresync@deploy2002> Pruned MediaWiki: 1.41.0-wmf.4 (duration: 02m 06s) [production]
03:50 <mwpresync@deploy2002> Finished scap: testwikis wikis to 1.41.0-wmf.6 refs T330212 (duration: 48m 05s) [production]
03:02 <mwpresync@deploy2002> Started scap: testwikis wikis to 1.41.0-wmf.6 refs T330212 [production]
2023-04-24 §
09:55 <slyngs> Update LDAP schema wmf-user: T148048 [production]
2023-04-21 §
12:18 <duesen> reverted monky-patch, mwdebug2001 and deploy2002 are back to wmf/1.41.0-wmf.5 (T335183) [production]
2023-04-20 §
08:17 <jnuche@deploy2002> rebuilt and synchronized wikiversions files: all wikis to 1.41.0-wmf.5 refs T330211 [production]
00:02 <mutante> LDAP - adding uid fnavas-foundation to group wmf - T331482 [production]
2023-04-19 §
15:34 <pt1979@cumin2002> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add DNS for dns200[4-6] - pt1979@cumin2002" [production]
15:33 <pt1979@cumin2002> START - Cookbook sre.puppet.sync-netbox-hiera generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: Add DNS for dns200[4-6] - pt1979@cumin2002" [production]
08:45 <marostegui@cumin1001> dbctl commit (dc=all): 'db1113:3316 (re)pooling @ 4%: Repooling', diff saved to https://phabricator.wikimedia.org/P47232 and previous config saved to /var/cache/conftool/dbconfig/20230419-084545-root.json [production]
08:37 <marostegui@cumin1001> dbctl commit (dc=all): 'db1113:3315 (re)pooling @ 4%: Repooling', diff saved to https://phabricator.wikimedia.org/P47229 and previous config saved to /var/cache/conftool/dbconfig/20230419-083717-root.json [production]
08:24 <jnuche@deploy2002> Synchronized php: group1 wikis to 1.41.0-wmf.5 refs T330211 (duration: 05m 43s) [production]
08:18 <jnuche@deploy2002> rebuilt and synchronized wikiversions files: group1 wikis to 1.41.0-wmf.5 refs T330211 [production]
07:22 <marostegui@cumin1001> dbctl commit (dc=all): 'db1219 (re)pooling @ 4%: Pooling', diff saved to https://phabricator.wikimedia.org/P47212 and previous config saved to /var/cache/conftool/dbconfig/20230419-072228-root.json [production]
06:53 <marostegui@cumin1001> dbctl commit (dc=all): 'db1212 (re)pooling @ 4%: Pooling', diff saved to https://phabricator.wikimedia.org/P47207 and previous config saved to /var/cache/conftool/dbconfig/20230419-065317-root.json [production]
2023-04-18 §
08:38 <jnuche@deploy2002> rebuilt and synchronized wikiversions files: group0 wikis to 1.41.0-wmf.5 refs T330211 [production]
07:20 <zabe@deploy2002> scap failed: CalledProcessError Command '/usr/local/bin/mwscript mergeMessageFileList.php --wiki=aawiki --force-version "1.41.0-wmf.4" --list-file="/srv/mediawiki-staging/wmf-config/extension-list" --output="/tmp/tmp.8ZJFnr01rx"' returned non-zero exit status 255. (duration: 00m 00s) [production]