1151-1200 of 10000 results (36ms)
2025-01-15 §
10:01 <marostegui@cumin1002> dbctl commit (dc=all): 'es1043 (re)pooling @ 4%: Repooling', diff saved to https://phabricator.wikimedia.org/P72058 and previous config saved to /var/cache/conftool/dbconfig/20250115-100138-root.json [production]
2025-01-14 §
21:48 <swfrench-wmf> deployed conftool 4.2.0 fleet-wide as of ~ 20:00 UTC (previously 4.1.0) [production]
19:29 <brennen@deploy2002> rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.12 refs T382363 [production]
19:12 <brennen> 1.44.0-wmf.12 train (T382363): no current blockers, rolling to group0 [production]
17:36 <swfrench-wmf> continuing shellbox-syntaxhighlight pilot on PHP 8.1 (all eqiad replicas) - T377038 [production]
17:15 <swfrench-wmf> starting shellbox-syntaxhighlight pilot on PHP 8.1 (1 replica, eqiad only) - T377038 [production]
12:41 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2212 gradually with 4 steps - Maint over [production]
11:55 <ladsgroup@cumin1002> START - Cookbook sre.mysql.pool db2212 gradually with 4 steps - Maint over [production]
10:17 <marostegui@cumin1002> dbctl commit (dc=all): 'es1044 (re)pooling @ 4%: Pooling for the first time', diff saved to https://phabricator.wikimedia.org/P72034 and previous config saved to /var/cache/conftool/dbconfig/20250114-101732-root.json [production]
05:03 <mwpresync@deploy2002> Pruned MediaWiki: 1.44.0-wmf.6 (duration: 03m 06s) [production]
04:54 <mwpresync@deploy2002> Finished scap sync-world: testwikis to 1.44.0-wmf.12 refs T382363 (duration: 50m 57s) [production]
04:03 <mwpresync@deploy2002> Started scap sync-world: testwikis to 1.44.0-wmf.12 refs T382363 [production]
2025-01-13 §
12:18 <reedy@deploy2002> Synchronized php-1.44.0-wmf.11/extensions/UploadWizard/: T383415 (duration: 13m 05s) [production]
2025-01-10 §
13:54 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1170.eqiad.wmnet with reason: maintenance [production]
13:54 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1170.eqiad.wmnet with reason: maintenance [production]
2025-01-09 §
19:34 <dduvall@deploy2002> rebuilt and synchronized wikiversions files: group2 to 1.44.0-wmf.11 refs T382362 [production]
16:40 <dduvall@deploy2002> rebuilt and synchronized wikiversions files: group1 to 1.44.0-wmf.11 refs T382362 [production]
10:37 <marostegui@cumin1002> dbctl commit (dc=all): 'db2231 (re)pooling @ 4%: Repooling for the first time', diff saved to https://phabricator.wikimedia.org/P71927 and previous config saved to /var/cache/conftool/dbconfig/20250109-103723-root.json [production]
07:13 <marostegui@cumin1002> dbctl commit (dc=all): 'es1042 (re)pooling @ 4%: Repooling for the first time', diff saved to https://phabricator.wikimedia.org/P71903 and previous config saved to /var/cache/conftool/dbconfig/20250109-071305-root.json [production]
2025-01-08 §
20:05 <dduvall@deploy2002> rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.11 refs T382362 [production]
19:54 <dduvall> rolling back wmf.11 to group0 due to `Table 'commonswiki.file' doesn't exist` errors [production]
19:29 <dduvall@deploy2002> rebuilt and synchronized wikiversions files: group1 to 1.44.0-wmf.11 refs T382362 [production]
14:31 <marostegui@cumin1002> dbctl commit (dc=all): 'db2228 (re)pooling @ 4%: Repooling for the first time', diff saved to https://phabricator.wikimedia.org/P71878 and previous config saved to /var/cache/conftool/dbconfig/20250108-143126-root.json [production]
12:15 <marostegui@cumin1002> dbctl commit (dc=all): 'db2226 (re)pooling @ 4%: Repooling for the first time', diff saved to https://phabricator.wikimedia.org/P71857 and previous config saved to /var/cache/conftool/dbconfig/20250108-121512-root.json [production]
08:53 <marostegui@cumin1002> dbctl commit (dc=all): 'es1041 (re)pooling @ 4%: Repooling for the first time', diff saved to https://phabricator.wikimedia.org/P71844 and previous config saved to /var/cache/conftool/dbconfig/20250108-085344-root.json [production]
2025-01-07 §
19:36 <dduvall@deploy2002> rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.11 refs T382362 [production]
17:26 <dzahn@cumin2002> END (PASS) - Cookbook sre.idm.logout (exit_code=0) Logging Muhammad Jaziraly out of all services on: 4 hosts [production]
17:26 <dzahn@cumin2002> START - Cookbook sre.idm.logout Logging Muhammad Jaziraly out of all services on: 4 hosts [production]
04:51 <mwpresync@deploy2002> Finished scap sync-world: testwikis to 1.44.0-wmf.11 refs T382362 (duration: 48m 35s) [production]
04:02 <mwpresync@deploy2002> Started scap sync-world: testwikis to 1.44.0-wmf.11 refs T382362 [production]
2025-01-03 §
07:36 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4 days, 0:00:00 on db1193.eqiad.wmnet with reason: maintenance [production]
07:36 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 4 days, 0:00:00 on db1193.eqiad.wmnet with reason: maintenance [production]
2025-01-02 §
10:56 <marostegui> dbmaint codfw Decommissioned dbproxy200[1-4] m1 m2 m3 m5 T381962 [production]
10:56 <marostegui> dbmaint codfw Decommissioned dbproxy200[1-4] T381962 [production]
2024-12-24 §
05:01 <mwpresync@deploy2002> Pruned MediaWiki: 1.44.0-wmf.5 (duration: 01m 21s) [production]
2024-12-23 §
21:54 <zabe@deploy2002> scap failed: <CalledProcessError> Command 'sudo -u mwbuilder /srv/mwbuilder/release/make-container-image/build-images.py /srv/mediawiki-staging/scap/image-build --staging-dir /srv/mediawiki-staging --mediawiki-versions 1.44.0-wmf.8 --multiversion-image-name docker-registry.discovery.wmnet/restricted/mediawiki-multiversion --multiversion-debug-image-name docker-registry.discovery.wmnet/restricted/media [production]
2024-12-19 §
19:12 <dancy@deploy2002> rebuilt and synchronized wikiversions files: group2 to 1.44.0-wmf.8 refs T375667 [production]
2024-12-18 §
19:28 <dancy@deploy2002> rebuilt and synchronized wikiversions files: group1 to 1.44.0-wmf.8 refs T375667 [production]
2024-12-17 §
19:29 <dancy@deploy2002> rebuilt and synchronized wikiversions files: group0 to 1.44.0-wmf.8 refs T375667 [production]
16:22 <swfrench-wmf> deployed shellbox 2024-12-17-061932 for T292322 [production]
04:03 <mwpresync@deploy2002> Started scap sync-world: testwikis to 1.44.0-wmf.8 refs T375667 [production]
01:33 <swfrench-wmf> deployed shellbox-video to pick up config change for T292322 [production]
2024-12-12 §
13:36 <marostegui@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1169.eqiad.wmnet with reason: Maintenance [production]
13:36 <marostegui@cumin1002> START - Cookbook sre.hosts.downtime for 4:00:00 on db1169.eqiad.wmnet with reason: Maintenance [production]
11:08 <cmooney@cumin1002> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: update Homer wmf-plugin - cmooney@cumin1002 [production]
11:07 <cmooney@cumin1002> START - Cookbook sre.deploy.python-code homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: update Homer wmf-plugin - cmooney@cumin1002 [production]
11:04 <cmooney@cumin1002> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: update Homer wmf-plugin - cmooney@cumin1002 [production]
11:03 <cmooney@cumin1002> START - Cookbook sre.deploy.python-code homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: update Homer wmf-plugin - cmooney@cumin1002 [production]
10:48 <cmooney@cumin1002> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: update Homer wmf-plugin - cmooney@cumin1002 [production]
10:44 <cmooney@cumin1002> START - Cookbook sre.deploy.python-code homer to cumin2002.codfw.wmnet,cumin1002.eqiad.wmnet with reason: update Homer wmf-plugin - cmooney@cumin1002 [production]