951-1000 of 10000 results (87ms)
2025-07-16 §
02:19 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2228 (T399249)', diff saved to https://phabricator.wikimedia.org/P79152 and previous config saved to /var/cache/conftool/dbconfig/20250716-021956-marostegui.json [production]
02:19 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2228.codfw.wmnet with reason: Maintenance [production]
02:19 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2223 (T399249)', diff saved to https://phabricator.wikimedia.org/P79151 and previous config saved to /var/cache/conftool/dbconfig/20250716-021933-marostegui.json [production]
02:04 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2223', diff saved to https://phabricator.wikimedia.org/P79150 and previous config saved to /var/cache/conftool/dbconfig/20250716-020426-marostegui.json [production]
01:49 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2223', diff saved to https://phabricator.wikimedia.org/P79149 and previous config saved to /var/cache/conftool/dbconfig/20250716-014918-marostegui.json [production]
01:34 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2223 (T399249)', diff saved to https://phabricator.wikimedia.org/P79148 and previous config saved to /var/cache/conftool/dbconfig/20250716-013410-marostegui.json [production]
01:06 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2223 (T399249)', diff saved to https://phabricator.wikimedia.org/P79147 and previous config saved to /var/cache/conftool/dbconfig/20250716-010617-marostegui.json [production]
01:06 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2223.codfw.wmnet with reason: Maintenance [production]
01:05 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2211 (T399249)', diff saved to https://phabricator.wikimedia.org/P79146 and previous config saved to /var/cache/conftool/dbconfig/20250716-010554-marostegui.json [production]
00:50 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2211', diff saved to https://phabricator.wikimedia.org/P79145 and previous config saved to /var/cache/conftool/dbconfig/20250716-005047-marostegui.json [production]
00:35 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2211', diff saved to https://phabricator.wikimedia.org/P79144 and previous config saved to /var/cache/conftool/dbconfig/20250716-003539-marostegui.json [production]
00:20 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2211 (T399249)', diff saved to https://phabricator.wikimedia.org/P79143 and previous config saved to /var/cache/conftool/dbconfig/20250716-002031-marostegui.json [production]
2025-07-15 §
23:52 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2211 (T399249)', diff saved to https://phabricator.wikimedia.org/P79142 and previous config saved to /var/cache/conftool/dbconfig/20250715-235236-marostegui.json [production]
23:52 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2211.codfw.wmnet with reason: Maintenance [production]
23:26 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2201.codfw.wmnet with reason: Maintenance [production]
23:26 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2192 (T399249)', diff saved to https://phabricator.wikimedia.org/P79141 and previous config saved to /var/cache/conftool/dbconfig/20250715-232640-marostegui.json [production]
23:11 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2192', diff saved to https://phabricator.wikimedia.org/P79139 and previous config saved to /var/cache/conftool/dbconfig/20250715-231132-marostegui.json [production]
22:56 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2192', diff saved to https://phabricator.wikimedia.org/P79138 and previous config saved to /var/cache/conftool/dbconfig/20250715-225624-marostegui.json [production]
22:50 <zabe@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-experimental: apply [production]
22:49 <zabe@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-experimental: apply [production]
22:41 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2192 (T399249)', diff saved to https://phabricator.wikimedia.org/P79137 and previous config saved to /var/cache/conftool/dbconfig/20250715-224117-marostegui.json [production]
22:27 <swfrench-wmf> reprepro include php-excimer_1.2.5-1+wmf11u1 php-imagick_3.7.0-13+wmf11u1 php-luasandbox_4.1.2-1+wmf11u1 php-memcached_3.3.0-1+wmf11u1 php-pcov_1.0.12-1+wmf11u1 php-redis_6.2.0-1+wmf11u1 php-uuid_1.3.0-1+wmf11u1 php-wmerrors_2.0.0-1+wmf11u1 php-yaml_2.2.4-1+wmf11u1 wikidiff2_1.14.1-2+wmf11u1 xdebug_3.4.4-1+wmf11u1 in component/php83 - T398245 [production]
22:20 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1169777|extension-list: Undeploy Interwiki (step 3) (T399636)]] (duration: 08m 17s) [production]
22:16 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2192 (T399249)', diff saved to https://phabricator.wikimedia.org/P79136 and previous config saved to /var/cache/conftool/dbconfig/20250715-221606-marostegui.json [production]
22:15 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2192.codfw.wmnet with reason: Maintenance [production]
22:15 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178 (T399249)', diff saved to https://phabricator.wikimedia.org/P79135 and previous config saved to /var/cache/conftool/dbconfig/20250715-221543-marostegui.json [production]
22:15 <zabe@deploy1003> zabe: Continuing with sync [production]
22:14 <zabe@deploy1003> zabe: Backport for [[gerrit:1169777|extension-list: Undeploy Interwiki (step 3) (T399636)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
22:12 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1169777|extension-list: Undeploy Interwiki (step 3) (T399636)]] [production]
22:00 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178', diff saved to https://phabricator.wikimedia.org/P79134 and previous config saved to /var/cache/conftool/dbconfig/20250715-220036-marostegui.json [production]
21:57 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1169776|IS: Undeploy Interwiki (step 2) (T399636)]] (duration: 08m 42s) [production]
21:52 <zabe@deploy1003> zabe: Continuing with sync [production]
21:51 <zabe@deploy1003> zabe: Backport for [[gerrit:1169776|IS: Undeploy Interwiki (step 2) (T399636)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:49 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1169776|IS: Undeploy Interwiki (step 2) (T399636)]] [production]
21:45 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178', diff saved to https://phabricator.wikimedia.org/P79133 and previous config saved to /var/cache/conftool/dbconfig/20250715-214528-marostegui.json [production]
21:40 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1169775|CS: Undeploy Interwiki (step 1) (T399636)]] (duration: 08m 55s) [production]
21:35 <zabe@deploy1003> zabe: Continuing with sync [production]
21:33 <zabe@deploy1003> zabe: Backport for [[gerrit:1169775|CS: Undeploy Interwiki (step 1) (T399636)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:31 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1169775|CS: Undeploy Interwiki (step 1) (T399636)]] [production]
21:30 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178 (T399249)', diff saved to https://phabricator.wikimedia.org/P79132 and previous config saved to /var/cache/conftool/dbconfig/20250715-213021-marostegui.json [production]
21:28 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd2007-dev.codfw.wmnet with OS bullseye [production]
21:17 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1169765|Also join linktarget on namespace to allow index usage]], [[gerrit:1169766|Also join linktarget on namespace to allow index usage]] (duration: 08m 12s) [production]
21:12 <zabe@deploy1003> zabe: Continuing with sync [production]
21:11 <zabe@deploy1003> zabe: Backport for [[gerrit:1169765|Also join linktarget on namespace to allow index usage]], [[gerrit:1169766|Also join linktarget on namespace to allow index usage]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:10 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd2007-dev.codfw.wmnet with reason: host reimage [production]
21:09 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1169765|Also join linktarget on namespace to allow index usage]], [[gerrit:1169766|Also join linktarget on namespace to allow index usage]] [production]
21:07 <eileen> civicrm upgraded from 521d0dbe to 71b58ed5 [production]
21:07 <eileen> civicrm upgraded from 521d0dbe to 71b58ed5 [production]
21:06 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd2007-dev.codfw.wmnet with reason: host reimage [production]
21:05 <eevans@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aqs1012.eqiad.wmnet with OS bullseye [production]