1-50 of 10000 results (92ms)
2025-07-15 ยง
23:52 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2211 (T399249)', diff saved to https://phabricator.wikimedia.org/P79142 and previous config saved to /var/cache/conftool/dbconfig/20250715-235236-marostegui.json [production]
23:52 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2211.codfw.wmnet with reason: Maintenance [production]
23:26 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2201.codfw.wmnet with reason: Maintenance [production]
23:26 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2192 (T399249)', diff saved to https://phabricator.wikimedia.org/P79141 and previous config saved to /var/cache/conftool/dbconfig/20250715-232640-marostegui.json [production]
23:11 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2192', diff saved to https://phabricator.wikimedia.org/P79139 and previous config saved to /var/cache/conftool/dbconfig/20250715-231132-marostegui.json [production]
22:56 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2192', diff saved to https://phabricator.wikimedia.org/P79138 and previous config saved to /var/cache/conftool/dbconfig/20250715-225624-marostegui.json [production]
22:50 <zabe@deploy1003> helmfile [eqiad] DONE helmfile.d/services/mw-experimental: apply [production]
22:49 <zabe@deploy1003> helmfile [eqiad] START helmfile.d/services/mw-experimental: apply [production]
22:41 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2192 (T399249)', diff saved to https://phabricator.wikimedia.org/P79137 and previous config saved to /var/cache/conftool/dbconfig/20250715-224117-marostegui.json [production]
22:27 <swfrench-wmf> reprepro include php-excimer_1.2.5-1+wmf11u1 php-imagick_3.7.0-13+wmf11u1 php-luasandbox_4.1.2-1+wmf11u1 php-memcached_3.3.0-1+wmf11u1 php-pcov_1.0.12-1+wmf11u1 php-redis_6.2.0-1+wmf11u1 php-uuid_1.3.0-1+wmf11u1 php-wmerrors_2.0.0-1+wmf11u1 php-yaml_2.2.4-1+wmf11u1 wikidiff2_1.14.1-2+wmf11u1 xdebug_3.4.4-1+wmf11u1 in component/php83 - T398245 [production]
22:20 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1169777|extension-list: Undeploy Interwiki (step 3) (T399636)]] (duration: 08m 17s) [production]
22:16 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2192 (T399249)', diff saved to https://phabricator.wikimedia.org/P79136 and previous config saved to /var/cache/conftool/dbconfig/20250715-221606-marostegui.json [production]
22:15 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2192.codfw.wmnet with reason: Maintenance [production]
22:15 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178 (T399249)', diff saved to https://phabricator.wikimedia.org/P79135 and previous config saved to /var/cache/conftool/dbconfig/20250715-221543-marostegui.json [production]
22:15 <zabe@deploy1003> zabe: Continuing with sync [production]
22:14 <zabe@deploy1003> zabe: Backport for [[gerrit:1169777|extension-list: Undeploy Interwiki (step 3) (T399636)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
22:12 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1169777|extension-list: Undeploy Interwiki (step 3) (T399636)]] [production]
22:00 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178', diff saved to https://phabricator.wikimedia.org/P79134 and previous config saved to /var/cache/conftool/dbconfig/20250715-220036-marostegui.json [production]
21:57 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1169776|IS: Undeploy Interwiki (step 2) (T399636)]] (duration: 08m 42s) [production]
21:52 <zabe@deploy1003> zabe: Continuing with sync [production]
21:51 <zabe@deploy1003> zabe: Backport for [[gerrit:1169776|IS: Undeploy Interwiki (step 2) (T399636)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:49 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1169776|IS: Undeploy Interwiki (step 2) (T399636)]] [production]
21:45 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178', diff saved to https://phabricator.wikimedia.org/P79133 and previous config saved to /var/cache/conftool/dbconfig/20250715-214528-marostegui.json [production]
21:40 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1169775|CS: Undeploy Interwiki (step 1) (T399636)]] (duration: 08m 55s) [production]
21:35 <zabe@deploy1003> zabe: Continuing with sync [production]
21:33 <zabe@deploy1003> zabe: Backport for [[gerrit:1169775|CS: Undeploy Interwiki (step 1) (T399636)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:31 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1169775|CS: Undeploy Interwiki (step 1) (T399636)]] [production]
21:30 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2178 (T399249)', diff saved to https://phabricator.wikimedia.org/P79132 and previous config saved to /var/cache/conftool/dbconfig/20250715-213021-marostegui.json [production]
21:28 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host cloudcephosd2007-dev.codfw.wmnet with OS bullseye [production]
21:17 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1169765|Also join linktarget on namespace to allow index usage]], [[gerrit:1169766|Also join linktarget on namespace to allow index usage]] (duration: 08m 12s) [production]
21:12 <zabe@deploy1003> zabe: Continuing with sync [production]
21:11 <zabe@deploy1003> zabe: Backport for [[gerrit:1169765|Also join linktarget on namespace to allow index usage]], [[gerrit:1169766|Also join linktarget on namespace to allow index usage]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
21:10 <andrew@cumin2002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on cloudcephosd2007-dev.codfw.wmnet with reason: host reimage [production]
21:09 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1169765|Also join linktarget on namespace to allow index usage]], [[gerrit:1169766|Also join linktarget on namespace to allow index usage]] [production]
21:07 <eileen> civicrm upgraded from 521d0dbe to 71b58ed5 [production]
21:07 <eileen> civicrm upgraded from 521d0dbe to 71b58ed5 [production]
21:06 <andrew@cumin2002> START - Cookbook sre.hosts.downtime for 2:00:00 on cloudcephosd2007-dev.codfw.wmnet with reason: host reimage [production]
21:05 <eevans@cumin1003> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host aqs1012.eqiad.wmnet with OS bullseye [production]
21:02 <marostegui@cumin1002> dbctl commit (dc=all): 'Depooling db2178 (T399249)', diff saved to https://phabricator.wikimedia.org/P79131 and previous config saved to /var/cache/conftool/dbconfig/20250715-210251-marostegui.json [production]
21:02 <marostegui@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 5:00:00 on db2178.codfw.wmnet with reason: Maintenance [production]
21:02 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2171 (T399249)', diff saved to https://phabricator.wikimedia.org/P79130 and previous config saved to /var/cache/conftool/dbconfig/20250715-210240-marostegui.json [production]
20:50 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd2007-dev.codfw.wmnet with OS bullseye [production]
20:50 <andrew@cumin2002> END (ERROR) - Cookbook sre.hosts.reimage (exit_code=97) for host cloudcephosd2007-dev.codfw.wmnet with OS bullseye [production]
20:48 <eevans@cumin1003> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2:00:00 on aqs1012.eqiad.wmnet with reason: host reimage [production]
20:47 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2171', diff saved to https://phabricator.wikimedia.org/P79129 and previous config saved to /var/cache/conftool/dbconfig/20250715-204732-marostegui.json [production]
20:44 <eevans@cumin1003> START - Cookbook sre.hosts.downtime for 2:00:00 on aqs1012.eqiad.wmnet with reason: host reimage [production]
20:39 <andrew@cumin2002> START - Cookbook sre.hosts.reimage for host cloudcephosd2007-dev.codfw.wmnet with OS bullseye [production]
20:33 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1169763|Revert^2 "initialiseSettings: set wgSecurePollUseMediaWikiNamespace = true for enwiki"]], [[gerrit:1169734|Undeploy Readers Use Cases Survey (T398870)]] (duration: 08m 27s) [production]
20:32 <marostegui@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2171', diff saved to https://phabricator.wikimedia.org/P79128 and previous config saved to /var/cache/conftool/dbconfig/20250715-203224-marostegui.json [production]
20:30 <eevans@cumin1003> START - Cookbook sre.hosts.reimage for host aqs1012.eqiad.wmnet with OS bullseye [production]