151-200 of 10000 results (100ms)
2026-01-28 ยง
15:55 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1165', diff saved to https://phabricator.wikimedia.org/P88010 and previous config saved to /var/cache/conftool/dbconfig/20260128-155518-marostegui.json [production]
15:49 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db2151 (T415786)', diff saved to https://phabricator.wikimedia.org/P88009 and previous config saved to /var/cache/conftool/dbconfig/20260128-154919-marostegui.json [production]
15:42 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1226 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P88007 and previous config saved to /var/cache/conftool/dbconfig/20260128-154224-marostegui.json [production]
15:42 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 3 days, 0:00:00 on db1226.eqiad.wmnet with reason: Maintenance [production]
15:41 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1214 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P88006 and previous config saved to /var/cache/conftool/dbconfig/20260128-154158-marostegui.json [production]
15:40 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1165', diff saved to https://phabricator.wikimedia.org/P88005 and previous config saved to /var/cache/conftool/dbconfig/20260128-154010-marostegui.json [production]
15:31 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1214', diff saved to https://phabricator.wikimedia.org/P88004 and previous config saved to /var/cache/conftool/dbconfig/20260128-153150-marostegui.json [production]
15:25 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1165 (T415786)', diff saved to https://phabricator.wikimedia.org/P88003 and previous config saved to /var/cache/conftool/dbconfig/20260128-152501-marostegui.json [production]
15:21 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1214', diff saved to https://phabricator.wikimedia.org/P88002 and previous config saved to /var/cache/conftool/dbconfig/20260128-152141-marostegui.json [production]
15:13 <apine@deploy2002> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
15:12 <apine@deploy2002> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
15:12 <apine@deploy2002> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
15:12 <apine@deploy2002> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
15:11 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1214 (T411163 T411164)', diff saved to https://phabricator.wikimedia.org/P88001 and previous config saved to /var/cache/conftool/dbconfig/20260128-151133-marostegui.json [production]
15:10 <apine@deploy2002> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
15:09 <apine@deploy2002> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
15:06 <apine@deploy2002> helmfile [eqiad] DONE helmfile.d/services/wikifunctions: apply [production]
15:05 <apine@deploy2002> helmfile [eqiad] START helmfile.d/services/wikifunctions: apply [production]
15:05 <apine@deploy2002> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
15:05 <Lucas_WMDE> UTC afternoon backport+config window done [production]
15:04 <apine@deploy2002> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
15:04 <dreamyjazz@deploy2002> Finished scap sync-world: Backport for [[gerrit:1233752|CheckUser: Read new for user agent table migration everywhere (T361199)]] (duration: 09m 58s) [production]
15:04 <apine@deploy2002> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
15:03 <apine@deploy2002> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
15:00 <dreamyjazz@deploy2002> dreamyjazz: Continuing with sync [production]
14:56 <dreamyjazz@deploy2002> dreamyjazz: Backport for [[gerrit:1233752|CheckUser: Read new for user agent table migration everywhere (T361199)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
14:54 <dreamyjazz@deploy2002> Started scap sync-world: Backport for [[gerrit:1233752|CheckUser: Read new for user agent table migration everywhere (T361199)]] [production]
14:52 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db2151 (T415786)', diff saved to https://phabricator.wikimedia.org/P88000 and previous config saved to /var/cache/conftool/dbconfig/20260128-145223-marostegui.json [production]
14:52 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db2151.codfw.wmnet with reason: Maintenance [production]
14:50 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1165 (T415786)', diff saved to https://phabricator.wikimedia.org/P87999 and previous config saved to /var/cache/conftool/dbconfig/20260128-145057-marostegui.json [production]
14:50 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 16:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1015,1019].eqiad.wmnet,db1155.eqiad.wmnet with reason: Maintenance [production]
14:50 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 8:00:00 on db1165.eqiad.wmnet with reason: Maintenance [production]
14:35 <mvolz@deploy2002> Finished scap sync-world: Backport for [[gerrit:1204813|Remove deprecated parameter (T361576)]] (duration: 23m 33s) [production]
14:29 <mvolz@deploy2002> mvolz: Continuing with sync [production]
14:17 <mvolz@deploy2002> mvolz: Backport for [[gerrit:1204813|Remove deprecated parameter (T361576)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
14:12 <mvolz@deploy2002> Started scap sync-world: Backport for [[gerrit:1204813|Remove deprecated parameter (T361576)]] [production]
13:57 <sfaci@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/test-kitchen-next: apply [production]
13:56 <sfaci@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/test-kitchen-next: apply [production]
13:33 <jforrester@deploy2002> mwscript-k8s job started: /srv/mediawiki/php-1.46.0-wmf.13/extensions/Translate/scripts/createMessageIndex.php --wiki=mediawikiwiki # T415725 [production]
12:44 <mvolz@deploy2002> helmfile [eqiad] DONE helmfile.d/services/citoid: apply [production]
12:43 <mvolz@deploy2002> helmfile [eqiad] START helmfile.d/services/citoid: apply [production]
12:43 <mvolz@deploy2002> helmfile [codfw] DONE helmfile.d/services/citoid: apply [production]
12:42 <mvolz@deploy2002> helmfile [codfw] START helmfile.d/services/citoid: apply [production]
12:41 <mvolz@deploy2002> helmfile [staging] DONE helmfile.d/services/citoid: apply [production]
12:41 <mvolz@deploy2002> helmfile [staging] START helmfile.d/services/citoid: apply [production]
12:38 <mvolz@deploy2002> helmfile [staging] DONE helmfile.d/services/citoid: apply [production]
12:38 <mvolz@deploy2002> helmfile [staging] START helmfile.d/services/citoid: apply [production]
12:27 <mvolz@deploy2002> helmfile [staging] DONE helmfile.d/services/citoid: apply [production]
12:27 <mvolz@deploy2002> helmfile [staging] START helmfile.d/services/citoid: apply [production]
12:13 <mvolz@deploy2002> helmfile [staging] DONE helmfile.d/services/citoid: apply [production]