201-250 of 10000 results (15ms)
2026-05-28 ยง
08:34 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1165.eqiad.wmnet with reason: Maintenance [production]
08:33 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1211 (T426633)', diff saved to https://phabricator.wikimedia.org/P93322 and previous config saved to /var/cache/conftool/dbconfig/20260528-083331-fceratto.json [production]
08:24 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1209: Test [production]
08:23 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1211', diff saved to https://phabricator.wikimedia.org/P93320 and previous config saved to /var/cache/conftool/dbconfig/20260528-082324-fceratto.json [production]
08:23 <marostegui@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db2189: repool after crash [production]
08:17 <slyngshede@dns1004> END - running authdns-update [production]
08:16 <slyngshede@dns1004> START - running authdns-update [production]
08:13 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1211', diff saved to https://phabricator.wikimedia.org/P93318 and previous config saved to /var/cache/conftool/dbconfig/20260528-081316-fceratto.json [production]
08:10 <jnuche@deploy1003> rebuilt and synchronized wikiversions files: group2 to 1.47.0-wmf.4 refs T423913 [production]
08:09 <fceratto@cumin1003> START - Cookbook sre.mysql.pool pool db1209: Test [production]
08:05 <hashar@deploy1003> Finished deploy [integration/docroot@2a51016]: build: update dependencies + eslint fix in comment. f021d3f..2a51016 (duration: 00m 13s) [production]
08:05 <hashar@deploy1003> Started deploy [integration/docroot@2a51016]: build: update dependencies + eslint fix in comment. f021d3f..2a51016 [production]
08:03 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1211 (T426633)', diff saved to https://phabricator.wikimedia.org/P93315 and previous config saved to /var/cache/conftool/dbconfig/20260528-080309-fceratto.json [production]
07:56 <fceratto@cumin1003> dbctl commit (dc=all): 'Depooling db1211 (T426633)', diff saved to https://phabricator.wikimedia.org/P93314 and previous config saved to /var/cache/conftool/dbconfig/20260528-075631-fceratto.json [production]
07:56 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on clouddb[1016,1020,1022-1023].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
07:56 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1211.eqiad.wmnet with reason: Maintenance [production]
07:55 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1264 (T426633)', diff saved to https://phabricator.wikimedia.org/P93313 and previous config saved to /var/cache/conftool/dbconfig/20260528-075521-fceratto.json [production]
07:47 <jelto@cumin1003> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab2002.wikimedia.org with reason: Upgrade GitLab replica [production]
07:45 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1264', diff saved to https://phabricator.wikimedia.org/P93311 and previous config saved to /var/cache/conftool/dbconfig/20260528-074513-fceratto.json [production]
07:37 <marostegui@cumin1003> START - Cookbook sre.mysql.pool pool db2189: repool after crash [production]
07:36 <jelto@cumin1003> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab2002.wikimedia.org with reason: Upgrade GitLab replica [production]
07:35 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1264', diff saved to https://phabricator.wikimedia.org/P93309 and previous config saved to /var/cache/conftool/dbconfig/20260528-073506-fceratto.json [production]
07:34 <jelto@cumin1003> END (PASS) - Cookbook sre.gitlab.upgrade (exit_code=0) on GitLab host gitlab1003.wikimedia.org with reason: Upgrade GitLab replica [production]
07:29 <wmde-fisch@deploy1003> Finished scap sync-world: Backport for [[gerrit:1294808|Don't run the click intent experiment on mobile (T426743)]] (duration: 06m 29s) [production]
07:25 <wmde-fisch@deploy1003> thiemowmde, wmde-fisch: Continuing with deployment [production]
07:24 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1264 (T426633)', diff saved to https://phabricator.wikimedia.org/P93308 and previous config saved to /var/cache/conftool/dbconfig/20260528-072458-fceratto.json [production]
07:24 <wmde-fisch@deploy1003> thiemowmde, wmde-fisch: Backport for [[gerrit:1294808|Don't run the click intent experiment on mobile (T426743)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
07:24 <jelto@cumin1003> START - Cookbook sre.gitlab.upgrade on GitLab host gitlab1003.wikimedia.org with reason: Upgrade GitLab replica [production]
07:23 <tgr@deploy1003> mwscript-k8s job started: extensions/CentralAuth/maintenance/fixStuckGlobalRename.php --wiki=enwikisource --logwiki=metawiki Ioed Renamed_user_4232d41570b9e8f46ef150e5e360e446 # T427459 [production]
07:22 <wmde-fisch@deploy1003> Started scap sync-world: Backport for [[gerrit:1294808|Don't run the click intent experiment on mobile (T426743)]] [production]
07:20 <wmde-fisch@deploy1003> Finished scap sync-world: Backport for [[gerrit:1270986|Update wikimania wordmark for 2026 (T413331)]] (duration: 06m 54s) [production]
07:18 <fceratto@cumin1003> dbctl commit (dc=all): 'Depooling db1264 (T426633)', diff saved to https://phabricator.wikimedia.org/P93307 and previous config saved to /var/cache/conftool/dbconfig/20260528-071836-fceratto.json [production]
07:18 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1264.eqiad.wmnet with reason: Maintenance [production]
07:16 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) pool db1167: Reboot completed [production]
07:16 <wmde-fisch@deploy1003> wmde-fisch, robertsky: Continuing with deployment [production]
07:15 <wmde-fisch@deploy1003> wmde-fisch, robertsky: Backport for [[gerrit:1270986|Update wikimania wordmark for 2026 (T413331)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
07:13 <wmde-fisch@deploy1003> Started scap sync-world: Backport for [[gerrit:1270986|Update wikimania wordmark for 2026 (T413331)]] [production]
07:11 <wmde-fisch@deploy1003> Finished scap sync-world: Backport for [[gerrit:1289898|Disable support for PHP-serialized EntityData on Wikidata production (T98035)]] (duration: 07m 15s) [production]
07:07 <wmde-fisch@deploy1003> wmde-fisch, arthurtaylor: Continuing with deployment [production]
07:06 <wmde-fisch@deploy1003> wmde-fisch, arthurtaylor: Backport for [[gerrit:1289898|Disable support for PHP-serialized EntityData on Wikidata production (T98035)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
07:05 <hashar> integration: delete deployment-deploy04 agent from Jenkins controller. Batch job has been migrated to a systemd driven script # T256168 [releng]
07:04 <wmde-fisch@deploy1003> Started scap sync-world: Backport for [[gerrit:1289898|Disable support for PHP-serialized EntityData on Wikidata production (T98035)]] [production]
06:43 <fceratto@cumin1003> START - Cookbook sre.mysql.pool pool db1167: Reboot completed [production]
06:42 <fceratto@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1167 (T426633)', diff saved to https://phabricator.wikimedia.org/P93303 and previous config saved to /var/cache/conftool/dbconfig/20260528-064217-fceratto.json [production]
06:33 <fceratto@cumin1003> dbctl commit (dc=all): 'Depooling db1167 (T426633)', diff saved to https://phabricator.wikimedia.org/P93302 and previous config saved to /var/cache/conftool/dbconfig/20260528-063357-fceratto.json [production]
06:33 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on an-redacteddb1001.eqiad.wmnet,clouddb[1016,1020].eqiad.wmnet,db1154.eqiad.wmnet with reason: Maintenance [production]
06:33 <fceratto@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db1167.eqiad.wmnet with reason: Maintenance [production]
06:29 <hashar> integration: delete integration-castor05 agent from Jenkins, replaced by integration-castor06 # T421114 [releng]
06:25 <hashar> Restarting CI Jenkins for plugins upgrades [production]
06:16 <fceratto@dns1005> END - running authdns-update [production]