551-600 of 10000 results (112ms)
2025-04-30 §
06:01 <marostegui@dns1006> START - running authdns-update [production]
06:00 <marostegui> Failover m1-master T392806 [production]
05:51 <kartik@deploy1003> helmfile [staging] START helmfile.d/services/machinetranslation: apply [production]
00:06 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 2 days, 0:00:00 on db[2242-2243].codfw.wmnet with reason: Maintenance [production]
00:06 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2241.codfw.wmnet with reason: Maintenance [production]
00:05 <zabe@deploy1003> Finished scap sync-world: Backport for [[gerrit:1139577|enwiki and commons: Increase revision-slots cache expiry again (T183490)]] (duration: 13m 45s) [production]
00:01 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2200.codfw.wmnet with reason: Maintenance [production]
2025-04-29 §
23:58 <zabe@deploy1003> zabe: Continuing with sync [production]
23:58 <zabe@deploy1003> zabe: Backport for [[gerrit:1139577|enwiki and commons: Increase revision-slots cache expiry again (T183490)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
23:56 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2198.codfw.wmnet with reason: Maintenance [production]
23:55 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2195 (T392806)', diff saved to https://phabricator.wikimedia.org/P75672 and previous config saved to /var/cache/conftool/dbconfig/20250429-235552-fceratto.json [production]
23:51 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1139577|enwiki and commons: Increase revision-slots cache expiry again (T183490)]] [production]
23:40 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2195', diff saved to https://phabricator.wikimedia.org/P75671 and previous config saved to /var/cache/conftool/dbconfig/20250429-234045-fceratto.json [production]
23:25 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2195', diff saved to https://phabricator.wikimedia.org/P75670 and previous config saved to /var/cache/conftool/dbconfig/20250429-232538-fceratto.json [production]
23:10 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2195 (T392806)', diff saved to https://phabricator.wikimedia.org/P75669 and previous config saved to /var/cache/conftool/dbconfig/20250429-231031-fceratto.json [production]
23:02 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2195 (T392806)', diff saved to https://phabricator.wikimedia.org/P75668 and previous config saved to /var/cache/conftool/dbconfig/20250429-230222-fceratto.json [production]
23:02 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2195.codfw.wmnet with reason: Maintenance [production]
23:01 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2181 (T392806)', diff saved to https://phabricator.wikimedia.org/P75667 and previous config saved to /var/cache/conftool/dbconfig/20250429-230155-fceratto.json [production]
22:46 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2181', diff saved to https://phabricator.wikimedia.org/P75666 and previous config saved to /var/cache/conftool/dbconfig/20250429-224647-fceratto.json [production]
22:34 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply [production]
22:34 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply [production]
22:33 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply [production]
22:33 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply [production]
22:33 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply [production]
22:32 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply [production]
22:31 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2181', diff saved to https://phabricator.wikimedia.org/P75665 and previous config saved to /var/cache/conftool/dbconfig/20250429-223140-fceratto.json [production]
22:16 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2181 (T392806)', diff saved to https://phabricator.wikimedia.org/P75664 and previous config saved to /var/cache/conftool/dbconfig/20250429-221633-fceratto.json [production]
22:16 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply [production]
22:14 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply [production]
22:08 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2181 (T392806)', diff saved to https://phabricator.wikimedia.org/P75663 and previous config saved to /var/cache/conftool/dbconfig/20250429-220823-fceratto.json [production]
22:08 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2181.codfw.wmnet with reason: Maintenance [production]
22:07 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2167 (T392806)', diff saved to https://phabricator.wikimedia.org/P75662 and previous config saved to /var/cache/conftool/dbconfig/20250429-220757-fceratto.json [production]
22:00 <brett> import ncmonitor 1.3.5 to bookworm-wikimedia [production]
21:52 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2167', diff saved to https://phabricator.wikimedia.org/P75661 and previous config saved to /var/cache/conftool/dbconfig/20250429-215250-fceratto.json [production]
21:37 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2167', diff saved to https://phabricator.wikimedia.org/P75660 and previous config saved to /var/cache/conftool/dbconfig/20250429-213743-fceratto.json [production]
21:22 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2167 (T392806)', diff saved to https://phabricator.wikimedia.org/P75659 and previous config saved to /var/cache/conftool/dbconfig/20250429-212235-fceratto.json [production]
21:14 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2167 (T392806)', diff saved to https://phabricator.wikimedia.org/P75658 and previous config saved to /var/cache/conftool/dbconfig/20250429-211415-fceratto.json [production]
21:14 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2167.codfw.wmnet with reason: Maintenance [production]
21:13 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2166 (T392806)', diff saved to https://phabricator.wikimedia.org/P75657 and previous config saved to /var/cache/conftool/dbconfig/20250429-211349-fceratto.json [production]
20:58 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2166', diff saved to https://phabricator.wikimedia.org/P75656 and previous config saved to /var/cache/conftool/dbconfig/20250429-205841-fceratto.json [production]
20:43 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2166', diff saved to https://phabricator.wikimedia.org/P75655 and previous config saved to /var/cache/conftool/dbconfig/20250429-204334-fceratto.json [production]
20:28 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2166 (T392806)', diff saved to https://phabricator.wikimedia.org/P75654 and previous config saved to /var/cache/conftool/dbconfig/20250429-202827-fceratto.json [production]
20:19 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2166 (T392806)', diff saved to https://phabricator.wikimedia.org/P75653 and previous config saved to /var/cache/conftool/dbconfig/20250429-201905-fceratto.json [production]
20:18 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2166.codfw.wmnet with reason: Maintenance [production]
20:18 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2165 (T392806)', diff saved to https://phabricator.wikimedia.org/P75652 and previous config saved to /var/cache/conftool/dbconfig/20250429-201838-fceratto.json [production]
20:03 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2165', diff saved to https://phabricator.wikimedia.org/P75651 and previous config saved to /var/cache/conftool/dbconfig/20250429-200331-fceratto.json [production]
20:02 <denisse> disabling Puppet on grafana2001 - T384841 [production]
19:48 <ejegg> civicrm upgraded from 6c4c4016 to 2b8b4651 [production]
19:48 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2165', diff saved to https://phabricator.wikimedia.org/P75649 and previous config saved to /var/cache/conftool/dbconfig/20250429-194824-fceratto.json [production]
19:33 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2165 (T392806)', diff saved to https://phabricator.wikimedia.org/P75648 and previous config saved to /var/cache/conftool/dbconfig/20250429-193316-fceratto.json [production]