551-600 of 10000 results (109ms)
2025-04-29 ยง
23:58 <zabe@deploy1003> zabe: Continuing with sync [production]
23:58 <zabe@deploy1003> zabe: Backport for [[gerrit:1139577|enwiki and commons: Increase revision-slots cache expiry again (T183490)]] synced to the testservers (https://wikitech.wikimedia.org/wiki/Mwdebug) [production]
23:56 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2198.codfw.wmnet with reason: Maintenance [production]
23:55 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2195 (T392806)', diff saved to https://phabricator.wikimedia.org/P75672 and previous config saved to /var/cache/conftool/dbconfig/20250429-235552-fceratto.json [production]
23:51 <zabe@deploy1003> Started scap sync-world: Backport for [[gerrit:1139577|enwiki and commons: Increase revision-slots cache expiry again (T183490)]] [production]
23:40 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2195', diff saved to https://phabricator.wikimedia.org/P75671 and previous config saved to /var/cache/conftool/dbconfig/20250429-234045-fceratto.json [production]
23:25 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2195', diff saved to https://phabricator.wikimedia.org/P75670 and previous config saved to /var/cache/conftool/dbconfig/20250429-232538-fceratto.json [production]
23:10 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2195 (T392806)', diff saved to https://phabricator.wikimedia.org/P75669 and previous config saved to /var/cache/conftool/dbconfig/20250429-231031-fceratto.json [production]
23:02 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2195 (T392806)', diff saved to https://phabricator.wikimedia.org/P75668 and previous config saved to /var/cache/conftool/dbconfig/20250429-230222-fceratto.json [production]
23:02 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2195.codfw.wmnet with reason: Maintenance [production]
23:01 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2181 (T392806)', diff saved to https://phabricator.wikimedia.org/P75667 and previous config saved to /var/cache/conftool/dbconfig/20250429-230155-fceratto.json [production]
22:46 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2181', diff saved to https://phabricator.wikimedia.org/P75666 and previous config saved to /var/cache/conftool/dbconfig/20250429-224647-fceratto.json [production]
22:34 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply [production]
22:34 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply [production]
22:33 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply [production]
22:33 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply [production]
22:33 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply [production]
22:32 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply [production]
22:31 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2181', diff saved to https://phabricator.wikimedia.org/P75665 and previous config saved to /var/cache/conftool/dbconfig/20250429-223140-fceratto.json [production]
22:16 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2181 (T392806)', diff saved to https://phabricator.wikimedia.org/P75664 and previous config saved to /var/cache/conftool/dbconfig/20250429-221633-fceratto.json [production]
22:16 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/blunderbuss: apply [production]
22:14 <amastilovic@deploy2002> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/blunderbuss: apply [production]
22:08 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2181 (T392806)', diff saved to https://phabricator.wikimedia.org/P75663 and previous config saved to /var/cache/conftool/dbconfig/20250429-220823-fceratto.json [production]
22:08 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2181.codfw.wmnet with reason: Maintenance [production]
22:07 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2167 (T392806)', diff saved to https://phabricator.wikimedia.org/P75662 and previous config saved to /var/cache/conftool/dbconfig/20250429-220757-fceratto.json [production]
22:00 <brett> import ncmonitor 1.3.5 to bookworm-wikimedia [production]
21:52 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2167', diff saved to https://phabricator.wikimedia.org/P75661 and previous config saved to /var/cache/conftool/dbconfig/20250429-215250-fceratto.json [production]
21:37 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2167', diff saved to https://phabricator.wikimedia.org/P75660 and previous config saved to /var/cache/conftool/dbconfig/20250429-213743-fceratto.json [production]
21:22 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2167 (T392806)', diff saved to https://phabricator.wikimedia.org/P75659 and previous config saved to /var/cache/conftool/dbconfig/20250429-212235-fceratto.json [production]
21:14 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2167 (T392806)', diff saved to https://phabricator.wikimedia.org/P75658 and previous config saved to /var/cache/conftool/dbconfig/20250429-211415-fceratto.json [production]
21:14 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2167.codfw.wmnet with reason: Maintenance [production]
21:13 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2166 (T392806)', diff saved to https://phabricator.wikimedia.org/P75657 and previous config saved to /var/cache/conftool/dbconfig/20250429-211349-fceratto.json [production]
20:58 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2166', diff saved to https://phabricator.wikimedia.org/P75656 and previous config saved to /var/cache/conftool/dbconfig/20250429-205841-fceratto.json [production]
20:43 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2166', diff saved to https://phabricator.wikimedia.org/P75655 and previous config saved to /var/cache/conftool/dbconfig/20250429-204334-fceratto.json [production]
20:28 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2166 (T392806)', diff saved to https://phabricator.wikimedia.org/P75654 and previous config saved to /var/cache/conftool/dbconfig/20250429-202827-fceratto.json [production]
20:19 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2166 (T392806)', diff saved to https://phabricator.wikimedia.org/P75653 and previous config saved to /var/cache/conftool/dbconfig/20250429-201905-fceratto.json [production]
20:18 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2166.codfw.wmnet with reason: Maintenance [production]
20:18 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2165 (T392806)', diff saved to https://phabricator.wikimedia.org/P75652 and previous config saved to /var/cache/conftool/dbconfig/20250429-201838-fceratto.json [production]
20:03 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2165', diff saved to https://phabricator.wikimedia.org/P75651 and previous config saved to /var/cache/conftool/dbconfig/20250429-200331-fceratto.json [production]
20:02 <denisse> disabling Puppet on grafana2001 - T384841 [production]
19:48 <ejegg> civicrm upgraded from 6c4c4016 to 2b8b4651 [production]
19:48 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2165', diff saved to https://phabricator.wikimedia.org/P75649 and previous config saved to /var/cache/conftool/dbconfig/20250429-194824-fceratto.json [production]
19:33 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2165 (T392806)', diff saved to https://phabricator.wikimedia.org/P75648 and previous config saved to /var/cache/conftool/dbconfig/20250429-193316-fceratto.json [production]
19:25 <fceratto@cumin1002> dbctl commit (dc=all): 'Depooling db2165 (T392806)', diff saved to https://phabricator.wikimedia.org/P75647 and previous config saved to /var/cache/conftool/dbconfig/20250429-192501-fceratto.json [production]
19:24 <fceratto@cumin1002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1 day, 0:00:00 on db2165.codfw.wmnet with reason: Maintenance [production]
19:24 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2164 (T392806)', diff saved to https://phabricator.wikimedia.org/P75646 and previous config saved to /var/cache/conftool/dbconfig/20250429-192434-fceratto.json [production]
19:09 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2164', diff saved to https://phabricator.wikimedia.org/P75645 and previous config saved to /var/cache/conftool/dbconfig/20250429-190927-fceratto.json [production]
18:58 <fab@deploy1003> Finished deploy [airflow-dags/research@414def7]: (no justification provided) (duration: 00m 50s) [production]
18:58 <fab@deploy1003> Started deploy [airflow-dags/research@414def7]: (no justification provided) [production]
18:54 <fceratto@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2164', diff saved to https://phabricator.wikimedia.org/P75644 and previous config saved to /var/cache/conftool/dbconfig/20250429-185421-fceratto.json [production]