201-250 of 10000 results (33ms)
2025-11-06 ยง
16:17 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on cirrussearch1083.eqiad.wmnet with reason: C/D Migration [production]
16:17 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on cirrussearch1083.eqiad.wmnet with reason: C/D Migration [production]
16:16 <moritzm> installing sysstat security updates [production]
16:16 <Amir1> cumin2024@db2205.codfw.wmnet[(none)]> drop database if exists boardvotetest and boardvote2007_test; (T297297) [production]
16:10 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1232 (T407997)', diff saved to https://phabricator.wikimedia.org/P85027 and previous config saved to /var/cache/conftool/dbconfig/20251106-161045-marostegui.json [production]
16:09 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on cirrussearch1082.eqiad.wmnet with reason: C/D Migration [production]
16:04 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on cp1109.eqiad.wmnet with reason: C/D Migration [production]
16:04 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.major-upgrade (exit_code=0) [production]
16:04 <fceratto@cumin1003> END (PASS) - Cookbook sre.mysql.pool (exit_code=0) db2163 gradually with 4 steps - Migration of db2163.codfw.wmnet completed [production]
16:02 <ejegg> payments-wiki upgraded from c2a4b377 to 1d4b0d2a [production]
16:00 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [tools]
15:55 <dancy@deploy2002> Installation of scap version "4.225.0" completed for 2 hosts [production]
15:53 <dancy@deploy2002> Installing scap version "4.225.0" for 2 host(s) [production]
15:52 <robh> cp1108 moving as part of migration [production]
15:52 <marostegui@cumin1003> dbctl commit (dc=all): 'Depooling db1232 (T407997)', diff saved to https://phabricator.wikimedia.org/P85025 and previous config saved to /var/cache/conftool/dbconfig/20251106-155207-marostegui.json [production]
15:52 <robh@cumin2002> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:15:00 on cp1108.eqiad.wmnet with reason: C/D Migration [production]
15:51 <marostegui@cumin1003> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 4:00:00 on db1232.eqiad.wmnet with reason: Maintenance [production]
15:51 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1219 (T407997)', diff saved to https://phabricator.wikimedia.org/P85024 and previous config saved to /var/cache/conftool/dbconfig/20251106-155143-marostegui.json [production]
15:49 <jynus> drop grants for dbprov1003 & dbprov2003 T403166 [production]
15:45 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [tools]
15:36 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1219', diff saved to https://phabricator.wikimedia.org/P85022 and previous config saved to /var/cache/conftool/dbconfig/20251106-153636-marostegui.json [production]
15:34 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [toolsbeta]
15:22 <dcaro@cloudcumin1001> START - Cookbook wmcs.toolforge.component.deploy for component jobs-api [toolsbeta]
15:21 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1219', diff saved to https://phabricator.wikimedia.org/P85019 and previous config saved to /var/cache/conftool/dbconfig/20251106-152129-marostegui.json [production]
15:18 <fceratto@cumin1003> START - Cookbook sre.mysql.pool db2163 gradually with 4 steps - Migration of db2163.codfw.wmnet completed [production]
15:10 <jmm@cumin2002> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device fasw2-c1a-eqiad [production]
15:10 <jmm@cumin2002> START - Cookbook sre.network.tls for network device fasw2-c1a-eqiad [production]
15:10 <jmm@cumin2002> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device cr2-eqsin [production]
15:10 <jmm@cumin2002> START - Cookbook sre.network.tls for network device cr2-eqsin [production]
15:06 <marostegui@cumin1003> dbctl commit (dc=all): 'Repooling after maintenance db1219 (T407997)', diff saved to https://phabricator.wikimedia.org/P85017 and previous config saved to /var/cache/conftool/dbconfig/20251106-150622-marostegui.json [production]
15:03 <jmm@cumin2002> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device ssw1-e1-eqiad [production]
15:03 <jmm@cumin2002> START - Cookbook sre.network.tls for network device ssw1-e1-eqiad [production]
15:03 <dcaro@cloudcumin1001> END (PASS) - Cookbook wmcs.toolforge.component.deploy (exit_code=0) for component jobs-api [toolsbeta]
15:02 <jmm@cumin2002> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device ssw1-f1-eqiad [production]
15:02 <jmm@cumin2002> START - Cookbook sre.network.tls for network device ssw1-f1-eqiad [production]
15:02 <jmm@cumin2002> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-a2-codfw [production]
15:02 <jmm@cumin2002> START - Cookbook sre.network.tls for network device lsw1-a2-codfw [production]
15:00 <jmm@cumin2002> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-a3-codfw [production]
15:00 <jmm@cumin2002> START - Cookbook sre.network.tls for network device lsw1-a3-codfw [production]
15:00 <jmm@cumin2002> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-a4-codfw [production]
15:00 <jmm@cumin2002> START - Cookbook sre.network.tls for network device lsw1-a4-codfw [production]
14:59 <jmm@cumin2002> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-a6-codfw [production]
14:59 <jmm@cumin2002> START - Cookbook sre.network.tls for network device lsw1-a6-codfw [production]
14:59 <jmm@cumin2002> END (PASS) - Cookbook sre.network.tls (exit_code=0) for network device lsw1-a5-codfw [production]
14:59 <jmm@cumin2002> START - Cookbook sre.network.tls for network device lsw1-a5-codfw [production]
14:57 <tappof> bump space for prometheus k8s-dse in eqiad [production]
14:55 <Lucas_WMDE> UTC afternoon backport+config window done [production]
14:55 <Lucas_WMDE> Deployed security patch for T409423 [production]
14:54 <cmooney@cumin1003> END (PASS) - Cookbook sre.dns.netbox (exit_code=0) [production]
14:54 <cmooney@cumin1003> END (PASS) - Cookbook sre.puppet.sync-netbox-hiera (exit_code=0) generate netbox hiera data: "Triggered by cookbooks.sre.dns.netbox: change dns for row c gateway interfaces eqiad CRs - cmooney@cumin1003" [production]