1351-1400 of 10000 results (106ms)
2024-09-11 §
15:35 <dzahn@cumin2002> START - Cookbook sre.hosts.downtime for 0:10:00 on phab2002.codfw.wmnet with reason: nftables migration [production]
15:31 <topranks> push server and vlan configuration to lsw1-c6-codfw with Homer to prep physical moves T373101 [production]
15:28 <dduvall@deploy1003> Finished deploy [releng/jenkins-deploy@4635fcb] (releasing): (no justification provided) (duration: 00m 35s) [production]
15:27 <dduvall@deploy1003> Started deploy [releng/jenkins-deploy@4635fcb] (releasing): (no justification provided) [production]
15:26 <dduvall@deploy1003> Finished deploy [releng/jenkins-deploy@71141b8] (releasing): (no justification provided) (duration: 00m 41s) [production]
15:26 <dduvall@deploy1003> Started deploy [releng/jenkins-deploy@71141b8] (releasing): (no justification provided) [production]
15:21 <sukhe@puppetmaster1001> conftool action : set/pooled=no; selector: name=(cp2037|cp2038).codfw.wmnet [reason: depooling for T373101] [production]
15:17 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2138 (re)pooling @ 100%: post db2138 → db2238 repool', diff saved to https://phabricator.wikimedia.org/P68928 and previous config saved to /var/cache/conftool/dbconfig/20240911-151754-arnaudb.json [production]
15:08 <cmooney@cumin1002> END (ERROR) - Cookbook sre.ganeti.drain-node (exit_code=97) for draining ganeti node ganeti2014.codfw.wmnet [production]
15:05 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2032.codfw.wmnet [production]
15:05 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2032.codfw.wmnet [production]
15:05 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2024.codfw.wmnet [production]
15:04 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2024.codfw.wmnet [production]
15:04 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2023.codfw.wmnet [production]
15:03 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2023.codfw.wmnet [production]
15:03 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2022.codfw.wmnet [production]
15:03 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2022.codfw.wmnet [production]
15:03 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2021.codfw.wmnet [production]
15:02 <arnaudb@cumin1002> dbctl commit (dc=all): 'db2138 (re)pooling @ 75%: post db2138 → db2238 repool', diff saved to https://phabricator.wikimedia.org/P68927 and previous config saved to /var/cache/conftool/dbconfig/20240911-150249-arnaudb.json [production]
15:02 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2021.codfw.wmnet [production]
15:02 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2020.codfw.wmnet [production]
15:01 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2020.codfw.wmnet [production]
15:01 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-ctrl2002.codfw.wmnet [production]
15:01 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-ctrl2002.codfw.wmnet [production]
15:01 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host parse2015.codfw.wmnet [production]
15:00 <ladsgroup@cumin1002> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 12:00:00 on db2141.codfw.wmnet with reason: Maintenance [production]
15:00 <ladsgroup@cumin1002> START - Cookbook sre.hosts.downtime for 12:00:00 on db2141.codfw.wmnet with reason: Maintenance [production]
15:00 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Repooling after maintenance db2130 (T371742)', diff saved to https://phabricator.wikimedia.org/P68926 and previous config saved to /var/cache/conftool/dbconfig/20240911-150011-ladsgroup.json [production]
14:58 <ladsgroup@cumin1002> dbctl commit (dc=all): 'Pool pc5 into production traffic (T374496)', diff saved to https://phabricator.wikimedia.org/P68925 and previous config saved to /var/cache/conftool/dbconfig/20240911-145844-ladsgroup.json [production]
14:58 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host parse2015.codfw.wmnet [production]
14:58 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host parse2014.codfw.wmnet [production]
14:57 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host parse2014.codfw.wmnet [production]
14:57 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw2359.codfw.wmnet [production]
14:57 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host mw2359.codfw.wmnet [production]
14:57 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw2357.codfw.wmnet [production]
14:56 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host mw2357.codfw.wmnet [production]
14:56 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw2356.codfw.wmnet [production]
14:55 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host mw2356.codfw.wmnet [production]
14:55 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw2355.codfw.wmnet [production]
14:55 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host mw2355.codfw.wmnet [production]
14:54 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw2354.codfw.wmnet [production]
14:54 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host mw2354.codfw.wmnet [production]
14:54 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw2353.codfw.wmnet [production]
14:53 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host mw2353.codfw.wmnet [production]
14:53 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw2352.codfw.wmnet [production]
14:53 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host mw2352.codfw.wmnet [production]
14:52 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw2351.codfw.wmnet [production]
14:52 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host mw2351.codfw.wmnet [production]
14:52 <cgoubert@cumin1002> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host mw2350.codfw.wmnet [production]
14:51 <cgoubert@cumin1002> START - Cookbook sre.k8s.pool-depool-node depool for host mw2350.codfw.wmnet [production]