251-300 of 10000 results (21ms)
2026-10-06 ยง
15:08 <trueg@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/services/wdqs-next: apply [production]
15:07 <cdobbins@cumin1004> END (PASS) - Cookbook sre.cdn.roll-restart-ats (exit_code=0) rolling restart_daemons on A:cp-codfw [production]
15:06 <trueg@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/services/wdqs-next: apply [production]
15:04 <brennen@deploy1003> Finished deploy [phabricator/deployment@2b620eb]: deploy phab1005 for T440340 (duration: 00m 42s) [production]
15:03 <brennen@deploy1003> Started deploy [phabricator/deployment@2b620eb]: deploy phab1005 for T440340 [production]
15:03 <aokoth@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on phab1005.eqiad.wmnet with reason: Deployment [production]
15:03 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
15:03 <jayme@deploy1003> helmfile [staging-codfw] DONE helmfile.d/admin 'apply'. [production]
15:03 <jayme@deploy1003> helmfile [staging-codfw] START helmfile.d/admin 'apply'. [production]
15:03 <brennen@deploy1003> Finished deploy [phabricator/deployment@2b620eb]: deploy phab2003 for T440340 (duration: 00m 51s) [production]
15:02 <jayme@deploy1003> helmfile [staging-eqiad] DONE helmfile.d/admin 'apply'. [production]
15:02 <jayme@deploy1003> helmfile [staging-eqiad] START helmfile.d/admin 'apply'. [production]
15:02 <brennen@deploy1003> Started deploy [phabricator/deployment@2b620eb]: deploy phab2003 for T440340 [production]
15:02 <aokoth@cumin1004> DONE (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 0:30:00 on phab2003.codfw.wmnet with reason: Deployment [production]
15:02 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
14:59 <ladsgroup@deploy1003> helmfile [staging] DONE helmfile.d/services/thumbor: apply [production]
14:59 <ladsgroup@deploy1003> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
14:57 <moritzm> restarting pybal on lvs1018 T439730 [production]
14:51 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker[2041-2042,2044,2046,2049-2051].codfw.wmnet [production]
14:51 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker[2041-2042,2044,2046,2049-2051].codfw.wmnet [production]
14:48 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.enable_virtualization (exit_code=0) rolling provision on D{wikikube-worker[2041-2042,2044,2046,2049-2051].codfw.wmnet} and (A:wikikube-master-codfw or A:wikikube-worker-codfw) [production]
14:48 <oblivian@cumin1004> END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) pool for host wikikube-worker2051.codfw.wmnet [production]
14:48 <moritzm> restarting pybal on lvs1020 T439730 [production]
14:47 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2051.codfw.wmnet [production]
14:47 <oblivian@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2051.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
14:41 <cdobbins@cumin1004> START - Cookbook sre.cdn.roll-restart-ats rolling restart_daemons on A:cp-codfw [production]
14:40 <oblivian@cumin1004> START - Cookbook sre.hosts.provision for host wikikube-worker2051.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
14:40 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2051.codfw.wmnet [production]
14:39 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2051.codfw.wmnet [production]
14:39 <oblivian@cumin1004> END (FAIL) - Cookbook sre.k8s.pool-depool-node (exit_code=99) pool for host wikikube-worker2050.codfw.wmnet [production]
14:38 <ladsgroup@deploy1003> Finished scap sync-world: Backport for [[gerrit:1325997|Enable $wgCiteDefaultRefDirAuto on fawiki (T432544)]] (duration: 11m 37s) [production]
14:38 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2050.codfw.wmnet [production]
14:38 <oblivian@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2050.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
14:33 <ladsgroup@deploy1003> ladsgroup, mamouri: Continuing with deployment [production]
14:33 <moritzm> restarting pybal on lvs2012 T439730 [production]
14:32 <oblivian@cumin1004> START - Cookbook sre.hosts.provision for host wikikube-worker2050.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
14:32 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2050.codfw.wmnet [production]
14:31 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node depool for host wikikube-worker2050.codfw.wmnet [production]
14:31 <cdobbins@cumin1004> END (PASS) - Cookbook sre.cdn.roll-restart-ats (exit_code=0) rolling restart_daemons on A:cp-eqsin [production]
14:31 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) pool for host wikikube-worker2049.codfw.wmnet [production]
14:31 <oblivian@cumin1004> START - Cookbook sre.k8s.pool-depool-node pool for host wikikube-worker2049.codfw.wmnet [production]
14:31 <ladsgroup@deploy1003> ladsgroup, mamouri: Backport for [[gerrit:1325997|Enable $wgCiteDefaultRefDirAuto on fawiki (T432544)]] synced to the testservers (see https://wikitech.wikimedia.org/wiki/Mwdebug). Changes can now be verified there. [production]
14:31 <oblivian@cumin1004> END (PASS) - Cookbook sre.hosts.provision (exit_code=0) for host wikikube-worker2049.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
14:28 <trueg@deploy1003> helmfile [dse-k8s-codfw] DONE helmfile.d/services/wdqs-next: apply [production]
14:27 <ladsgroup@deploy1003> Started scap sync-world: Backport for [[gerrit:1325997|Enable $wgCiteDefaultRefDirAuto on fawiki (T432544)]] [production]
14:27 <trueg@deploy1003> helmfile [dse-k8s-codfw] START helmfile.d/services/wdqs-next: apply [production]
14:23 <oblivian@cumin1004> START - Cookbook sre.hosts.provision for host wikikube-worker2049.mgmt.codfw.wmnet with chassis set policy GRACEFUL_RESTART and with Dell SCP reboot policy GRACEFUL [production]
14:23 <jelto@deploy1003> Finished scap deploy-service miscweb: First test deployment of miscweb using deploy-service and spiderpig (duration: 01m 54s) [production]
14:23 <oblivian@cumin1004> END (PASS) - Cookbook sre.k8s.pool-depool-node (exit_code=0) depool for host wikikube-worker2049.codfw.wmnet [production]
14:23 <moritzm> restarting pybal on lvs2014 T439730 [production]