151-200 of 10000 results (48ms)
2026-09-02 ยง
15:53 <slyngshede@cumin1003> START - Cookbook sre.switchdc.mediawiki.02-set-readonly for datacenter switchover from codfw to eqiad [production]
15:53 <slyngshede@cumin1003> END (PASS) - Cookbook sre.switchdc.mediawiki.01-stop-maintenance (exit_code=0) for datacenter switchover from codfw to eqiad [production]
15:53 <slyngshede@cumin1003> START - Cookbook sre.switchdc.mediawiki.01-stop-maintenance for datacenter switchover from codfw to eqiad [production]
15:53 <slyngshede@cumin1003> END (PASS) - Cookbook sre.switchdc.mediawiki.00-reduce-ttl (exit_code=0) for datacenter switchover from codfw to eqiad [production]
15:47 <slyngshede@cumin1003> START - Cookbook sre.switchdc.mediawiki.00-reduce-ttl for datacenter switchover from codfw to eqiad [production]
15:46 <slyngshede@cumin1003> END (ERROR) - Cookbook sre.switchdc.mediawiki.00-optional-warmup-caches (exit_code=97) for datacenter switchover from codfw to eqiad [production]
15:45 <cdobbins@cumin1003> START - Cookbook sre.cdn.roll-restart-ats rolling restart_daemons on A:cp-upload_eqsin [production]
15:44 <cdobbins@cumin1003> END (PASS) - Cookbook sre.cdn.roll-restart-ats (exit_code=0) rolling restart_daemons on A:cp-text_eqsin [production]
15:42 <sukhe> sukhe@lvs1019:~$ sudo systemctl restart pybal.service [production]
15:39 <atsuko@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
15:38 <atsuko@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/airflow-test-k8s: apply [production]
15:31 <cdobbins@cumin1003> START - Cookbook sre.cdn.roll-restart-ats rolling restart_daemons on A:cp-text_eqsin [production]
15:28 <cmooney@cumin1003> END (PASS) - Cookbook sre.deploy.python-code (exit_code=0) homer to cumin1004.eqiad.wmnet with reason: deploy homer to cumin1004 - cmooney@cumin1003 [production]
15:27 <cdobbins@cumin1003> END (PASS) - Cookbook sre.cdn.roll-restart-ats (exit_code=0) rolling restart_daemons on A:cp-upload_magru [production]
15:27 <cmooney@cumin1003> START - Cookbook sre.deploy.python-code homer to cumin1004.eqiad.wmnet with reason: deploy homer to cumin1004 - cmooney@cumin1003 [production]
15:22 <slyngshede@cumin1003> START - Cookbook sre.switchdc.mediawiki.00-optional-warmup-caches for datacenter switchover from codfw to eqiad [production]
15:22 <slyngshede@cumin1003> END (PASS) - Cookbook sre.switchdc.mediawiki.00-lock-scap (exit_code=0) for datacenter switchover from codfw to eqiad [production]
15:22 <root@deploy1003> Locking from deployment [ALL REPOSITORIES]: Datacenter switchover from codfw to eqiad - T436781 [production]
15:22 <slyngshede@cumin1003> START - Cookbook sre.switchdc.mediawiki.00-lock-scap for datacenter switchover from codfw to eqiad [production]
15:21 <slyngshede@cumin1003> END (PASS) - Cookbook sre.switchdc.mediawiki.00-downtime-db-readonly-checks (exit_code=0) for datacenter switchover from codfw to eqiad [production]
15:21 <slyngshede@cumin1003> START - Cookbook sre.switchdc.mediawiki.00-downtime-db-readonly-checks for datacenter switchover from codfw to eqiad [production]
15:17 <sukhe> sukhe@lvs1020:~$ sudo systemctl restart pybal.service [production]
15:15 <cdobbins@cumin1003> START - Cookbook sre.cdn.roll-restart-ats rolling restart_daemons on A:cp-upload_magru [production]
15:11 <moritzm> import jenkins 2.568.3 to thirdparty/jenkins for trixie-wikimedia [production]
14:56 <cdobbins@cumin1003> END (PASS) - Cookbook sre.cdn.roll-restart-ats (exit_code=0) rolling restart_daemons on A:cp-text_magru [production]
14:44 <cdobbins@cumin1003> START - Cookbook sre.cdn.roll-restart-ats rolling restart_daemons on A:cp-text_magru [production]
14:32 <moritzm> installing pdns-recursor security updates [production]
14:27 <apine@deploy1003> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
14:27 <apine@deploy1003> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
14:26 <apine@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
14:26 <apine@deploy1003> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
14:20 <apine@deploy1003> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
14:15 <ladsgroup@deploy1003> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]
14:12 <ladsgroup@deploy1003> helmfile [eqiad] START helmfile.d/services/thumbor: apply [production]
14:09 <apine@deploy1003> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
14:09 <brouberol@deploy1003> helmfile [dse-k8s-codfw] DONE helmfile.d/admin 'apply'. [production]
14:09 <apine@deploy1003> helmfile [codfw] DONE helmfile.d/services/wikifunctions: apply [production]
14:08 <apine@deploy1003> helmfile [codfw] START helmfile.d/services/wikifunctions: apply [production]
14:08 <brouberol@deploy1003> helmfile [dse-k8s-codfw] START helmfile.d/admin 'apply'. [production]
14:08 <ladsgroup@deploy1003> helmfile [codfw] DONE helmfile.d/services/thumbor: apply [production]
14:08 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/admin 'apply'. [production]
14:07 <brouberol@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/admin 'apply'. [production]
14:06 <apine@deploy1003> helmfile [staging] DONE helmfile.d/services/wikifunctions: apply [production]
14:06 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply [production]
14:06 <apine@deploy1003> helmfile [staging] START helmfile.d/services/wikifunctions: apply [production]
14:06 <javiermonton@deploy1003> helmfile [dse-k8s-eqiad] START helmfile.d/dse-k8s-services/pageview-trending-relative-next: apply [production]
14:06 <ladsgroup@deploy1003> helmfile [codfw] START helmfile.d/services/thumbor: apply [production]
14:04 <ladsgroup@deploy1003> helmfile [staging] DONE helmfile.d/services/thumbor: apply [production]
14:04 <ladsgroup@deploy1003> helmfile [staging] START helmfile.d/services/thumbor: apply [production]
13:44 <moritzm> bounce tcpircbot-logmsgbot/tcpircbot-logmsgbot_cloud on alert1002 to allow cumin1004 T427897 [production]