3451-3500 of 10000 results (94ms)
2024-03-20 §
14:45 <Dreamy_Jazz> Starting MediaModeration scanning script - https://wikitech.wikimedia.org/wiki/MediaModeration [production]
14:36 <jiji@cumin1002> END (PASS) - Cookbook sre.switchdc.mediawiki.09-run-puppet-on-db-masters (exit_code=0) [production]
14:29 <jiji@cumin1002> START - Cookbook sre.switchdc.mediawiki.09-run-puppet-on-db-masters [production]
14:27 <jiji@cumin1002> END (PASS) - Cookbook sre.switchdc.mediawiki.09-restore-ttl (exit_code=0) [production]
14:27 <jiji@cumin1002> START - Cookbook sre.switchdc.mediawiki.09-restore-ttl [production]
14:26 <jiji@cumin1002> END (PASS) - Cookbook sre.switchdc.mediawiki.08-start-maintenance (exit_code=0) [production]
14:24 <jiji@cumin1002> START - Cookbook sre.switchdc.mediawiki.08-start-maintenance [production]
14:23 <jiji@cumin1002> END (PASS) - Cookbook sre.switchdc.mediawiki.08-restart-mw-jobrunner (exit_code=0) [production]
14:23 <root@deploy2002> helmfile [codfw] [main] DONE helmfile.d/services/mw-jobrunner : sync [production]
14:21 <root@deploy2002> helmfile [codfw] [canary] DONE helmfile.d/services/mw-jobrunner : sync [production]
14:21 <root@deploy2002> helmfile [codfw] [main] START helmfile.d/services/mw-jobrunner : sync [production]
14:21 <root@deploy2002> helmfile [codfw] [canary] START helmfile.d/services/mw-jobrunner : sync [production]
14:21 <jiji@cumin1002> START - Cookbook sre.switchdc.mediawiki.08-restart-mw-jobrunner [production]
14:18 <marostegui> Test write T357547 [production]
14:18 <jiji@cumin1002> END (PASS) - Cookbook sre.switchdc.mediawiki.07-set-readwrite (exit_code=0) [production]
14:18 <jiji@cumin1002> MediaWiki read-only period ends at: 2024-03-20 14:18:32.727570 [production]
14:18 <jiji@cumin1002> START - Cookbook sre.switchdc.mediawiki.07-set-readwrite [production]
14:18 <jiji@cumin1002> END (PASS) - Cookbook sre.switchdc.mediawiki.06-set-db-readwrite (exit_code=0) [production]
14:18 <jiji@cumin1002> START - Cookbook sre.switchdc.mediawiki.06-set-db-readwrite [production]
14:17 <jiji@cumin1002> END (PASS) - Cookbook sre.switchdc.mediawiki.04-switch-mediawiki (exit_code=0) [production]
14:16 <jiji@cumin1002> START - Cookbook sre.switchdc.mediawiki.04-switch-mediawiki [production]
14:16 <jiji@cumin1002> END (PASS) - Cookbook sre.switchdc.mediawiki.03-set-db-readonly (exit_code=0) [production]
14:16 <jiji@cumin1002> START - Cookbook sre.switchdc.mediawiki.03-set-db-readonly [production]
14:15 <jiji@cumin1002> END (PASS) - Cookbook sre.switchdc.mediawiki.02-set-readonly (exit_code=0) [production]
14:15 <jiji@cumin1002> MediaWiki read-only period starts at: 2024-03-20 14:15:24.401121 [production]
14:15 <jiji@cumin1002> START - Cookbook sre.switchdc.mediawiki.02-set-readonly [production]
14:13 <jiji@cumin1002> END (PASS) - Cookbook sre.switchdc.mediawiki.01-stop-maintenance (exit_code=0) [production]
14:13 <jiji@cumin1002> START - Cookbook sre.switchdc.mediawiki.01-stop-maintenance [production]
14:03 <jiji@cumin1002> END (FAIL) - Cookbook sre.switchdc.mediawiki.01-stop-maintenance (exit_code=99) [production]
14:03 <jiji@cumin1002> START - Cookbook sre.switchdc.mediawiki.01-stop-maintenance [production]
14:02 <jiji@cumin1002> END (PASS) - Cookbook sre.switchdc.mediawiki.00-reduce-ttl (exit_code=0) [production]
13:57 <jiji@cumin1002> START - Cookbook sre.switchdc.mediawiki.00-reduce-ttl [production]
13:56 <jiji@cumin1002> END (PASS) - Cookbook sre.switchdc.mediawiki.00-downtime-db-readonly-checks (exit_code=0) [production]
13:56 <jiji@cumin1002> START - Cookbook sre.switchdc.mediawiki.00-downtime-db-readonly-checks [production]
13:55 <jiji@cumin1002> END (PASS) - Cookbook sre.switchdc.mediawiki.00-disable-puppet (exit_code=0) [production]
13:55 <jiji@cumin1002> START - Cookbook sre.switchdc.mediawiki.00-disable-puppet [production]
13:48 <jiji@deploy2002> Locking from deployment [ALL REPOSITORIES]: Datacenter Switchover - T357547 [production]
13:43 <akosiaris@deploy1002> helmfile [codfw] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
13:42 <akosiaris@deploy1002> helmfile [codfw] START helmfile.d/services/changeprop-jobqueue: apply [production]
13:42 <akosiaris@deploy1002> helmfile [eqiad] DONE helmfile.d/services/changeprop-jobqueue: apply [production]
13:42 <akosiaris> update chageprop-jobqueue to include rdb101{1,2} IPv6 related netpols [production]
13:41 <akosiaris@deploy1002> helmfile [eqiad] START helmfile.d/services/changeprop-jobqueue: apply [production]
13:32 <Lucas_WMDE> <moritzm> 13:16 UTC: installing libuv1 security updates on bullseye [re-log, original message wasn’t logged] [production]
13:20 <jayme> manually scaled up changeprop replicas in eqiad from 12 to 15 [production]
13:10 <logmsgbot> @deploy2002 helmfile [eqiad] DONE helmfile.d/services/cirrus-streaming-updater: apply [production]
13:10 <logmsgbot> @deploy2002 helmfile [eqiad] START helmfile.d/services/cirrus-streaming-updater: apply [production]
13:08 <moritzm> installing imagemagick security updates [production]
13:02 <jiji@deploy2002> helmfile [eqiad] DONE helmfile.d/services/thumbor: apply [production]
12:59 <slyngshede@cumin1002> END (PASS) - Cookbook sre.hosts.reimage (exit_code=0) for host idp-test2002.wikimedia.org with OS bookworm [production]
12:57 <brouberol@deploy2002> helmfile [dse-k8s-eqiad] DONE helmfile.d/dse-k8s-services/superset: apply [production]