2801-2850 of 10000 results (50ms)
2021-06-29 ยง
14:23 <jayme@cumin1001> MediaWiki read-only period ends at: 2021-06-29 14:23:23.504447 [production]
14:23 <jayme@cumin1001> START - Cookbook sre.switchdc.mediawiki.07-set-readwrite [production]
14:23 <jayme@cumin1001> END (PASS) - Cookbook sre.switchdc.mediawiki.06-set-db-readwrite (exit_code=0) [production]
14:23 <jayme@cumin1001> START - Cookbook sre.switchdc.mediawiki.06-set-db-readwrite [production]
14:23 <jayme@cumin1001> END (PASS) - Cookbook sre.switchdc.mediawiki.05-invert-redis-sessions (exit_code=0) [production]
14:22 <jayme@cumin1001> START - Cookbook sre.switchdc.mediawiki.05-invert-redis-sessions [production]
14:22 <jayme@cumin1001> END (PASS) - Cookbook sre.switchdc.mediawiki.04-switch-mediawiki (exit_code=0) [production]
14:22 <jayme@cumin1001> START - Cookbook sre.switchdc.mediawiki.04-switch-mediawiki [production]
14:22 <jayme@cumin1001> END (PASS) - Cookbook sre.switchdc.mediawiki.03-set-db-readonly (exit_code=0) [production]
14:21 <jayme@cumin1001> START - Cookbook sre.switchdc.mediawiki.03-set-db-readonly [production]
14:21 <jayme@cumin1001> END (PASS) - Cookbook sre.switchdc.mediawiki.02-set-readonly (exit_code=0) [production]
14:21 <jayme@cumin1001> MediaWiki read-only period starts at: 2021-06-29 14:21:26.671853 [production]
14:21 <jayme@cumin1001> START - Cookbook sre.switchdc.mediawiki.02-set-readonly [production]
14:15 <jayme@cumin1001> END (PASS) - Cookbook sre.switchdc.mediawiki.01-stop-maintenance (exit_code=0) [production]
14:15 <jayme@cumin1001> START - Cookbook sre.switchdc.mediawiki.01-stop-maintenance [production]
14:13 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) for 1:00:00 on 44 hosts with reason: DC switchover [production]
14:13 <kormat@cumin1001> START - Cookbook sre.hosts.downtime for 1:00:00 on 44 hosts with reason: DC switchover [production]
14:12 <jayme@cumin1001> END (PASS) - Cookbook sre.switchdc.mediawiki.00-warmup-caches (exit_code=0) [production]
14:11 <jayme@cumin1001> START - Cookbook sre.switchdc.mediawiki.00-warmup-caches [production]
14:10 <jayme@cumin1001> END (PASS) - Cookbook sre.switchdc.mediawiki.00-warmup-caches (exit_code=0) [production]
14:09 <jayme@cumin1001> START - Cookbook sre.switchdc.mediawiki.00-warmup-caches [production]
14:08 <jayme@cumin1001> END (PASS) - Cookbook sre.switchdc.mediawiki.00-reduce-ttl (exit_code=0) [production]
14:02 <jayme@cumin1001> START - Cookbook sre.switchdc.mediawiki.00-reduce-ttl [production]
14:01 <jayme@cumin1001> END (PASS) - Cookbook sre.switchdc.mediawiki.00-disable-puppet (exit_code=0) [production]
14:01 <jayme@cumin1001> START - Cookbook sre.switchdc.mediawiki.00-disable-puppet [production]
13:51 <otto@deploy1002> Started deploy [analytics/refinery@edc31a2] (hadoop-test): Regular analytics weekly train TEST [analytics/refinery@edc31a2] [production]
13:49 <otto@deploy1002> Finished deploy [analytics/refinery@edc31a2] (thin): Regular analytics weekly train THIN [analytics/refinery@edc31a2] (duration: 00m 07s) [production]
13:49 <otto@deploy1002> Started deploy [analytics/refinery@edc31a2] (thin): Regular analytics weekly train THIN [analytics/refinery@edc31a2] [production]
13:49 <otto@deploy1002> Finished deploy [analytics/refinery@edc31a2]: Regular analytics weekly train [analytics/refinery@COMMIT_HASH] (duration: 17m 42s) [production]
13:35 <volker-e@deploy1002> Finished deploy [design/style-guide@e97fccb]: Deploy design/style-guide: e97fccb styles: Add internationalization and accessibility note labels and treatments (#476) (duration: 00m 07s) [production]
13:34 <volker-e@deploy1002> Started deploy [design/style-guide@e97fccb]: Deploy design/style-guide: e97fccb styles: Add internationalization and accessibility note labels and treatments (#476) [production]
13:31 <otto@deploy1002> Started deploy [analytics/refinery@edc31a2]: Regular analytics weekly train [analytics/refinery@COMMIT_HASH] [production]
13:31 <ottomata> deploying refinery for weekly train [analytics]
11:54 <phuedx@deploy1002> Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:702095|vector: Finish enabling language switcher treatment A/B test on fawiki (T269093)]] (duration: 00m 56s) [production]
11:38 <ladsgroup@deploy1002> Synchronized php-1.37.0-wmf.11/extensions/Wikibase/repo/: Backport: [[gerrit:702018|Use EntityLookup backed TermLookup for Rdf PropertyStubs (T285634)]], Part II (duration: 00m 58s) [production]
11:36 <ladsgroup@deploy1002> Synchronized php-1.37.0-wmf.11/extensions/Wikibase/repo/includes/Rdf/PropertyStubRdfBuilder.php: Backport: [[gerrit:702018|Use EntityLookup backed TermLookup for Rdf PropertyStubs (T285634)]], Part I (duration: 00m 56s) [production]
11:35 <ladsgroup@deploy1002> sync-file aborted: Backport: [[gerrit:702018|Use EntityLookup backed TermLookup for Rdf PropertyStubs (T285634)]] (duration: 00m 10s) [production]
10:30 <moritzm> cleanup now unused nginx mods and former deps (various X11 libs and libxslt) on acmechief* after switch towards nginx-light T164456 [production]
10:24 <dcaro> running puppet on the buster bastions after 20000 minutes failing... might break something [tools]
09:28 <wm-bot> Depooled and removed worker toolsbeta-test-k8s-worker-3.toolsbeta.eqiad1.wikimedia.cloud. (T267140) - cookbook ran by dcaro@vulcanus [toolsbeta]
09:28 <wm-bot> Drained node toolsbeta-test-k8s-worker-3. (T267140) - cookbook ran by dcaro@vulcanus [toolsbeta]
09:27 <wm-bot> Draining node toolsbeta-test-k8s-worker-3... (T267140) - cookbook ran by dcaro@vulcanus [toolsbeta]
09:27 <wm-bot> Depooling and removing worker , will pick the oldest. (T267140) - cookbook ran by dcaro@vulcanus [toolsbeta]
09:27 <wm-bot> Added a new k8s worker toolsbeta-test-k8s-worker-6.toolsbeta.eqiad1.wikimedia.cloud to the worker pool - cookbook ran by dcaro@vulcanus [toolsbeta]
09:27 <moritzm> installing nettle security updates on buster [production]
09:18 <wm-bot> Adding a new k8s worker node - cookbook ran by dcaro@vulcanus [toolsbeta]
09:13 <wm-bot> Adding a new k8s worker node - cookbook ran by dcaro@vulcanus [toolsbeta]
09:13 <wm-bot> Depooled and removed worker toolsbeta-test-k8s-worker-2.toolsbeta.eqiad1.wikimedia.cloud. (T267140) - cookbook ran by dcaro@vulcanus [toolsbeta]
09:13 <wm-bot> Drained node toolsbeta-test-k8s-worker-2. (T267140) - cookbook ran by dcaro@vulcanus [toolsbeta]
09:12 <wm-bot> Draining node toolsbeta-test-k8s-worker-2... (T267140) - cookbook ran by dcaro@vulcanus [toolsbeta]