1401-1450 of 10000 results (31ms)
2020-11-05 §
06:51 <marostegui@cumin1001> dbctl commit (dc=all): 'es1017 (re)pooling @ 75%: After cloning es1031 T261717', diff saved to https://phabricator.wikimedia.org/P13195 and previous config saved to /var/cache/conftool/dbconfig/20201105-065107-root.json [production]
06:40 <marostegui@cumin1001> dbctl commit (dc=all): 'es1016 (re)pooling @ 50%: After cloning es1029 T261717', diff saved to https://phabricator.wikimedia.org/P13193 and previous config saved to /var/cache/conftool/dbconfig/20201105-064010-root.json [production]
06:36 <marostegui@cumin1001> dbctl commit (dc=all): 'es1013 (re)pooling @ 50%: After cloning es1030 T261717', diff saved to https://phabricator.wikimedia.org/P13192 and previous config saved to /var/cache/conftool/dbconfig/20201105-063610-root.json [production]
06:36 <marostegui@cumin1001> dbctl commit (dc=all): 'es1017 (re)pooling @ 50%: After cloning es1031 T261717', diff saved to https://phabricator.wikimedia.org/P13191 and previous config saved to /var/cache/conftool/dbconfig/20201105-063603-root.json [production]
06:34 <elukey> truncate application_1601916545561_129457's taskmanager.log (~600G) on an-worker1113 due to partition 'e' full [production]
06:25 <marostegui@cumin1001> dbctl commit (dc=all): 'es1016 (re)pooling @ 25%: After cloning es1029 T261717', diff saved to https://phabricator.wikimedia.org/P13190 and previous config saved to /var/cache/conftool/dbconfig/20201105-062507-root.json [production]
06:24 <marostegui@cumin1001> dbctl commit (dc=all): 'es1013 (re)pooling @ 25%: After cloning es1027 T261717', diff saved to https://phabricator.wikimedia.org/P13189 and previous config saved to /var/cache/conftool/dbconfig/20201105-062454-root.json [production]
06:24 <marostegui@cumin1001> dbctl commit (dc=all): 'es1017 (re)pooling @ 25%: After cloning es1028 T261717', diff saved to https://phabricator.wikimedia.org/P13188 and previous config saved to /var/cache/conftool/dbconfig/20201105-062446-root.json [production]
01:57 <milimetric@deploy1001> Finished deploy [analytics/refinery@6913407] (thin): Regular analytics weekly train THIN [analytics/refinery@6913407] (duration: 00m 08s) [production]
01:56 <milimetric@deploy1001> Started deploy [analytics/refinery@6913407] (thin): Regular analytics weekly train THIN [analytics/refinery@6913407] [production]
01:56 <milimetric@deploy1001> Finished deploy [analytics/refinery@6913407]: Regular analytics weekly train [analytics/refinery@6913407] (duration: 08m 34s) [production]
01:47 <milimetric@deploy1001> Started deploy [analytics/refinery@6913407]: Regular analytics weekly train [analytics/refinery@6913407] [production]
2020-11-04 §
20:36 <Urbanecm> Late B&C Morning window completed, deployment host is clear [production]
20:36 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: ee0ba541fa55f6707276fdc5bd3f032cb9be3e60: Disable the search in header A/B test (T265333) (duration: 01m 06s) [production]
20:33 <ejegg> updated payments-wiki from 1ad4ba9639 to 388490e86d [production]
20:31 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Migrate NewcomerTask event stream to EventGate on testwiki - T259163 (duration: 01m 07s) [production]
20:17 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: 82579bf9d71bd3c9d97da0132ce8d92a8863da5b: Enable wgImagePreconnect on remaining wikis (T123582) (duration: 01m 06s) [production]
20:12 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: d2a57725f8f6fdaa3f40c834e84b43a0260077f2: Enable DiscussionTools as a beta feature on almost all Wikipedias (T266303) (duration: 01m 07s) [production]
20:08 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: fb5c03262c20b5e99b3c2f6e91abb024f12da1f5: Enable wgCheckUserLogLogins at all wikis but loginwiki (T253802) (duration: 01m 08s) [production]
19:59 <brennen@deploy1001> Finished scap: testwikis wikis to 1.36.0-wmf.16 (duration: 62m 44s) [production]
18:57 <brennen@deploy1001> Started scap: testwikis wikis to 1.36.0-wmf.16 [production]
18:52 <brennen@deploy1001> Pruned MediaWiki: 1.36.0-wmf.10 (duration: 27m 38s) [production]
18:51 <Urbanecm> Strip 2FA for Mark83 at SUL (T267257) [production]
18:20 <elukey> restart memcached on mc1036 to pick up new settings (see https://gerrit.wikimedia.org/r/639099) [production]
18:15 <hknust> holger@mwmaint1002 END - Run updateRestrictions.php [production]
17:44 <hknust> holger@mwmaint1002 START - Run updateRestrictions.php [production]
17:22 <jiji@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
17:20 <jiji@cumin1001> START - Cookbook sre.hosts.downtime [production]
17:15 <zpapierski@deploy1001> Finished deploy [wikimedia/discovery/analytics@8e8d2d4]: Deploying dc switch (duration: 01m 15s) [production]
17:13 <zpapierski@deploy1001> Started deploy [wikimedia/discovery/analytics@8e8d2d4]: Deploying dc switch [production]
17:07 <effie> Reimage mc1036 for real this time [production]
16:40 <brennen> 1.36.0-wmf.16 was branched at f51ccd2ccef8cba0e7d874b6f7cf4b73bcd36636 for T263182 [production]
16:10 <filippo@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
16:10 <filippo@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:39 <effie> Reimage mc1036 to buster - T252391 [production]
15:25 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Migrate ContentTranslationAbuseFilter event stream to EventGate on all wikis - T259163 (duration: 00m 58s) [production]
15:19 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:19 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:18 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
15:18 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
15:09 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Migrate ContentTranslationAbuseFilter event stream to EventGate on testwiki - T259163 (duration: 00m 59s) [production]
14:37 <jynus> restart mysql at db1133 T266483 [production]
14:35 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:35 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:35 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:35 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:35 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:34 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]
14:19 <kormat@cumin1001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
14:19 <kormat@cumin1001> START - Cookbook sre.hosts.downtime [production]