|
2020-11-05
§
|
| 06:34 |
<elukey> |
truncate application_1601916545561_129457's taskmanager.log (~600G) on an-worker1113 due to partition 'e' full |
[production] |
| 06:25 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'es1016 (re)pooling @ 25%: After cloning es1029 T261717', diff saved to https://phabricator.wikimedia.org/P13190 and previous config saved to /var/cache/conftool/dbconfig/20201105-062507-root.json |
[production] |
| 06:24 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'es1013 (re)pooling @ 25%: After cloning es1027 T261717', diff saved to https://phabricator.wikimedia.org/P13189 and previous config saved to /var/cache/conftool/dbconfig/20201105-062454-root.json |
[production] |
| 06:24 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'es1017 (re)pooling @ 25%: After cloning es1028 T261717', diff saved to https://phabricator.wikimedia.org/P13188 and previous config saved to /var/cache/conftool/dbconfig/20201105-062446-root.json |
[production] |
| 01:57 |
<milimetric@deploy1001> |
Finished deploy [analytics/refinery@6913407] (thin): Regular analytics weekly train THIN [analytics/refinery@6913407] (duration: 00m 08s) |
[production] |
| 01:56 |
<milimetric@deploy1001> |
Started deploy [analytics/refinery@6913407] (thin): Regular analytics weekly train THIN [analytics/refinery@6913407] |
[production] |
| 01:56 |
<milimetric@deploy1001> |
Finished deploy [analytics/refinery@6913407]: Regular analytics weekly train [analytics/refinery@6913407] (duration: 08m 34s) |
[production] |
| 01:47 |
<milimetric@deploy1001> |
Started deploy [analytics/refinery@6913407]: Regular analytics weekly train [analytics/refinery@6913407] |
[production] |
|
2020-11-04
§
|
| 20:36 |
<Urbanecm> |
Late B&C Morning window completed, deployment host is clear |
[production] |
| 20:36 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: ee0ba541fa55f6707276fdc5bd3f032cb9be3e60: Disable the search in header A/B test (T265333) (duration: 01m 06s) |
[production] |
| 20:33 |
<ejegg> |
updated payments-wiki from 1ad4ba9639 to 388490e86d |
[production] |
| 20:31 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Migrate NewcomerTask event stream to EventGate on testwiki - T259163 (duration: 01m 07s) |
[production] |
| 20:17 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: 82579bf9d71bd3c9d97da0132ce8d92a8863da5b: Enable wgImagePreconnect on remaining wikis (T123582) (duration: 01m 06s) |
[production] |
| 20:12 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: d2a57725f8f6fdaa3f40c834e84b43a0260077f2: Enable DiscussionTools as a beta feature on almost all Wikipedias (T266303) (duration: 01m 07s) |
[production] |
| 20:08 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: fb5c03262c20b5e99b3c2f6e91abb024f12da1f5: Enable wgCheckUserLogLogins at all wikis but loginwiki (T253802) (duration: 01m 08s) |
[production] |
| 19:59 |
<brennen@deploy1001> |
Finished scap: testwikis wikis to 1.36.0-wmf.16 (duration: 62m 44s) |
[production] |
| 18:57 |
<brennen@deploy1001> |
Started scap: testwikis wikis to 1.36.0-wmf.16 |
[production] |
| 18:52 |
<brennen@deploy1001> |
Pruned MediaWiki: 1.36.0-wmf.10 (duration: 27m 38s) |
[production] |
| 18:51 |
<Urbanecm> |
Strip 2FA for Mark83 at SUL (T267257) |
[production] |
| 18:20 |
<elukey> |
restart memcached on mc1036 to pick up new settings (see https://gerrit.wikimedia.org/r/639099) |
[production] |
| 18:15 |
<hknust> |
holger@mwmaint1002 END - Run updateRestrictions.php |
[production] |
| 17:44 |
<hknust> |
holger@mwmaint1002 START - Run updateRestrictions.php |
[production] |
| 17:22 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 17:20 |
<jiji@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 17:15 |
<zpapierski@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@8e8d2d4]: Deploying dc switch (duration: 01m 15s) |
[production] |
| 17:13 |
<zpapierski@deploy1001> |
Started deploy [wikimedia/discovery/analytics@8e8d2d4]: Deploying dc switch |
[production] |
| 17:07 |
<effie> |
Reimage mc1036 for real this time |
[production] |
| 16:40 |
<brennen> |
1.36.0-wmf.16 was branched at f51ccd2ccef8cba0e7d874b6f7cf4b73bcd36636 for T263182 |
[production] |
| 16:10 |
<filippo@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 16:10 |
<filippo@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:39 |
<effie> |
Reimage mc1036 to buster - T252391 |
[production] |
| 15:25 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Migrate ContentTranslationAbuseFilter event stream to EventGate on all wikis - T259163 (duration: 00m 58s) |
[production] |
| 15:19 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 15:19 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:18 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 15:18 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 15:09 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Migrate ContentTranslationAbuseFilter event stream to EventGate on testwiki - T259163 (duration: 00m 59s) |
[production] |
| 14:37 |
<jynus> |
restart mysql at db1133 T266483 |
[production] |
| 14:35 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:35 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:35 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:35 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:35 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:34 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:19 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:19 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |
| 14:17 |
<elukey> |
upload 4.8.0-1+deb10u1 to buster-wikimedia |
[production] |
| 14:14 |
<jynus> |
restart mysqls at db209[789],db210[01], db2139, db2141 T266483 |
[production] |
| 14:03 |
<kormat@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
| 14:03 |
<kormat@cumin1001> |
START - Cookbook sre.hosts.downtime |
[production] |