|
2019-09-03
ยง
|
| 15:36 |
<James_F> |
Zuul: Add phan dependencies for MachineVision |
[releng] |
| 15:32 |
<ebernhardson> |
unban elastic1027 from production-search-eqiad |
[production] |
| 15:20 |
<fdans> |
creating test Cassandra keyspace "local_group_default_T_request_per_file_TEST" |
[analytics] |
| 15:07 |
<hashar@deploy1001> |
rebuilt and synchronized wikiversions files: testwiki 1.34.0-wmf.21 for T231894 - T220746 |
[production] |
| 14:57 |
<hashar@deploy1001> |
rebuilt and synchronized wikiversions files: Rollback group0 to 1.34.0-wmf.21 - T220746 |
[production] |
| 14:45 |
<hashar@deploy1001> |
rebuilt and synchronized wikiversions files: group0 to 1.34.0-wmf.21 - T220746 |
[production] |
| 14:39 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Promote db1133 as wikitech master T229657 (duration: 00m 54s) |
[production] |
| 14:34 |
<James_F> |
Zuul: And wmf/ branches for VisualEditor core. |
[releng] |
| 14:28 |
<hashar@deploy1001> |
Finished scap: testwiki to 1.34.0-wmf.21 and rebuild l10n cache - T220746 (duration: 50m 09s) |
[production] |
| 14:21 |
<moritzm> |
upgrading app server canaries to PHP 7.2.22 T230024 |
[production] |
| 14:21 |
<James_F> |
Zuul: Drop EducationProgram from dependencies |
[releng] |
| 13:44 |
<joal@deploy1001> |
Started deploy [analytics/refinery@8b17711]: Fixes for regualr analytics deploy |
[production] |
| 13:43 |
<joal> |
Deploying refinery using scap for fixes |
[analytics] |
| 13:38 |
<hashar@deploy1001> |
Started scap: testwiki to 1.34.0-wmf.21 and rebuild l10n cache - T220746 |
[production] |
| 13:30 |
<joal> |
Kill-restart mediawiki-history jobs (denormalize, check_denormalize, reduced, metrics, wikitext) |
[analytics] |
| 13:26 |
<joal> |
Kill-restart geoeditors jobs (monthly, yearly and druid) |
[analytics] |
| 13:26 |
<hashar> |
Gerrit should be fine again, apparently was due to the wmf branch cut taking too much resources (sic) - T231872 filled to investigate |
[production] |
| 13:25 |
<hashar> |
1.34.0-wmf.21 cut |
[production] |
| 13:21 |
<joal> |
Kill-restart edit jobs (hourly and druid) |
[analytics] |
| 13:16 |
<hashar> |
Gerrit has some random times out from time to time (no reason) |
[production] |
| 13:14 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Depool db1073 from wikitech T229657', diff saved to https://phabricator.wikimedia.org/P9038 and previous config saved to /var/cache/conftool/dbconfig/20190903-131456-marostegui.json |
[production] |
| 13:13 |
<marostegui> |
Re-enable puppet on db1073 and db1133 T229657 |
[production] |
| 13:11 |
<marostegui> |
Reload haproxy on dbproxy1005 T229657 |
[production] |
| 13:10 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Set wikitech back to RW after maintenance T229657', diff saved to https://phabricator.wikimedia.org/P9037 and previous config saved to /var/cache/conftool/dbconfig/20190903-131000-marostegui.json |
[production] |
| 13:09 |
<moritzm> |
upgrading remaining mwdebug servers to PHP 7.2.22 T230024 |
[production] |
| 13:09 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Promote db1133 to wikitech master T229657', diff saved to https://phabricator.wikimedia.org/P9036 and previous config saved to /var/cache/conftool/dbconfig/20190903-130937-marostegui.json |
[production] |
| 13:08 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Set wikitech as read-only for maintenance T229657', diff saved to https://phabricator.wikimedia.org/P9035 and previous config saved to /var/cache/conftool/dbconfig/20190903-130839-marostegui.json |
[production] |
| 13:06 |
<joal> |
Kill-restart unique_devices per_project_familly jobs (daily, monthly, druid daily, druid daily aggregated monthly, and druid monthly) |
[analytics] |
| 13:01 |
<marostegui@cumin1001> |
dbctl commit (dc=all): 'Set wikitech as read-only for maintenance T229657', diff saved to https://phabricator.wikimedia.org/P9033 and previous config saved to /var/cache/conftool/dbconfig/20190903-130113-marostegui.json |
[production] |
| 13:00 |
<marostegui> |
Failover m5 from db1073 to db1133 - T229657 |
[production] |
| 13:00 |
<joal> |
Kill-restart unique_devices per_domain jobs (daily, monthly, druid daily, druid daily aggregated monthly, and druid monthly) |
[analytics] |
| 12:52 |
<moritzm> |
uploaded PHP 7.2.22 to component/php72 T230024 |
[production] |
| 12:43 |
<joal> |
Kill-restart mobile-apps jobs (app-session, uniques daily and monthly) |
[analytics] |
| 12:42 |
<jeh> |
Set Icingia downtime on cloudcontrol100[34]and cloudservices100[34] for database switch over T229657 |
[openstack] |
| 12:39 |
<moritzm> |
upgrading mwdebug2001 to PHP 7.2.22 |
[production] |
| 12:34 |
<joal> |
Kill-restart virtualpageview druid jobs (daily and monthly) |
[analytics] |
| 12:29 |
<joal> |
Kill-restart wikidata jobs (article_placeholder, coeditors, specialentitydata) |
[analytics] |
| 12:29 |
<hashar> |
Cutting wmf/1.34.0-wmf.21 # T220746 |
[production] |
| 12:28 |
<joal> |
Fix interlanguage for naming convention |
[analytics] |
| 12:24 |
<joal> |
Kill-restart interlanguage job |
[analytics] |
| 12:20 |
<joal> |
Kill restart browser-general and clickstream |
[analytics] |
| 12:19 |
<hashar@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.34.0-wmf.20 |
[production] |
| 12:17 |
<joal> |
Manually create success-files for banner_activity monthly to start |
[analytics] |
| 12:11 |
<joal> |
Kill-restart banner-activity jobs (daily and monthly) |
[analytics] |
| 12:08 |
<joal> |
Restart mediarequest job after hotfix (renaming) and needed ops (table change and data move) |
[analytics] |
| 12:02 |
<marostegui> |
Disable puppet on db1073 and db1133 - T229657 |
[production] |
| 11:55 |
<marostegui> |
Change topology on m5 and make everything replicate from db1133 - T229657 |
[production] |
| 11:48 |
<marostegui> |
Downtime m5 hosts T229657 |
[production] |
| 11:43 |
<joal> |
Kill-restart virtualpageview_hourly |
[analytics] |
| 11:42 |
<joal> |
Kill mediarequest-hourly (more ops to do before restarting) |
[analytics] |