2018-11-19
§
|
14:02 |
<joal@deploy1001> |
Finished deploy [analytics/aqs/deploy@7cde8c8]: Update unique-devices schema adding 2 fields (duration: 20m 57s) |
[production] |
13:55 |
<gtirloni> |
T207377 reboot cloudcontrol1004 |
[production] |
13:43 |
<moritzm> |
installing chromium security update on proton* (tested new upstream release in deployment-prep) |
[production] |
13:41 |
<joal@deploy1001> |
Started deploy [analytics/aqs/deploy@7cde8c8]: Update unique-devices schema adding 2 fields |
[production] |
13:39 |
<fdans@deploy1001> |
Finished deploy [analytics/aqs/deploy@7cde8c8]: Deploying AQS to add two new fields to uniques (duration: 06m 18s) |
[production] |
13:39 |
<akosiaris> |
cumin -b1 -s 300 'ores2*' 'enable-puppet "merge of https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/474158/" ; puppet agent -t ; service uwsgi-ores restart ; service celery-ores-worker restart' |
[production] |
13:36 |
<akosiaris> |
disable puppet on ores1* and ores2* for slow deployment of https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/474158/ |
[production] |
13:33 |
<fdans@deploy1001> |
Started deploy [analytics/aqs/deploy@7cde8c8]: Deploying AQS to add two new fields to uniques |
[production] |
13:21 |
<gtirloni> |
T207377 icinga downtime and reboot of labcontrol1001 and labservices1001 |
[production] |
13:08 |
<arturo> |
T207377 icinga downtime and reboot of cloudcontrol1003 and cloudservices1003 |
[production] |
13:06 |
<raynor> |
EU SWAT finished |
[production] |
13:03 |
<pmiazga@deploy1001> |
Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:474679]|In SecurePoll use gpg1 to avoid gpg-agent autostart (T209802)]] (duration: 00m 48s) |
[production] |
12:50 |
<raynor> |
EU SWAT reopened |
[production] |
12:40 |
<raynor> |
EU SWAT finished |
[production] |
12:38 |
<pmiazga@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:472918]|Enable autopatrol, patrol, rollback rights and RCPatrol on srwiktionary (T209252)]] (duration: 00m 46s) |
[production] |
12:21 |
<pmiazga@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:474124]|Remove wgMetaNamespaceTalk for shnwiki (T206777)]] (duration: 00m 46s) |
[production] |
12:10 |
<pmiazga@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:473225]|Enable Schema.org page split test at 50% sampling (T208755)]] (duration: 00m 46s) |
[production] |
11:33 |
<gtirloni> |
labsdb1011 upgraded packages on labsdb1011 (pre-work T209517) |
[production] |
11:20 |
<elukey> |
restart memcached on mc1020 to apply -R 200 settings (shard wiped) - T208844 |
[production] |
10:41 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1078 T209754 (duration: 00m 46s) |
[production] |
10:21 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increase weight for db1078 T209754 (duration: 00m 46s) |
[production] |
10:21 |
<banyek> |
stopping replication on db2076 (T85757) |
[production] |
10:11 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increase weight for db1078 T209754 (duration: 00m 46s) |
[production] |
09:57 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1123 and increase weight for db1078 T209754 (duration: 00m 46s) |
[production] |
09:48 |
<marostegui> |
Rename table foundationwiki.petition_data on db1078 - T208979 |
[production] |
09:46 |
<marostegui> |
Drop empty testwiki.petition_data from db1075 with replication - T208979 |
[production] |
09:43 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1123 and db1078 T209754 (duration: 00m 46s) |
[production] |
09:10 |
<Nikerabbit> |
Rebuilt message group stats cache for T208521 |
[production] |
08:43 |
<banyek> |
executing schema change on db2095 (T85757) |
[production] |
07:57 |
<marostegui> |
Stop MySQL on db1123 - T209754 |
[production] |
07:56 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1123 to clone db1078 T209754 (duration: 00m 47s) |
[production] |
06:21 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Add db1078 line back to config file but depooled T209754 (duration: 00m 51s) |
[production] |
06:20 |
<marostegui@deploy1001> |
sync-file aborted: Add db1078 line back to config file but depooled T209754 (duration: 00m 02s) |
[production] |
2018-11-16
§
|
23:13 |
<smalyshev@deploy1001> |
Finished deploy [wdqs/wdqs@ee91c41]: Deploy on test wdqs1010 (duration: 00m 23s) |
[production] |
23:12 |
<smalyshev@deploy1001> |
Started deploy [wdqs/wdqs@ee91c41]: Deploy on test wdqs1010 |
[production] |
16:23 |
<Trey314159> |
reindexing Chinese wikis on elastic@eqiad and elastic@codfw (T209156) |
[production] |
15:46 |
<moritzm> |
rebooting debmonitor* instances for kernel security update and to pick up SSBD |
[production] |
15:01 |
<hashar> |
restarting zuul with 1300 events to process |
[production] |
14:56 |
<marostegui> |
Create ipblocks_restrictions on labswiki and labtestwiki on db1073 - T209674 |
[production] |
14:56 |
<ema> |
upgrade cp-ats to 8.0.0-1wm2 T204225 T204209 |
[production] |
14:39 |
<ema> |
trafficserver 8.0.0-1wm2 uploaded to stretch-wikimedia T204225 T204209 |
[production] |
14:36 |
<hashar> |
Gracefully stopping zuul (kill -SIGUSR1) |
[production] |
14:29 |
<_joe_> |
re-depooling mw1261 for php-fpm testing |
[production] |
14:28 |
<oblivian@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=mw126[1-6].*,dc=eqiad,cluster=appserver |
[production] |