5451-5500 of 10000 results (85ms)
2018-11-19 §
13:41 <joal@deploy1001> Started deploy [analytics/aqs/deploy@7cde8c8]: Update unique-devices schema adding 2 fields [production]
13:39 <fdans@deploy1001> Finished deploy [analytics/aqs/deploy@7cde8c8]: Deploying AQS to add two new fields to uniques (duration: 06m 18s) [production]
13:39 <akosiaris> cumin -b1 -s 300 'ores2*' 'enable-puppet "merge of https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/474158/" ; puppet agent -t ; service uwsgi-ores restart ; service celery-ores-worker restart' [production]
13:36 <akosiaris> disable puppet on ores1* and ores2* for slow deployment of https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/474158/ [production]
13:33 <fdans@deploy1001> Started deploy [analytics/aqs/deploy@7cde8c8]: Deploying AQS to add two new fields to uniques [production]
13:21 <gtirloni> T207377 icinga downtime and reboot of labcontrol1001 and labservices1001 [production]
13:08 <arturo> T207377 icinga downtime and reboot of cloudcontrol1003 and cloudservices1003 [production]
13:06 <raynor> EU SWAT finished [production]
13:03 <pmiazga@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:474679]|In SecurePoll use gpg1 to avoid gpg-agent autostart (T209802)]] (duration: 00m 48s) [production]
12:50 <raynor> EU SWAT reopened [production]
12:40 <raynor> EU SWAT finished [production]
12:38 <pmiazga@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:472918]|Enable autopatrol, patrol, rollback rights and RCPatrol on srwiktionary (T209252)]] (duration: 00m 46s) [production]
12:21 <pmiazga@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:474124]|Remove wgMetaNamespaceTalk for shnwiki (T206777)]] (duration: 00m 46s) [production]
12:10 <pmiazga@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:473225]|Enable Schema.org page split test at 50% sampling (T208755)]] (duration: 00m 46s) [production]
11:33 <gtirloni> labsdb1011 upgraded packages on labsdb1011 (pre-work T209517) [production]
11:20 <elukey> restart memcached on mc1020 to apply -R 200 settings (shard wiped) - T208844 [production]
10:41 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1078 T209754 (duration: 00m 46s) [production]
10:21 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Increase weight for db1078 T209754 (duration: 00m 46s) [production]
10:21 <banyek> stopping replication on db2076 (T85757) [production]
10:11 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Increase weight for db1078 T209754 (duration: 00m 46s) [production]
09:57 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1123 and increase weight for db1078 T209754 (duration: 00m 46s) [production]
09:48 <marostegui> Rename table foundationwiki.petition_data on db1078 - T208979 [production]
09:46 <marostegui> Drop empty testwiki.petition_data from db1075 with replication - T208979 [production]
09:43 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Slowly repool db1123 and db1078 T209754 (duration: 00m 46s) [production]
09:10 <Nikerabbit> Rebuilt message group stats cache for T208521 [production]
08:43 <banyek> executing schema change on db2095 (T85757) [production]
07:57 <marostegui> Stop MySQL on db1123 - T209754 [production]
07:56 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1123 to clone db1078 T209754 (duration: 00m 47s) [production]
06:21 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Add db1078 line back to config file but depooled T209754 (duration: 00m 51s) [production]
06:20 <marostegui@deploy1001> sync-file aborted: Add db1078 line back to config file but depooled T209754 (duration: 00m 02s) [production]
2018-11-18 §
17:26 <andrewbogott> restarting cp1078 from mgmt console [production]
09:00 <elukey> cleaned up analytics1039 and restarted Yarn [production]
03:46 <Zoranzoki21> Starting equalization translations for Serbian Cyrillic (sr-ec) and Serbian Latin (sr-el). Possible lags on translatewiki.net due to excessive number of operations [production]
2018-11-17 §
07:02 <volans|off> 'reset modified attributes' on IcingaUI for db1078 (and mgmt) and all its services [production]
06:38 <oblivian@deploy1001> Synchronized wmf-config/db-eqiad.php: Depooling db1078 (duration: 00m 59s) [production]
02:54 <RoanKattouw> Deployed patches for T208112, T208109, T208110 [production]
2018-11-16 §
23:13 <smalyshev@deploy1001> Finished deploy [wdqs/wdqs@ee91c41]: Deploy on test wdqs1010 (duration: 00m 23s) [production]
23:12 <smalyshev@deploy1001> Started deploy [wdqs/wdqs@ee91c41]: Deploy on test wdqs1010 [production]
16:23 <Trey314159> reindexing Chinese wikis on elastic@eqiad and elastic@codfw (T209156) [production]
15:46 <moritzm> rebooting debmonitor* instances for kernel security update and to pick up SSBD [production]
15:01 <hashar> restarting zuul with 1300 events to process [production]
14:56 <marostegui> Create ipblocks_restrictions on labswiki and labtestwiki on db1073 - T209674 [production]
14:56 <ema> upgrade cp-ats to 8.0.0-1wm2 T204225 T204209 [production]
14:39 <ema> trafficserver 8.0.0-1wm2 uploaded to stretch-wikimedia T204225 T204209 [production]
14:36 <hashar> Gracefully stopping zuul (kill -SIGUSR1) [production]
14:29 <_joe_> re-depooling mw1261 for php-fpm testing [production]
14:28 <oblivian@puppetmaster1001> conftool action : set/pooled=yes; selector: name=mw126[1-6].*,dc=eqiad,cluster=appserver [production]
14:26 <_joe_> repooling the mw canaries [production]
13:02 <moritzm> installing spamassassin security update on mendelevium [production]
12:10 <godog> reboot restbase1014, nothing on console [production]