651-700 of 10000 results (39ms)
2017-02-06 ยง
18:06 <marostegui> Start to transfer commonswiki ibd and cfg from db1064 to labsdb1010 - https://phabricator.wikimedia.org/T153743 [production]
17:41 <mobrovac> restbase end deploy of ea980cc5 [production]
17:10 <mobrovac> restbase start deploy of ea980cc5 [production]
17:03 <hashar> Nodepool/CI back up [production]
16:51 <marostegui> Stop MySQL and shutdown db1072 for raid and BBU replacement - T156226 [production]
16:51 <marostegui> Stop MySQL and shutdown db1072 for raid [production]
16:35 <hashar> Nodepool Jessie images are back up. Trusty one is being rebuild.. [production]
15:55 <elukey> mc2029 shutdown for DC ops [production]
15:46 <hashar> Stopping Nodepool for maintenance [production]
15:42 <oblivian@tin> Finished deploy [changeprop/deploy@5f932a3]: Revert ORES throttling (duration: 03m 49s) [production]
15:39 <oblivian@tin> Started deploy [changeprop/deploy@5f932a3]: Revert ORES throttling [production]
15:38 <moritzm> installing lcms security updates on mediawiki canaries [production]
15:17 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=wdqs1001.eqiad.wmnet [production]
15:16 <gehel> starting reimage of wdqs1001 - T144536 [production]
15:13 <ema> cache_text: upgrade to jessie 8.7 and reboot into kernel 4.4.2-3+wmf8 T155401!log cache_maps: upgrade to jessie 8.7 and reboot into kernel 4.4.2-3+wmf8 T155401 [production]
15:10 <addshore@tin> Synchronized php-1.29.0-wmf.10/extensions/ORES/extension.json: T157206 [[gerrit:336215|ORES - Remove all (except meta) API funcationality hooks]] (take2) (duration: 00m 54s) [production]
14:51 <moritzm> upgrading mw1262-mw1265 to hhvm 3.12.11+dfsg-1+wmf2 [production]
14:46 <addshore> EU SWAT all done! [production]
14:45 <addshore@tin> Synchronized wmf-config/InitialiseSettings-labs.php: PROD-NOOP [[gerrit:333603|Enable InterwikiSorting on beta]] (duration: 00m 39s) [production]
14:41 <addshore@tin> Synchronized wmf-config/Wikibase.php: T155995 [[gerrit:333885|Rm InterwikiSorting settings from wmgWikibaseClientSettings]] PT 2/2 (duration: 00m 39s) [production]
14:40 <addshore@tin> Synchronized wmf-config/InitialiseSettings.php: T155995 [[gerrit:333885|Rm InterwikiSorting settings from wmgWikibaseClientSettings]] PT 1/2 (duration: 00m 41s) [production]
14:33 <gehel> resetting analytics-wmde/scripts on stat1002 to the correct "production" branch [production]
14:32 <ema> cp2018 stuck rebooting, powercycled [production]
14:30 <addshore@tin> Synchronized dblists/compact-language-links.dblist: T157108 & T157112 [[gerrit:335781|Deploy Compact Language Links out of beta in French/Dutch Wikipedia]] (duration: 00m 40s) [production]
14:23 <addshore@tin> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:333936|Copy InterwikiSorting settings from wmgWikibaseClientSettings]] (duration: 00m 40s) [production]
14:19 <marostegui> Stop MySQL and shutdown db2060 for maintenance - T156161 [production]
14:15 <addshore@tin> Synchronized wmf-config/InitialiseSettings.php: T155717 [[gerrit:332909|Enable TwoColConflict on mw.org]] (duration: 00m 40s) [production]
14:09 <addshore@tin> Synchronized php-1.29.0-wmf.10/extensions/ORES/extension.json: T157206 [[gerrit:336215|ORES - Remove all (except meta) API funcationality hooks]] (duration: 00m 51s) [production]
14:05 <volans> fixed duplicate entries in source.list on db2040 and es2002 (trusty) [production]
13:44 <ema> cache_misc: upgrade to jessie 8.7 and reboot into kernel 4.4.2-3+wmf8 T155401 [production]
13:30 <elukey> applied https://gerrit.wikimedia.org/r/#/c/336203/ manually to analytics1028 (hadoop worker node) as live test - T156932 [production]
13:23 <gehel> removing stale puppet lock file on elastic10(22|26) [production]
12:03 <moritzm> upgrading mwdebug* and mw1261 to hhvm 3.12.11+dfsg-1+wmf2 [production]
10:21 <oblivian@tin> Finished deploy [changeprop/deploy@ac11ebe]: Deploying ores concurrency/disabling (duration: 00m 38s) [production]
10:20 <oblivian@tin> Started deploy [changeprop/deploy@ac11ebe]: Deploying ores concurrency/disabling [production]
10:18 <oblivian@tin> Started deploy [changeprop/deploy@ac11ebe]: Deploying ores concurrency/disabling to canary [production]
10:17 <gehel> data import complete for wdqs1003, repooling - T152643 [production]
10:14 <marostegui> Started to transfer commonswiki (ibd and cfg) from db1064 to labsdb1011 - T153743 [production]
10:14 <ema> cache_maps: upgrade to jessie 8.7 and reboot into kernel 4.4.2-3+wmf8 T155401 [production]
09:40 <gehel> elasticsearch - reindexing from 2017-02-04T20:00:00Z to 2017-02-05T23:59:00Z - T139043 [production]
09:36 <hoo> Removed 2fa from an account, per T157191 [production]
09:30 <marostegui> Stop MySQL Replication on db1064 for maintenance - T153743 [production]
09:26 <marostegui> Deploy ALTER table db1028 metawiki.pagelinks - T153300 [production]
09:25 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1028 - T153300 (duration: 00m 42s) [production]
08:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1064 - T153743 (duration: 00m 41s) [production]
08:19 <elukey@puppetmaster1001> conftool action : set/pooled=yes; selector: name=aqs1008.eqiad.wmnet [production]
07:38 <elukey> bootstrapping aqs1009-a (new AQS cassandra instance) [production]
07:30 <marostegui> Stop MySQL on db1095 to snapshot it to es1017 - T153743 [production]
07:03 <marostegui> Upgrade mariadb+packages db1039 - T153300 [production]
07:01 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2060 - T156161 (duration: 00m 40s) [production]