|
2017-01-24
ยง
|
| 23:09 |
<ebernhardson@tin> |
Synchronized php-1.29.0-wmf.9/includes/specials/SpecialSearch.php: Update special:search security patc h to not fatal (duration: 00m 44s) |
[production] |
| 23:04 |
<jynus> |
reimage db1066 |
[production] |
| 22:41 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1066 for reimage (duration: 00m 55s) |
[production] |
| 22:22 |
<Pchelolo> |
update RESTBase to 69065e2 |
[production] |
| 22:19 |
<Pchelolo> |
update RESTBase to 69065e2: canary on restbase1007 |
[production] |
| 22:13 |
<Pchelolo> |
update RESTBase to 69065e2: staging |
[production] |
| 21:55 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: repool db1065 as dump/vslow & clean up s1 comments (duration: 00m 43s) |
[production] |
| 21:43 |
<twentyafterfour> |
Finished group0 to wmf/1.29.0-wmf.9 (refs T15525) Changelog: https://www.mediawiki.org/wiki/MediaWiki_1.29/wmf.9/Changelog |
[production] |
| 21:34 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group0 wikis to 1.29.0-wmf.9 refs T155525 |
[production] |
| 21:33 |
<zhuyifei1999_> |
depooling encoding02 & 03, repooling encoding01 |
[video] |
| 21:31 |
<demon@tin> |
Synchronized docroot: Drop labs docroot, unused in prod (duration: 00m 44s) |
[production] |
| 21:30 |
<zhuyifei1999_> |
git pulling v2c code to 8cf788e across all encoding hosts |
[video] |
| 21:30 |
<ottomata> |
restarted hadoop-mapreduce-historyserver on analytics1001. it died to do OOM |
[analytics] |
| 21:22 |
<twentyafterfour@tin> |
Finished scap: test wikis to 1.29.0-wmf.9 refs T155525 (duration: 32m 37s) |
[production] |
| 20:49 |
<twentyafterfour@tin> |
Started scap: test wikis to 1.29.0-wmf.9 refs T155525 |
[production] |
| 20:49 |
<volans> |
disabled puppet on ruthenium to avoid the restart of parsoid-vd and parsoid-vd-client processes T156177 |
[production] |
| 20:09 |
<demon@tin> |
Synchronized docroot: Adding new wikimediafoundation.org docroot (duration: 01m 05s) |
[production] |
| 19:51 |
<volans> |
ruthenium: stopped parsoid-vd and parsoid-vd-client to avoid uncontrolled spawning of phantomjs childs |
[production] |
| 19:39 |
<volans> |
sudo service parsoid-vd stop on ruthenium |
[production] |
| 19:37 |
<twentyafterfour> |
branching 1.29.0-wmf.9 refs T154683 |
[production] |
| 19:35 |
<volans> |
killed 822 "/srv/visualdiff/node_modules/phantomjs/lib/phantom/bin/phantomjs" processes on ruthenium. RAM and swap full, host unresponsive |
[production] |
| 19:29 |
<jynus> |
change replication master of db1095 to db1065 |
[production] |
| 19:07 |
<jynus> |
change replication master of db1095 to db1052 |
[production] |
| 19:07 |
<demon@tin> |
Synchronized docroot/foundation/logos: rm some old junk logos (duration: 00m 42s) |
[production] |
| 18:58 |
<arlolra> |
Updated Parsoid to version d000fdb4 (T58846, T154804, T152633) |
[production] |
| 18:45 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@c1a14c0]: Retry updating Parsoid to d000fdb4 (duration: 04m 14s) |
[production] |
| 18:45 |
<paladox> |
deleting phabricator instance and recreating it, replacing phab-01 with a phabricator instance :) |
[phabricator] |
| 18:43 |
<mutante> |
please stop using phab-01,-03,-05, none of them use puppet. please use instance "phabricator", this actually has the prod role |
[phabricator] |
| 18:43 |
<paladox> |
deleting phab-03 and phab-05 to allow us to create one large instance for replacement for phab-01 (might) |
[phabricator] |
| 18:41 |
<arlolra@tin> |
Starting deploy [parsoid/deploy@c1a14c0]: Retry updating Parsoid to d000fdb4 |
[production] |
| 18:40 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@c1a14c0]: Updating Parsoid to d000fdb4 (duration: 21m 28s) |
[production] |
| 18:37 |
<demon@tin> |
Synchronized docroot: tidying up mobileportal docroot stuff (duration: 00m 41s) |
[production] |
| 18:27 |
<zhuyifei1999_> |
repooling encoding02 & encoding03, depooling encoding01 T155455 |
[video] |
| 18:24 |
<demon@tin> |
Synchronized docroot: Removing old wikidata docroot (duration: 00m 46s) |
[production] |
| 18:23 |
<zhuyifei1999_> |
killed the rest of tasks on encoding02 & encoding03, they are gonna fail anyways |
[video] |
| 18:19 |
<arlolra@tin> |
Starting deploy [parsoid/deploy@c1a14c0]: Updating Parsoid to d000fdb4 |
[production] |
| 18:14 |
<andrewbogott> |
one last reboot of tools-mail |
[tools] |
| 18:10 |
<marostegui> |
restart mysql db1065 maintenance - https://phabricator.wikimedia.org/T155999) |
[production] |
| 18:07 |
<mutante> |
planet2001 - re-adding to puppet, revoke old cert, sign new cert, initial run |
[production] |
| 18:02 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1065 - T156006 (duration: 00m 49s) |
[production] |
| 18:00 |
<andrewbogott> |
apt-get autoremove on tools-mail |
[tools] |
| 17:51 |
<andrewbogott> |
rebooting tools-mail post upgrade |
[tools] |
| 17:19 |
<andrewbogott> |
restarting tools-mail, beginning do-release-upgrade -d -q |
[tools] |
| 17:17 |
<andrewbogott> |
backing up tools-mail to ~root/8c499e6e-1b79-4bb1-8f7f-72fee1f74ea5-backup on labvirt1009 |
[tools] |
| 17:15 |
<andrewbogott> |
stopping tools-mail, backing up, upgrading from precise to trusty |
[tools] |
| 16:54 |
<andrewbogott> |
tools deleting tools-mail-01 |
[production] |
| 16:52 |
<mutante> |
planet2001 - reinstalling to test DHCP/TFTP from install2001 |
[production] |
| 16:37 |
<elukey> |
upgrading aqs1004 to node6 |
[production] |
| 16:26 |
<marostegui> |
Restart mysql db1072 |
[production] |
| 16:22 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1072 - T156006 (duration: 00m 41s) |
[production] |