2017-02-01
ยง
|
21:40 |
<zhuyifei1999_> |
Deploying c96cab7 |
[tools.precise-tools] |
21:39 |
<twentyafterfour@tin> |
Synchronized wmf-config/InitialiseSettings.php: sync InitializeSettings to activate change from previous patches refs T156942 (duration: 00m 41s) |
[production] |
21:21 |
<reedy@tin> |
Synchronized php-1.29.0-wmf.10/includes/api/: Guard more ug_expiry queries (duration: 00m 48s) |
[production] |
21:19 |
<zhuyifei1999_> |
Deploying fix b705bdc |
[tools.precise-tools] |
20:54 |
<bd808> |
Deploying eabef48 |
[tools.precise-tools] |
20:48 |
<bd808> |
Rolled back to 6eb9c04; will examine error log |
[tools.precise-tools] |
20:47 |
<bd808> |
Poop. I broke it |
[tools.precise-tools] |
20:46 |
<bd808> |
Deploying e5282fb |
[tools.precise-tools] |
20:36 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.29.0-wmf.10 |
[production] |
20:29 |
<twentyafterfour@tin> |
Synchronized wmf-config/abusefilter.php: deploy I0b4e02714ea0d99da96e4ca1ce7de2a1a9552791 refs T156942 (duration: 00m 39s) |
[production] |
20:15 |
<twentyafterfour@tin> |
Synchronized wmf-config/flaggedrevs.php: deploy I1683b184fbf4c0c6fb0d4dad1fcde3a253a30cb4 refs T156942 (duration: 00m 40s) |
[production] |
20:10 |
<jynus> |
continuing mariadb rolling restart of db2044, db2051, db2058, db2065 |
[production] |
20:01 |
<ejegg> |
updated payments-wiki from dd8a16dc1cade69419f9c7b8f4703f23bb24d5fb to 4466b9deffcab144cdcddd511a3032513370a44d |
[production] |
19:59 |
<twentyafterfour> |
scheduled downtime in icinga for phab2001's phd service |
[production] |
19:59 |
<twentyafterfour> |
Freshening phabricator's elasticsearch index, currently 50% complete |
[production] |
19:30 |
<zhuyifei1999_> |
Deploying 6eb9c04 |
[tools.precise-tools] |
19:27 |
<twentyafterfour> |
disabled read-only in phabricator |
[production] |
19:25 |
<twentyafterfour> |
running puppet on iridium to activate the config change |
[production] |
19:20 |
<jynus> |
reloading haproxy on dbproxy1003 |
[production] |
19:11 |
<jynus> |
remaining 7 minute with phabricator up, but read-only |
[production] |
19:10 |
<ostriches> |
phabricator: now in read-only mode |
[production] |
19:08 |
<jynus> |
scheduling 10 minutes of emergency downtime on phabricator |
[production] |
19:06 |
<mobrovac> |
restbase deploy end of 96a641aa |
[production] |
19:01 |
<joal> |
Killed-Restarted Mobile apps Uniques monthly jobs to pick up new config - 0096638-161121120201437-oozie-oozi-C |
[analytics] |
18:51 |
<thcipriani> |
nodepool delete-image 1320 per T156923 |
[releng] |
18:49 |
<joal@tin> |
Finished deploy [analytics/refinery@2b9a70a]: (no justification provided) (duration: 02m 33s) |
[production] |
18:47 |
<joal> |
Deploy refinery for uniques monthly patches |
[analytics] |
18:46 |
<joal@tin> |
Started deploy [analytics/refinery@2b9a70a]: (no justification provided) |
[production] |
18:34 |
<mobrovac> |
restbase deploy start of 96a641aa |
[production] |
18:32 |
<zhuyifei1999_> |
Deploying faa6427 |
[tools.precise-tools] |
18:08 |
<zhuyifei1999_> |
Deploying 8b99b16 |
[tools.precise-tools] |
17:56 |
<zhuyifei1999_> |
Deploying 8deef39 |
[tools.precise-tools] |
17:36 |
<zhuyifei1999_> |
Pulling to e5f09b2 and pip installing yaml -- I didn't know it's not a default package... |
[tools.precise-tools] |
17:31 |
<zhuyifei1999_> |
Deploying 8241a04 and clearing cache |
[tools.precise-tools] |
17:27 |
<joal> |
Restarting 2 webrequest-load text jobs that failed during NM restart (2016-02-01T11:00 and T13:00) |
[analytics] |
16:54 |
<marostegui> |
Optimize table phabricator_search.search_documentfield on db2012 - T156905 |
[production] |
16:41 |
<jynus> |
mariadb rolling restart of db2037, db2044, db2051, db2058, db2065 |
[production] |
16:20 |
<elukey> |
restarting Yarn Node Manager daemons on all the Hadoop nodes to bandaid a memory leak causing OOMs |
[production] |
16:18 |
<marostegui> |
Optimizing table search_documentfield on db1048 - T156905 |
[production] |
15:50 |
<akosiaris> |
stop ircecho for a while to weather out most of the puppet alert storm |
[production] |
15:46 |
<akosiaris> |
restart puppetdb on nihal (openjdk upgrade) |
[production] |
15:43 |
<akosiaris> |
restart puppetdb on nitrogen |
[production] |
15:40 |
<jynus> |
preparing db1067 for reimage to jessie |
[production] |
15:37 |
<moritzm> |
upgrading canary app servers to new HHVM package (initially mwdebug and mw1261) |
[production] |
15:17 |
<Dereckson> |
`mwscript populateCategory.php plwikisource --force` to refresh categories stats (T156670) |
[production] |
15:17 |
<dereckson@tin> |
Finished scap: Full scap to propagate a core namespace l10n change (duration: 40m 10s) |
[production] |
14:53 |
<gehel> |
deployment-elastic* fully migrated to Jessie and /srv as data partition - T151326 |
[releng] |
14:52 |
<gehel> |
killing test node deployment-elastic08 - T151326 |
[releng] |
14:41 |
<godog> |
upgrade thumbor to 0.1.34 |
[production] |
14:37 |
<dereckson@tin> |
Started scap: Full scap to propagate a core namespace l10n change |
[production] |