2017-02-01
§
|
23:39 |
<halfak> |
deployed ores-wmflabs-deploy:ce8861d |
[ores] |
22:54 |
<mutante> |
carbon - rsyncing /srv/ data to install1002 (T132757) |
[production] |
22:46 |
<dereckson@tin> |
Synchronized wmf-config/: Folder sync to get around caching issue in previous deployments (T156942) (duration: 00m 45s) |
[production] |
22:08 |
<jynus> |
deploying schema change to page_assessments_projects on testwiki T156305 |
[production] |
21:52 |
<bd808> |
Deploying f32e68f |
[tools.precise-tools] |
21:49 |
<bsitzmann@tin> |
Finished deploy [mobileapps/deploy@09101f7]: Update mobileapps to e48a88c (duration: 03m 04s) |
[production] |
21:48 |
<bd808> |
Deploying cf01934 |
[tools.precise-tools] |
21:46 |
<bsitzmann@tin> |
Started deploy [mobileapps/deploy@09101f7]: Update mobileapps to e48a88c |
[production] |
21:45 |
<bd808> |
Deploying 4530d5c |
[tools.precise-tools] |
21:43 |
<bearND> |
Update mobileapps to e48a88c |
[releng] |
21:40 |
<zhuyifei1999_> |
Deploying c96cab7 |
[tools.precise-tools] |
21:39 |
<twentyafterfour@tin> |
Synchronized wmf-config/InitialiseSettings.php: sync InitializeSettings to activate change from previous patches refs T156942 (duration: 00m 41s) |
[production] |
21:21 |
<reedy@tin> |
Synchronized php-1.29.0-wmf.10/includes/api/: Guard more ug_expiry queries (duration: 00m 48s) |
[production] |
21:19 |
<zhuyifei1999_> |
Deploying fix b705bdc |
[tools.precise-tools] |
20:54 |
<bd808> |
Deploying eabef48 |
[tools.precise-tools] |
20:48 |
<bd808> |
Rolled back to 6eb9c04; will examine error log |
[tools.precise-tools] |
20:47 |
<bd808> |
Poop. I broke it |
[tools.precise-tools] |
20:46 |
<bd808> |
Deploying e5282fb |
[tools.precise-tools] |
20:36 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.29.0-wmf.10 |
[production] |
20:29 |
<twentyafterfour@tin> |
Synchronized wmf-config/abusefilter.php: deploy I0b4e02714ea0d99da96e4ca1ce7de2a1a9552791 refs T156942 (duration: 00m 39s) |
[production] |
20:15 |
<twentyafterfour@tin> |
Synchronized wmf-config/flaggedrevs.php: deploy I1683b184fbf4c0c6fb0d4dad1fcde3a253a30cb4 refs T156942 (duration: 00m 40s) |
[production] |
20:10 |
<jynus> |
continuing mariadb rolling restart of db2044, db2051, db2058, db2065 |
[production] |
20:01 |
<ejegg> |
updated payments-wiki from dd8a16dc1cade69419f9c7b8f4703f23bb24d5fb to 4466b9deffcab144cdcddd511a3032513370a44d |
[production] |
19:59 |
<twentyafterfour> |
scheduled downtime in icinga for phab2001's phd service |
[production] |
19:59 |
<twentyafterfour> |
Freshening phabricator's elasticsearch index, currently 50% complete |
[production] |
19:30 |
<zhuyifei1999_> |
Deploying 6eb9c04 |
[tools.precise-tools] |
19:27 |
<twentyafterfour> |
disabled read-only in phabricator |
[production] |
19:25 |
<twentyafterfour> |
running puppet on iridium to activate the config change |
[production] |
19:20 |
<jynus> |
reloading haproxy on dbproxy1003 |
[production] |
19:11 |
<jynus> |
remaining 7 minute with phabricator up, but read-only |
[production] |
19:10 |
<ostriches> |
phabricator: now in read-only mode |
[production] |
19:08 |
<jynus> |
scheduling 10 minutes of emergency downtime on phabricator |
[production] |
19:06 |
<mobrovac> |
restbase deploy end of 96a641aa |
[production] |
19:01 |
<joal> |
Killed-Restarted Mobile apps Uniques monthly jobs to pick up new config - 0096638-161121120201437-oozie-oozi-C |
[analytics] |
18:51 |
<thcipriani> |
nodepool delete-image 1320 per T156923 |
[releng] |
18:49 |
<joal@tin> |
Finished deploy [analytics/refinery@2b9a70a]: (no justification provided) (duration: 02m 33s) |
[production] |
18:47 |
<joal> |
Deploy refinery for uniques monthly patches |
[analytics] |
18:46 |
<joal@tin> |
Started deploy [analytics/refinery@2b9a70a]: (no justification provided) |
[production] |
18:34 |
<mobrovac> |
restbase deploy start of 96a641aa |
[production] |
18:32 |
<zhuyifei1999_> |
Deploying faa6427 |
[tools.precise-tools] |
18:08 |
<zhuyifei1999_> |
Deploying 8b99b16 |
[tools.precise-tools] |
17:56 |
<zhuyifei1999_> |
Deploying 8deef39 |
[tools.precise-tools] |
17:36 |
<zhuyifei1999_> |
Pulling to e5f09b2 and pip installing yaml -- I didn't know it's not a default package... |
[tools.precise-tools] |
17:31 |
<zhuyifei1999_> |
Deploying 8241a04 and clearing cache |
[tools.precise-tools] |
17:27 |
<joal> |
Restarting 2 webrequest-load text jobs that failed during NM restart (2016-02-01T11:00 and T13:00) |
[analytics] |
16:54 |
<marostegui> |
Optimize table phabricator_search.search_documentfield on db2012 - T156905 |
[production] |
16:41 |
<jynus> |
mariadb rolling restart of db2037, db2044, db2051, db2058, db2065 |
[production] |
16:20 |
<elukey> |
restarting Yarn Node Manager daemons on all the Hadoop nodes to bandaid a memory leak causing OOMs |
[production] |
16:18 |
<marostegui> |
Optimizing table search_documentfield on db1048 - T156905 |
[production] |