|
2017-02-01
ยง
|
| 19:11 |
<jynus> |
remaining 7 minute with phabricator up, but read-only |
[production] |
| 19:10 |
<ostriches> |
phabricator: now in read-only mode |
[production] |
| 19:08 |
<jynus> |
scheduling 10 minutes of emergency downtime on phabricator |
[production] |
| 19:06 |
<mobrovac> |
restbase deploy end of 96a641aa |
[production] |
| 19:01 |
<joal> |
Killed-Restarted Mobile apps Uniques monthly jobs to pick up new config - 0096638-161121120201437-oozie-oozi-C |
[analytics] |
| 18:51 |
<thcipriani> |
nodepool delete-image 1320 per T156923 |
[releng] |
| 18:49 |
<joal@tin> |
Finished deploy [analytics/refinery@2b9a70a]: (no justification provided) (duration: 02m 33s) |
[production] |
| 18:47 |
<joal> |
Deploy refinery for uniques monthly patches |
[analytics] |
| 18:46 |
<joal@tin> |
Started deploy [analytics/refinery@2b9a70a]: (no justification provided) |
[production] |
| 18:34 |
<mobrovac> |
restbase deploy start of 96a641aa |
[production] |
| 18:32 |
<zhuyifei1999_> |
Deploying faa6427 |
[tools.precise-tools] |
| 18:08 |
<zhuyifei1999_> |
Deploying 8b99b16 |
[tools.precise-tools] |
| 17:56 |
<zhuyifei1999_> |
Deploying 8deef39 |
[tools.precise-tools] |
| 17:36 |
<zhuyifei1999_> |
Pulling to e5f09b2 and pip installing yaml -- I didn't know it's not a default package... |
[tools.precise-tools] |
| 17:31 |
<zhuyifei1999_> |
Deploying 8241a04 and clearing cache |
[tools.precise-tools] |
| 17:27 |
<joal> |
Restarting 2 webrequest-load text jobs that failed during NM restart (2016-02-01T11:00 and T13:00) |
[analytics] |
| 16:54 |
<marostegui> |
Optimize table phabricator_search.search_documentfield on db2012 - T156905 |
[production] |
| 16:41 |
<jynus> |
mariadb rolling restart of db2037, db2044, db2051, db2058, db2065 |
[production] |
| 16:20 |
<elukey> |
restarting Yarn Node Manager daemons on all the Hadoop nodes to bandaid a memory leak causing OOMs |
[production] |
| 16:18 |
<marostegui> |
Optimizing table search_documentfield on db1048 - T156905 |
[production] |
| 15:50 |
<akosiaris> |
stop ircecho for a while to weather out most of the puppet alert storm |
[production] |
| 15:46 |
<akosiaris> |
restart puppetdb on nihal (openjdk upgrade) |
[production] |
| 15:43 |
<akosiaris> |
restart puppetdb on nitrogen |
[production] |
| 15:40 |
<jynus> |
preparing db1067 for reimage to jessie |
[production] |
| 15:37 |
<moritzm> |
upgrading canary app servers to new HHVM package (initially mwdebug and mw1261) |
[production] |
| 15:17 |
<Dereckson> |
`mwscript populateCategory.php plwikisource --force` to refresh categories stats (T156670) |
[production] |
| 15:17 |
<dereckson@tin> |
Finished scap: Full scap to propagate a core namespace l10n change (duration: 40m 10s) |
[production] |
| 14:53 |
<gehel> |
deployment-elastic* fully migrated to Jessie and /srv as data partition - T151326 |
[releng] |
| 14:52 |
<gehel> |
killing test node deployment-elastic08 - T151326 |
[releng] |
| 14:41 |
<godog> |
upgrade thumbor to 0.1.34 |
[production] |
| 14:37 |
<dereckson@tin> |
Started scap: Full scap to propagate a core namespace l10n change |
[production] |
| 14:32 |
<gehel> |
shutting down and reimaging deployment-elastic07 - T151326 |
[releng] |
| 14:25 |
<jynus> |
dropping and replacing events on db1057 - db1052 T156008 |
[production] |
| 14:24 |
<dereckson@tin> |
Synchronized php-1.29.0-wmf.9/languages/messages/MessagesJv.php: Update namespace localisation in Javanese (T155957) (duration: 00m 40s) |
[production] |
| 14:21 |
<dereckson@tin> |
Synchronized php-1.29.0-wmf.10/languages/messages/MessagesJv.php: Update namespace localisation in Javanese (T155957) (duration: 00m 45s) |
[production] |
| 14:12 |
<moritzm> |
uploaded hhvm 3.12.12 to carbon |
[production] |
| 14:10 |
<dereckson@tin> |
Synchronized wmf-config/InitialiseSettings.php: Enable ElectronPdfService on meta (T150943) (duration: 00m 48s) |
[production] |
| 14:06 |
<gehel> |
shutting down and reimaging deployment-elastic06 - T151326 |
[releng] |
| 13:39 |
<marostegui> |
Deploy alter table dbstore1002 metawiki.pagelinks - T153300 |
[production] |
| 13:38 |
<akosiaris> |
issue sudo hdparm -Y /dev/sdb on bast3001 to force a problematic drive to sleep |
[production] |
| 13:34 |
<gehel> |
shutting down and reimaging deployment-elastic05 - T151326 |
[releng] |
| 13:29 |
<gehel> |
starting deployment-elastic* migration to jessie and moving data partition to /srv (T151326 / T151328) |
[releng] |
| 13:21 |
<marostegui> |
Clean up db1043 replication thread (it was replicating from db1048 which looks like an old thing) - T156905 |
[production] |
| 13:18 |
<moritzm> |
upgraded deployment-prep to hhvm 3.12.12 |
[releng] |
| 13:12 |
<elukey> |
restarted pageview-druid-monthly-coord and pageview-druid-daily-coord oozie coordinators after deployment |
[analytics] |
| 12:17 |
<elukey> |
deployed Refinery via scap and then executed the hdfs copies on stat1002 |
[analytics] |
| 12:09 |
<elukey@tin> |
Finished deploy [analytics/refinery@e6254a4]: (no justification provided) (duration: 04m 41s) |
[production] |
| 12:04 |
<elukey@tin> |
Started deploy [analytics/refinery@e6254a4]: (no justification provided) |
[production] |
| 11:52 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2061 - T153300 (duration: 00m 40s) |
[production] |
| 11:39 |
<zhuyifei1999_> |
Deploying f225a2b -- another optimization attempt |
[tools.precise-tools] |