|
2017-02-02
§
|
| 03:24 |
<eileen1> |
renable all other jenkins jobs - only some dedupe & one-off jobs disabled |
[production] |
| 03:17 |
<eileen1> |
re-enable dedupe jobs |
[production] |
| 03:14 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Feb 2 03:14:06 UTC 2017 (duration 5m 44s) |
[production] |
| 03:08 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.10) (duration: 13m 49s) |
[production] |
| 02:36 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.9) (duration: 14m 39s) |
[production] |
| 02:32 |
<eileen1> |
update civicrm from d06db9223a47f74f9b87eba0f008696489668c77 to e45da6dc2cfaa48da8807ab9a571810c119e3233 |
[production] |
| 02:23 |
<eileen1> |
drush dis -y module_missing_message_fixer |
[production] |
| 02:22 |
<eileen1> |
drush mmmff --all |
[production] |
| 02:22 |
<eileen1> |
run drush en -y module_missing_message_fixer |
[production] |
| 02:20 |
<eileen1> |
Update civicrm from 7a861216a1392bf157fc4f17fd9e497a3796c00e to d06db9223a47f74f9b87eba0f008696489668c77 |
[production] |
| 02:02 |
<mutante> |
carbon - remove unmapped IPv6 address making ferm rules fail, use only the _mapped_ IP (ip addr del 2620:0:861:1:7a2b:cbff:fe09:ea0/64 dev eth0) (T84380 T132757) |
[production] |
| 01:50 |
<eileen1> |
update CiviCRM from e17622be4b8f077ba23d7de00bb132419723963d to 7a861216a1392bf157fc4f17fd9e497a3796c00e |
[production] |
| 01:25 |
<eileen1> |
jenkins disable Dedupe CiviCRM contacts & Dedupe major gifts 500_ |
[production] |
| 01:04 |
<maxsem@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/335578/ (duration: 00m 42s) |
[production] |
| 00:30 |
<maxsem@tin> |
Synchronized wmf-config/CirrusSearch-common.php: https://gerrit.wikimedia.org/r/#/c/335265/2 (duration: 00m 40s) |
[production] |
| 00:20 |
<maxsem@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/335561/ (duration: 01m 00s) |
[production] |
|
2017-02-01
§
|
| 22:54 |
<mutante> |
carbon - rsyncing /srv/ data to install1002 (T132757) |
[production] |
| 22:46 |
<dereckson@tin> |
Synchronized wmf-config/: Folder sync to get around caching issue in previous deployments (T156942) (duration: 00m 45s) |
[production] |
| 22:08 |
<jynus> |
deploying schema change to page_assessments_projects on testwiki T156305 |
[production] |
| 21:49 |
<bsitzmann@tin> |
Finished deploy [mobileapps/deploy@09101f7]: Update mobileapps to e48a88c (duration: 03m 04s) |
[production] |
| 21:46 |
<bsitzmann@tin> |
Started deploy [mobileapps/deploy@09101f7]: Update mobileapps to e48a88c |
[production] |
| 21:39 |
<twentyafterfour@tin> |
Synchronized wmf-config/InitialiseSettings.php: sync InitializeSettings to activate change from previous patches refs T156942 (duration: 00m 41s) |
[production] |
| 21:21 |
<reedy@tin> |
Synchronized php-1.29.0-wmf.10/includes/api/: Guard more ug_expiry queries (duration: 00m 48s) |
[production] |
| 20:36 |
<twentyafterfour@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.29.0-wmf.10 |
[production] |
| 20:29 |
<twentyafterfour@tin> |
Synchronized wmf-config/abusefilter.php: deploy I0b4e02714ea0d99da96e4ca1ce7de2a1a9552791 refs T156942 (duration: 00m 39s) |
[production] |
| 20:15 |
<twentyafterfour@tin> |
Synchronized wmf-config/flaggedrevs.php: deploy I1683b184fbf4c0c6fb0d4dad1fcde3a253a30cb4 refs T156942 (duration: 00m 40s) |
[production] |
| 20:10 |
<jynus> |
continuing mariadb rolling restart of db2044, db2051, db2058, db2065 |
[production] |
| 20:01 |
<ejegg> |
updated payments-wiki from dd8a16dc1cade69419f9c7b8f4703f23bb24d5fb to 4466b9deffcab144cdcddd511a3032513370a44d |
[production] |
| 19:59 |
<twentyafterfour> |
scheduled downtime in icinga for phab2001's phd service |
[production] |
| 19:59 |
<twentyafterfour> |
Freshening phabricator's elasticsearch index, currently 50% complete |
[production] |
| 19:27 |
<twentyafterfour> |
disabled read-only in phabricator |
[production] |
| 19:25 |
<twentyafterfour> |
running puppet on iridium to activate the config change |
[production] |
| 19:20 |
<jynus> |
reloading haproxy on dbproxy1003 |
[production] |
| 19:11 |
<jynus> |
remaining 7 minute with phabricator up, but read-only |
[production] |
| 19:10 |
<ostriches> |
phabricator: now in read-only mode |
[production] |
| 19:08 |
<jynus> |
scheduling 10 minutes of emergency downtime on phabricator |
[production] |
| 19:06 |
<mobrovac> |
restbase deploy end of 96a641aa |
[production] |
| 18:49 |
<joal@tin> |
Finished deploy [analytics/refinery@2b9a70a]: (no justification provided) (duration: 02m 33s) |
[production] |
| 18:46 |
<joal@tin> |
Started deploy [analytics/refinery@2b9a70a]: (no justification provided) |
[production] |
| 18:34 |
<mobrovac> |
restbase deploy start of 96a641aa |
[production] |
| 16:54 |
<marostegui> |
Optimize table phabricator_search.search_documentfield on db2012 - T156905 |
[production] |
| 16:41 |
<jynus> |
mariadb rolling restart of db2037, db2044, db2051, db2058, db2065 |
[production] |
| 16:20 |
<elukey> |
restarting Yarn Node Manager daemons on all the Hadoop nodes to bandaid a memory leak causing OOMs |
[production] |
| 16:18 |
<marostegui> |
Optimizing table search_documentfield on db1048 - T156905 |
[production] |
| 15:50 |
<akosiaris> |
stop ircecho for a while to weather out most of the puppet alert storm |
[production] |
| 15:46 |
<akosiaris> |
restart puppetdb on nihal (openjdk upgrade) |
[production] |
| 15:43 |
<akosiaris> |
restart puppetdb on nitrogen |
[production] |
| 15:40 |
<jynus> |
preparing db1067 for reimage to jessie |
[production] |
| 15:37 |
<moritzm> |
upgrading canary app servers to new HHVM package (initially mwdebug and mw1261) |
[production] |
| 15:17 |
<Dereckson> |
`mwscript populateCategory.php plwikisource --force` to refresh categories stats (T156670) |
[production] |