|
2016-12-08
§
|
| 19:00 |
<hoo> |
Started rebuildItemsPerSite for Wikidata on terbium. Note: This can be killed at any time, if needed. |
[production] |
| 18:40 |
<legoktm@tin> |
Synchronized wmf-config: Deploy Linter extension to beta cluster - no-op (duration: 00m 50s) |
[production] |
| 18:15 |
<ottomata> |
restarting broker on kafka1012 to repro T152674 |
[production] |
| 18:07 |
<gehel> |
cleanup nginx access logs on elasticsearch cluster (access logs are disabled, this is just left over) |
[production] |
| 17:53 |
<ejegg> |
disabled CiviCRM de-dupe jobs (CiviCRM contacts, Major gifts contacts, Major gifts 500+) |
[production] |
| 17:31 |
<godog> |
upload ieee-data 20160613.1 and upgrade jessie machines to it T152440 |
[production] |
| 17:13 |
<demon@tin> |
Synchronized docroot: cleanups: rm bits & fix wwwportal/w/extract2.php symlink (duration: 00m 48s) |
[production] |
| 16:30 |
<YuviPanda> |
disable puppet on californium to help debug T151422 with bd808 |
[production] |
| 15:44 |
<gehel> |
restarting elasticsearch relforge cluster for Java 8 upgrade - T151325 |
[production] |
| 13:52 |
<ema> |
upgrading cache_misc and cache_maps to varnish 4.1.4-1wm1 |
[production] |
| 12:48 |
<gehel> |
restarting elasticsearch eqiad cluster restart for Java 8 upgrade - T151325 |
[production] |
| 10:18 |
<gehel> |
restarting elasticsearch codfw cluster restart for Java 8 upgrade - T151325 |
[production] |
| 09:29 |
<legoktm@tin> |
Synchronized wmf-config/throttle.php: Lift six-account limit for BBC 100 Women event T152669 (duration: 01m 39s) |
[production] |
| 06:44 |
<eileen> |
dedupe jobs enabled |
[production] |
| 06:25 |
<ejegg> |
re-enabled silverpop export build job |
[production] |
| 06:15 |
<eileen> |
re-enabled Fredge Multiqueue Consumer |
[production] |
| 06:11 |
<eileen> |
re-enable thank you mail send |
[production] |
| 05:49 |
<eileen> |
donations consumer back on |
[production] |
| 04:53 |
<eileen> |
disable fredge multiq consumer |
[production] |
| 04:52 |
<eileen> |
disable http://localhost:9000/job/Silverpop%20emails%20-%20Build%20export%20files/ |
[production] |
| 04:51 |
<eileen> |
diable major gifts dedupe jobs |
[production] |
| 04:50 |
<eileen> |
disable jobs CiviCRM dedupe, Thank you mail send, Donations q consumer |
[production] |
| 03:59 |
<mutante> |
manually restarting gerrit to pick up config change to make jenkins comments pretty again (https://gerrit.wikimedia.org/r/#/c/325826/) (we stopped letting puppet do it for now) |
[production] |
| 01:28 |
<yurik@tin> |
Synchronized wmf-config/CommonSettings-labs.php: set license for structured data 325866 (duration: 00m 45s) |
[production] |
| 01:04 |
<dereckson@tin> |
Synchronized wmf-config/CommonSettings.php: Use numerics instead of custom namespace constant for NS_TOPIC (T152651) (duration: 00m 45s) |
[production] |
| 00:38 |
<dereckson@tin> |
Synchronized php-1.29.0-wmf.5/extensions/CentralAuth/maintenance/populateLocalAndGlobalIds.php: [[Gerrit:325733|Improve populateLocalAndGlobalIds maintenance script]] (T148242) (duration: 00m 46s) |
[production] |
|
2016-12-07
§
|
| 23:39 |
<Pchelolo> |
update RESTBase to e2b319a1 |
[production] |
| 23:34 |
<Pchelolo> |
update RESTBase to e2b319a1 - canary on restbase1007 |
[production] |
| 23:14 |
<Pchelolo> |
update RESTBase to e2b319a1 - staging |
[production] |
| 21:36 |
<arlolra> |
updated Parsoid to version 3cf19c6b (T110910, T102209, T94949, T150112, T151570, T149209, T150213) |
[production] |
| 21:27 |
<mholloway-shell@tin> |
Finished deploy [mobileapps/deploy@adc5f07]: Update mobileapps to 2b1d206 (duration: 01m 12s) |
[production] |
| 21:26 |
<mholloway-shell@tin> |
Starting deploy [mobileapps/deploy@adc5f07]: Update mobileapps to 2b1d206 |
[production] |
| 21:21 |
<arlolra@tin> |
Finished deploy [parsoid/deploy@a77f72a]: (no message) (duration: 12m 13s) |
[production] |
| 21:09 |
<arlolra@tin> |
Starting deploy [parsoid/deploy@a77f72a]: (no message) |
[production] |
| 21:08 |
<arlolra> |
starting Parsoid deploy |
[production] |
| 20:51 |
<demon@tin> |
Finished scap: symlink update (duration: 47m 21s) |
[production] |
| 20:46 |
<ostriches> |
gerrit back |
[production] |
| 20:33 |
<godog> |
update prometheus-node-exporter in eqiad - T152580 |
[production] |
| 20:26 |
<godog> |
update prometheus-node-exporter in codfw - T152580 |
[production] |
| 20:16 |
<godog> |
update prometheus-node-exporter in ulsfo/esams - T152580 |
[production] |
| 20:03 |
<demon@tin> |
Started scap: symlink update |
[production] |
| 20:02 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 to wmf.5 |
[production] |
| 18:35 |
<godog> |
upload gerrit 2.13.3-wmf.1 to carbon |
[production] |
| 18:10 |
<ottomata> |
will be bouncing some main-eqiad kafka brokers to try to troubleshoot T142430 |
[production] |
| 18:03 |
<YuviPanda> |
add zareen to nda LDAP group, per https://phabricator.wikimedia.org/T149211 |
[production] |
| 17:33 |
<jynus> |
forced retry of dbstore1001 backups |
[production] |
| 17:25 |
<elukey> |
puppet run completed on mw1* hosts (10% batch-size) |
[production] |
| 17:08 |
<elukey> |
Apache config changed on mw2*, tests look fine (apachectl -S does not show the vhost, apachectl -t is ok, apache-fast-test from tin is ok). Proceeding with eqiad |
[production] |
| 16:54 |
<elukey> |
force puppet run on mw2* hosts (10% batch-size) |
[production] |
| 16:47 |
<elukey> |
running puppet on some mw codfw appservers to check the new config |
[production] |