|
2016-08-26
§
|
| 11:32 |
<elukey> |
stopped camus on analytics1027 |
[analytics] |
| 11:31 |
<elukey> |
suspended all the oozie bundles via Hue |
[analytics] |
| 11:23 |
<hashar@tin> |
Synchronized php-1.28.0-wmf.16/extensions/CirrusSearch/includes/BuildDocument/RedirectsAndIncomingLinks.php: Temporarilly redirect RedirectsAndIncomingLinks job to a single db T143932 (duration: 00m 49s) |
[production] |
| 11:08 |
<elukey> |
Restarting all the Java daemons on most of the analytics* hosts for security upgrades |
[production] |
| 10:50 |
<hashar> |
running scap pull on mw1163 mw1164 mw1165 mw1166 mw1167 mw1168 (job runners) for T143932 |
[production] |
| 10:41 |
<hashar> |
ran scap pull on job runners mw1161 and mw1162 |
[production] |
| 10:34 |
<hashar> |
pulled https://gerrit.wikimedia.org/r/#/c/306899/ "Temporarilly redirect RedirectsAndIncomingLinks job to a single db" on tin for T143932 |
[production] |
| 09:56 |
<ema> |
cp4006 upgraded to varnish4 and repooled (T131502) |
[production] |
| 09:32 |
<moritzm> |
upgrading kernels on labtestmetal2001/labtestneutron2001/labtestvirt2001 |
[production] |
| 08:36 |
<moritzm> |
installing libcrypt security updates |
[production] |
| 08:18 |
<elukey> |
upgrading httpd to 2.4.10-10+deb8u6+wmf2 on mw127[2345] |
[production] |
| 08:15 |
<Amir1> |
restart uwsgi-ores and celery-ores-worker in deployment-sca03 (T143567) |
[releng] |
| 08:10 |
<hashar> |
beta-scap-eqiad job is back in operation. Was blocked on logstash not being reachable. T143982 |
[releng] |
| 08:10 |
<hashar> |
deployment-logstash2 is back after a hard reboot. T143982 |
[releng] |
| 08:07 |
<hashar> |
rebooting deployment-logstash02 via Horizon. Kernel hang apparently T143982 |
[releng] |
| 08:00 |
<hashar> |
beta-scap-eqiad failing investigating |
[releng] |
| 07:54 |
<Amir1> |
cherry-picked 306839/1 into deployment-puppetmaster |
[releng] |
| 07:41 |
<jynus> |
deploying schema change on s3 hosts T139090 |
[production] |
| 02:32 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Fri Aug 26 02:32:04 UTC 2016 (duration 5m 53s) |
[production] |
| 02:26 |
<mwdeploy@tin> |
scap sync-l10n completed (1.28.0-wmf.16) (duration: 10m 55s) |
[production] |
| 00:28 |
<twentyafterfour> |
restarted puppetmaster service on deployment-puppetmaster |
[releng] |
|
2016-08-25
§
|
| 23:40 |
<maxsem@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/306587/ (duration: 00m 47s) |
[production] |
| 23:30 |
<maxsem@tin> |
Synchronized php-1.28.0-wmf.16/includes/api/ApiCSPReport.php: https://gerrit.wikimedia.org/r/#/c/306837/ (duration: 00m 46s) |
[production] |
| 23:29 |
<maxsem@tin> |
Synchronized php-1.28.0-wmf.16/includes/DefaultSettings.php: https://gerrit.wikimedia.org/r/#/c/306837/ (duration: 00m 47s) |
[production] |
| 23:27 |
<bd808> |
Updated striker to 0b6ef02 |
[production] |
| 23:15 |
<maxsem@tin> |
Synchronized php-1.28.0-wmf.16/extensions/CirrusSearch: (no message) (duration: 00m 57s) |
[production] |
| 23:15 |
<Amir1> |
cherry-picked 306839/1 into puppetmaster |
[releng] |
| 22:28 |
<awight> |
update CRM config to 9a8664c5246e7b957940eb7670f781839f462aaf |
[production] |
| 22:15 |
<yuvipanda> |
forcing a puppet run on misc varnish hosts |
[production] |
| 21:52 |
<awight> |
update CRM from 73b71f060ad6f76aa2256f7e452e44f383ddb4af to d040549105151ccb66a464effbbd56a3e4bfbb8b |
[production] |
| 21:17 |
<awight> |
update CRM from 43cca607ed0d6d2f91e3f18d9df1473021b40f88 to 73b71f060ad6f76aa2256f7e452e44f383ddb4af |
[production] |
| 21:08 |
<awight> |
update paymentswiki config to 17f6ca972b8c747f90a4c407fe0747765de88623 |
[production] |
| 20:54 |
<ori@tin> |
Synchronized wmf-config/CommonSettings-labs.php: I02ae5be610: Enable PerformanceInspector extension for labs [3/3] (duration: 00m 46s) |
[production] |
| 20:53 |
<ori@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: I02ae5be610: Enable PerformanceInspector extension for labs [2/3] (duration: 00m 48s) |
[production] |
| 20:53 |
<ori@tin> |
Synchronized wmf-config/extension-list-labs: I02ae5be610: Enable PerformanceInspector extension for labs [1/3] (duration: 00m 46s) |
[production] |
| 20:10 |
<hashar> |
Delete integration-slave-trusty-1023 with label AndroidEmulator. The Android job has been migrated to a new Jessie based instance via T138506 |
[releng] |
| 19:05 |
<hashar> |
hard rebooting integration-raita via Horizon |
[releng] |
| 19:02 |
<hashar@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.28.0-wmf.16 |
[production] |
| 18:33 |
<thcipriani@tin> |
Synchronized php-1.28.0-wmf.16/extensions/ORES: SWAT: [[gerrit:306689|Fix CheckModelVersions by changing order of actions (T143799)]] [[gerrit:306691|Fix for purging scores (T143798)]] (duration: 00m 51s) |
[production] |
| 18:29 |
<thcipriani@tin> |
Synchronized php-1.28.0-wmf.16/resources/src/mediawiki/htmlform/hide-if.js: SWAT: [[gerrit:306706|mw.htmlform: Do not refer to OO.ui if it might not be loaded (T143850)]] (duration: 00m 49s) |
[production] |
| 18:25 |
<thcipriani@tin> |
Synchronized php-1.28.0-wmf.16/extensions/CirrusSearch/includes: SWAT: [[gerrit:306690|Use the UserTesting framework in maint scripts]] (duration: 00m 53s) |
[production] |
| 18:19 |
<thcipriani@tin> |
Synchronized php-1.28.0-wmf.16/extensions/CirrusSearch/includes/Job/CheckerJob.php: SWAT: [[gerrit:306687|Fix a typo in BC code that handles toId => toPageId (T143862)]] (duration: 00m 47s) |
[production] |
| 18:07 |
<yuvipanda> |
restart puppetmaster on tools-puppetmaster-01 |
[tools] |
| 17:41 |
<yuvipanda> |
depooled tools-webgrid-1413 |
[tools] |
| 17:05 |
<ejegg> |
updated payments-wiki from a472ff0a8c62f697221d71647f4013e5c2dfcd45 to ef2f2f85461d25a3938c173d0116fa0d2dee58d1 |
[production] |
| 16:04 |
<hashar> |
fixing puppet.conf on integration-slave-trusty-1013 it mysteriously considered itself as the puppetmaster |
[releng] |
| 16:02 |
<hashar> |
integration restarted puppetmaster service |
[releng] |
| 15:13 |
<ema> |
pooling cp4005 backend (varnish 4 cache_upload) T131502 |
[production] |
| 14:37 |
<elukey> |
upgrading httpd to 2.4.10-10+deb8u6+wmf2 on mw1269/mw127[01] |
[production] |
| 14:17 |
<moritzm> |
re-enabled puppet on kafka*, mc* and rdb* hosts |
[production] |