|
2017-02-22
§
|
| 10:54 |
<moritzm> |
upgrading remaining mediawiki servers to HHVM 3.12.14 |
[production] |
| 10:54 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=elastic10(35|37|39|43|44).eqiad.wmnet |
[production] |
| 10:42 |
<elukey> |
reinstall mw211[89] as MW videoscalers (trusty) and mw2243 as MW jobrunner |
[production] |
| 10:05 |
<filippo@tin> |
Synchronized wmf-config/ProductionServices.php: Move udp2log from fluorine to mwlog1001 - T123728 (duration: 00m 41s) |
[production] |
| 10:01 |
<hashar> |
enabling puppet on contint1001 and running it |
[production] |
| 09:56 |
<volans> |
restarting salt-master on neodymium after openssl upgrade |
[production] |
| 09:37 |
<ema> |
cache_text, cache_upload: libssl1.1 upgraded to 1.1.0e-1+wmf1, libevent-2.0-5 upgraded to 2.0.21-stable-2+deb8u1 |
[production] |
| 09:28 |
<hashar> |
disable puppet on contint1001. Will use contint2001 as a canary |
[production] |
| 09:14 |
<marostegui> |
Run pt-table-checksum on s2.nlwiki over some tables - T154485 |
[production] |
| 09:04 |
<dcausse> |
rebuilding translation memories index - ETA ~4hours (from terbium, logs in ~dcausse/ttm-refresh) |
[production] |
| 09:02 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=elastic10(35|39|43|44).eqiad.wmnet |
[production] |
| 08:07 |
<moritzm> |
upgrading openssl on redis clusters / various base service restarts |
[production] |
| 07:44 |
<gehel> |
restart elasticsearch on elastic1035 |
[production] |
| 07:43 |
<gehel> |
trncating logs on elastic10(35|39|44) |
[production] |
| 07:23 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2062 - T132416 (duration: 00m 40s) |
[production] |
| 07:23 |
<marostegui> |
Deploy alter table enwiki.revision db2062 - T132416 |
[production] |
| 07:18 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2055 - T132416 (duration: 00m 40s) |
[production] |
| 03:10 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Wed Feb 22 03:10:13 UTC 2017 (duration 5m 46s) |
[production] |
| 03:04 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.13) (duration: 13m 54s) |
[production] |
| 02:32 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.12) (duration: 11m 48s) |
[production] |
| 01:03 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:339090|Enable ORES review tool in cswiki]] T151611 (duration: 00m 39s) |
[production] |
| 00:48 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:323111|Send "exception" channel to logstash]] [[gerrit:323330|Do not send "exception-json" channel to logstash]] T136849 (duration: 00m 40s) |
[production] |
| 00:34 |
<thcipriani@tin> |
Synchronized wmf-config: SWAT: [[gerrit:324215|Set $wgSoftBlockRanges]] T154698 PART II (duration: 00m 42s) |
[production] |
| 00:33 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:324215|Set $wgSoftBlockRanges]] T154698 PART I (duration: 00m 40s) |
[production] |
| 00:20 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:336747|Fix SiteConfiguration array merge syntax]] T157656 [[gerrit:339012|Fix Sentry URL scheme on beta]] [[gerrit:339041|Fix PageViewInfo config]] T158698 (beta-only changes) (duration: 00m 39s) |
[production] |
| 00:17 |
<thcipriani@tin> |
Synchronized php-1.29.0-wmf.12/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: SWAT: [[gerrit:339010|Turn off sister search AB test.]] T157942 (duration: 00m 39s) |
[production] |
| 00:16 |
<thcipriani@tin> |
Synchronized php-1.29.0-wmf.13/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: SWAT: [[gerrit:339011|Turn off sister search AB test.]] T157942 (duration: 00m 43s) |
[production] |
| 00:13 |
<smalyshev@tin> |
Finished deploy [wdqs/wdqs@7768422]: Deploy 2.1.5RC WAR on 2001 for testing (duration: 00m 25s) |
[production] |
| 00:13 |
<smalyshev@tin> |
Started deploy [wdqs/wdqs@7768422]: Deploy 2.1.5RC WAR on 2001 for testing |
[production] |
| 00:05 |
<demon@tin> |
Synchronized scap/plugins/clean.py: More code cleanup (duration: 00m 40s) |
[production] |
|
2017-02-21
§
|
| 23:30 |
<MaxSem> |
Kartotherian deploy did not happen |
[production] |
| 23:22 |
<demon@tin> |
Synchronized scap/plugins/clean.py: Code cleanup (duration: 00m 46s) |
[production] |
| 23:21 |
<demon@tin> |
scap aborted: scap/plugins/clean.py Code cleanup (duration: 00m 10s) |
[production] |
| 23:21 |
<demon@tin> |
Started scap: scap/plugins/clean.py Code cleanup |
[production] |
| 22:01 |
<mutante> |
carbon - removed from icinga, shutdown -h now (T158020) |
[production] |
| 21:31 |
<mutante> |
carbon - puppet node clean, node deactivate (T158020) |
[production] |
| 21:10 |
<demon@tin> |
Synchronized scap/plugins/prep.py: Completeness (duration: 00m 42s) |
[production] |
| 20:48 |
<Krinkle> |
(terbium) sql --write test2wiki 'DELETE FROM module_deps' (3687 rows affected, 0.01 sec) - per T158105. |
[production] |
| 20:47 |
<Krinkle> |
(terbium) sql --write testwiki 'DELETE FROM module_deps' (per T158105) |
[production] |
| 20:44 |
<mutante> |
carbon - backup /root data to install1002:/root/root-carbon/ before shutdown (T158020) |
[production] |
| 20:36 |
<mutante> |
rsyncing /home/ dirs excl. dot files, from carbon to install1002 (T158020) |
[production] |
| 20:15 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=elastic10(35|39|43|44).eqiad.wmnet |
[production] |
| 20:08 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group0 to wmf.13 |
[production] |
| 19:50 |
<demon@tin> |
Finished scap: prime wmf.13 - testwiki plus l10n build (pt 3 because ugh) (duration: 17m 17s) |
[production] |
| 19:32 |
<demon@tin> |
Started scap: prime wmf.13 - testwiki plus l10n build (pt 3 because ugh) |
[production] |
| 19:32 |
<demon@tin> |
scap failed: RuntimeError 2 test canaries had check failures (rerun with --force to override this check) (duration: 15m 00s) |
[production] |
| 19:17 |
<demon@tin> |
Started scap: prime wmf.13 - testwiki plus l10n build (pt 2 because T156851) |
[production] |
| 19:16 |
<demon@tin> |
Finished scap: prime wmf.13 - testwiki plus l10n build (duration: 26m 15s) |
[production] |
| 18:49 |
<demon@tin> |
Started scap: prime wmf.13 - testwiki plus l10n build |
[production] |
| 18:45 |
<moritzm> |
installing PHP security updates on iridium (phabricator.wikimedia.org) |
[production] |