|
2016-02-09
§
|
| 10:53 |
<apergos> |
salt minions on labs instances that respond to labcontrol1001 will be coming back up over the next 1/2 hour as puppet runs (salt master key fixes) |
[production] |
| 10:45 |
<elukey> |
disabled puppet, redis and memcached on mc1004 for jessie migration |
[production] |
| 10:33 |
<_joe_> |
pybal updated everywhere |
[production] |
| 10:32 |
<gehel> |
elasticsearch codfw: cleanup leftover logs /var/log/elasticsearch/*.[2-7] |
[production] |
| 10:24 |
<gehel> |
elasticsearch eqiad: cleanup leftover logs /var/log/elasticsearch/*.[2-7] |
[production] |
| 10:09 |
<_joe_> |
upgrading pybal on active nodes in esams and eqiad |
[production] |
| 10:04 |
<_joe_> |
depooling elastic1021.eqiad.wmnet as RAM has failed |
[production] |
| 09:56 |
<jynus> |
running table engine conversion script on db1069 (potential small lag on labs for 1 day) |
[production] |
| 09:40 |
<moritzm> |
restarted cassandra-a service on praseodymium |
[production] |
| 09:21 |
<ema> |
restarted hhvm on mw1132 |
[production] |
| 08:49 |
<_joe_> |
installing the new pybal package in esams and eqiad backups |
[production] |
| 08:23 |
<moritzm> |
restarted cassandra-a service on praseodymium |
[production] |
| 07:11 |
<_joe_> |
manually touched (with -h) the wmf-config/PrivateSettings.php symlink on all mw* hosts |
[production] |
| 07:02 |
<tgr@mira> |
Synchronized wmf-config/PrivateSettings.php: Mass logout via $wgAuthenticationTokenVersion - T124440#2010709 (duration: 01m 20s) |
[production] |
| 07:01 |
<tgr@mira> |
Synchronized private/PrivateSettings.php: Mass logout via $wgAuthenticationTokenVersion - T124440#2010709 (duration: 01m 19s) |
[production] |
| 01:58 |
<legoktm> |
added SMalyshev to wikidata-query gerrit group |
[production] |
| 01:34 |
<krenair@mira> |
Synchronized php-1.27.0-wmf.12/extensions: https://gerrit.wikimedia.org/r/#/c/269344/ and https://gerrit.wikimedia.org/r/#/c/269293/1 (duration: 01m 51s) |
[production] |
| 01:27 |
<krenair@mira> |
Synchronized php-1.27.0-wmf.12/extensions/OAuth/frontend/specialpages/SpecialMWOAuthManageConsumers.php: https://gerrit.wikimedia.org/r/#/c/269333/ (duration: 01m 19s) |
[production] |
| 01:24 |
<krenair@mira> |
Synchronized php-1.27.0-wmf.12/resources/src: https://gerrit.wikimedia.org/r/#/c/269140/ (duration: 01m 19s) |
[production] |
| 00:54 |
<krenair@mira> |
Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/266509/ (duration: 01m 17s) |
[production] |
| 00:52 |
<krenair@mira> |
Synchronized docroot/noc: https://gerrit.wikimedia.org/r/#/c/266509/8 (duration: 01m 17s) |
[production] |
| 00:50 |
<krenair@mira> |
Synchronized wmf-config/ProductionServices.php: https://gerrit.wikimedia.org/r/#/c/266509/8 (duration: 01m 18s) |
[production] |
| 00:42 |
<hashar> |
killed Zuul scheduler. On gallium edited /usr/share/python/zuul/local/lib/python2.7/site-packages/zuul/trigger/gerrit.py and modified: replication_timeout = 300 -> replication_timeout = 10 . Started Zuul |
[production] |
| 00:26 |
<krenair@mira> |
Synchronized portals: https://gerrit.wikimedia.org/r/#/c/268849/ (duration: 01m 18s) |
[production] |
| 00:24 |
<krenair@mira> |
Synchronized portals/prod/wikipedia.org/assets: https://gerrit.wikimedia.org/r/#/c/268849/ (duration: 01m 18s) |
[production] |
| 00:17 |
<krenair@mira> |
Synchronized portals: https://gerrit.wikimedia.org/r/#/c/268849/ (duration: 01m 17s) |
[production] |
| 00:15 |
<krenair@mira> |
Synchronized portals/prod/wikipedia.org/assets: https://gerrit.wikimedia.org/r/#/c/268849/ (duration: 01m 16s) |
[production] |
|
2016-02-08
§
|
| 23:30 |
<ori@mira> |
Synchronized php-1.27.0-wmf.12/includes/interwiki/Interwiki.php: ac6e170fa5: Fix-up for I5a979f047031e (duration: 01m 18s) |
[production] |
| 23:24 |
<bd808@mira> |
Synchronized wmf-config/logging.php: logging: Collect mw1017 logs for debugging (9d6d0e0) (duration: 01m 18s) |
[production] |
| 23:20 |
<bd808@mira> |
Synchronized wmf-config/logging.php: logging: Send all udp2log eligible messages to $wmgDefaultMonologHandler (cd25586) (duration: 01m 17s) |
[production] |
| 23:16 |
<bd808@mira> |
Synchronized wmf-config/logging.php: Monolog: Add mwversion to udp2log log events (9b54967) (duration: 01m 18s) |
[production] |
| 23:04 |
<bd808@mira> |
Synchronized wmf-config/logging.php: Monolog: normalize messages before PSR3 expansion (e5ee5d8) (duration: 01m 18s) |
[production] |
| 22:52 |
<ori@mira> |
Synchronized wmf-config/missing.php: Ib5407c560: Update missing.php for interwiki.php (duration: 01m 18s) |
[production] |
| 22:51 |
<ori@mira> |
Synchronized docroot and w: Ifd7fe8c3c: createTxtFileSymlinks.sh: drop interwiki.cdb; add interwiki.php (duration: 01m 21s) |
[production] |
| 22:43 |
<bd808@mira> |
Synchronized php-1.27.0-wmf.12/includes/debug/logger/monolog/WikiProcessor.php: Add $wgVersion to MediaWiki\Logger\Monolog\WikiProcessor (3cea726) (duration: 01m 19s) |
[production] |
| 21:51 |
<ori@mira> |
Synchronized wmf-config/CommonSettings.php: Ie9bdd77fb: Use interwiki.php on all wikis; delete unused interwiki.json (duration: 01m 19s) |
[production] |
| 21:31 |
<ori@mira> |
Synchronized wmf-config/CommonSettings.php: I39c9ecd4b: Enable static PHP interwiki cache on mediawikiwiki and testwiki (duration: 01m 18s) |
[production] |
| 21:28 |
<ori> |
Restarting HHVM on mw1017 to wipe APC cache |
[production] |
| 21:23 |
<ori@mira> |
Synchronized wmf-config/CommonSettings.php: Ib599f9984a: Add interwiki.php; use it on mw1017 & on labs (2/2) (duration: 01m 16s) |
[production] |
| 21:22 |
<ori@mira> |
Synchronized wmf-config/interwiki.php: Ib599f9984a: Add interwiki.php; use it on mw1017 & on labs (1/2) (duration: 01m 20s) |
[production] |
| 21:19 |
<subbu> |
finished deploying parsoid version 4d44fcc7 |
[production] |
| 21:10 |
<subbu> |
synced code; restarted parsoid on wtp1003 as a canary |
[production] |
| 21:04 |
<subbu> |
starting parsoid deploy |
[production] |
| 21:02 |
<bblack> |
resuming rolling reboots of cpNNNN caches for kernel updates |
[production] |
| 20:34 |
<mobrovac> |
restbase deploy end of c929ceb |
[production] |
| 20:26 |
<mobrovac> |
restbase deploy start of c929ceb |
[production] |
| 19:36 |
<mattflaschen@mira> |
Synchronized wmf-config/InitialiseSettings-labs.php: Beta Cluster-only change (duration: 01m 20s) |
[production] |
| 19:04 |
<papaul> |
sarin - signing puppet certs, salt-key, initial run |
[production] |
| 19:03 |
<urandom> |
restart restbase on restbase-test2001.codfw (staging) |
[production] |
| 18:54 |
<mobrovac> |
mathoid deployed 4bdb2f18c |
[production] |