2051-2100 of 10000 results (29ms)
2016-02-09 §
12:33 <hashar> all CI slaves looping to death because of a php loop [production]
11:43 <paravoid> upgrading lvs2001, lvs2002, lvs2003 to kernel 4.4.0 [production]
11:36 <paravoid> reverting lvs2005 to 3.19 and rebooting, test is over and was successful [production]
11:19 <paravoid> stopping pybal on lvs2002 [production]
11:05 <paravoid> installing linux-image-4.4.0 on lvs2005 and rebooting for testing [production]
10:53 <apergos> salt minions on labs instances that respond to labcontrol1001 will be coming back up over the next 1/2 hour as puppet runs (salt master key fixes) [production]
10:45 <elukey> disabled puppet, redis and memcached on mc1004 for jessie migration [production]
10:33 <_joe_> pybal updated everywhere [production]
10:32 <gehel> elasticsearch codfw: cleanup leftover logs /var/log/elasticsearch/*.[2-7] [production]
10:24 <gehel> elasticsearch eqiad: cleanup leftover logs /var/log/elasticsearch/*.[2-7] [production]
10:09 <_joe_> upgrading pybal on active nodes in esams and eqiad [production]
10:04 <_joe_> depooling elastic1021.eqiad.wmnet as RAM has failed [production]
09:56 <jynus> running table engine conversion script on db1069 (potential small lag on labs for 1 day) [production]
09:40 <moritzm> restarted cassandra-a service on praseodymium [production]
09:21 <ema> restarted hhvm on mw1132 [production]
08:49 <_joe_> installing the new pybal package in esams and eqiad backups [production]
08:23 <moritzm> restarted cassandra-a service on praseodymium [production]
07:11 <_joe_> manually touched (with -h) the wmf-config/PrivateSettings.php symlink on all mw* hosts [production]
07:02 <tgr@mira> Synchronized wmf-config/PrivateSettings.php: Mass logout via $wgAuthenticationTokenVersion - T124440#2010709 (duration: 01m 20s) [production]
07:01 <tgr@mira> Synchronized private/PrivateSettings.php: Mass logout via $wgAuthenticationTokenVersion - T124440#2010709 (duration: 01m 19s) [production]
01:58 <legoktm> added SMalyshev to wikidata-query gerrit group [production]
01:34 <krenair@mira> Synchronized php-1.27.0-wmf.12/extensions: https://gerrit.wikimedia.org/r/#/c/269344/ and https://gerrit.wikimedia.org/r/#/c/269293/1 (duration: 01m 51s) [production]
01:27 <krenair@mira> Synchronized php-1.27.0-wmf.12/extensions/OAuth/frontend/specialpages/SpecialMWOAuthManageConsumers.php: https://gerrit.wikimedia.org/r/#/c/269333/ (duration: 01m 19s) [production]
01:24 <krenair@mira> Synchronized php-1.27.0-wmf.12/resources/src: https://gerrit.wikimedia.org/r/#/c/269140/ (duration: 01m 19s) [production]
00:54 <krenair@mira> Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/266509/ (duration: 01m 17s) [production]
00:52 <krenair@mira> Synchronized docroot/noc: https://gerrit.wikimedia.org/r/#/c/266509/8 (duration: 01m 17s) [production]
00:50 <krenair@mira> Synchronized wmf-config/ProductionServices.php: https://gerrit.wikimedia.org/r/#/c/266509/8 (duration: 01m 18s) [production]
00:42 <hashar> killed Zuul scheduler. On gallium edited /usr/share/python/zuul/local/lib/python2.7/site-packages/zuul/trigger/gerrit.py and modified: replication_timeout = 300 -> replication_timeout = 10 . Started Zuul [production]
00:26 <krenair@mira> Synchronized portals: https://gerrit.wikimedia.org/r/#/c/268849/ (duration: 01m 18s) [production]
00:24 <krenair@mira> Synchronized portals/prod/wikipedia.org/assets: https://gerrit.wikimedia.org/r/#/c/268849/ (duration: 01m 18s) [production]
00:17 <krenair@mira> Synchronized portals: https://gerrit.wikimedia.org/r/#/c/268849/ (duration: 01m 17s) [production]
00:15 <krenair@mira> Synchronized portals/prod/wikipedia.org/assets: https://gerrit.wikimedia.org/r/#/c/268849/ (duration: 01m 16s) [production]
2016-02-08 §
23:30 <ori@mira> Synchronized php-1.27.0-wmf.12/includes/interwiki/Interwiki.php: ac6e170fa5: Fix-up for I5a979f047031e (duration: 01m 18s) [production]
23:24 <bd808@mira> Synchronized wmf-config/logging.php: logging: Collect mw1017 logs for debugging (9d6d0e0) (duration: 01m 18s) [production]
23:20 <bd808@mira> Synchronized wmf-config/logging.php: logging: Send all udp2log eligible messages to $wmgDefaultMonologHandler (cd25586) (duration: 01m 17s) [production]
23:16 <bd808@mira> Synchronized wmf-config/logging.php: Monolog: Add mwversion to udp2log log events (9b54967) (duration: 01m 18s) [production]
23:04 <bd808@mira> Synchronized wmf-config/logging.php: Monolog: normalize messages before PSR3 expansion (e5ee5d8) (duration: 01m 18s) [production]
22:52 <ori@mira> Synchronized wmf-config/missing.php: Ib5407c560: Update missing.php for interwiki.php (duration: 01m 18s) [production]
22:51 <ori@mira> Synchronized docroot and w: Ifd7fe8c3c: createTxtFileSymlinks.sh: drop interwiki.cdb; add interwiki.php (duration: 01m 21s) [production]
22:43 <bd808@mira> Synchronized php-1.27.0-wmf.12/includes/debug/logger/monolog/WikiProcessor.php: Add $wgVersion to MediaWiki\Logger\Monolog\WikiProcessor (3cea726) (duration: 01m 19s) [production]
21:51 <ori@mira> Synchronized wmf-config/CommonSettings.php: Ie9bdd77fb: Use interwiki.php on all wikis; delete unused interwiki.json (duration: 01m 19s) [production]
21:31 <ori@mira> Synchronized wmf-config/CommonSettings.php: I39c9ecd4b: Enable static PHP interwiki cache on mediawikiwiki and testwiki (duration: 01m 18s) [production]
21:28 <ori> Restarting HHVM on mw1017 to wipe APC cache [production]
21:23 <ori@mira> Synchronized wmf-config/CommonSettings.php: Ib599f9984a: Add interwiki.php; use it on mw1017 & on labs (2/2) (duration: 01m 16s) [production]
21:22 <ori@mira> Synchronized wmf-config/interwiki.php: Ib599f9984a: Add interwiki.php; use it on mw1017 & on labs (1/2) (duration: 01m 20s) [production]
21:19 <subbu> finished deploying parsoid version 4d44fcc7 [production]
21:10 <subbu> synced code; restarted parsoid on wtp1003 as a canary [production]
21:04 <subbu> starting parsoid deploy [production]
21:02 <bblack> resuming rolling reboots of cpNNNN caches for kernel updates [production]
20:34 <mobrovac> restbase deploy end of c929ceb [production]