2751-2800 of 10000 results (37ms)
2016-03-31 §
22:22 <Pchelolo> finished update restbase to ba39d2bc [production]
22:15 <Pchelolo> started update restbase to ba39d2bc [production]
22:06 <Pchelolo> update restbase to ba39d2bc canary on restbase1005 [production]
22:02 <Pchelolo> reenable puppet on cerium in restbase staging [production]
21:26 <Pchelolo> disabling puppet on cerium, updating config and deploying restbase to staging. Testing https://gerrit.wikimedia.org/r/#/c/280711/ [production]
21:00 <mutante> bast2001 has been reinstalled and can be used again. fingerprints at https://wikitech.wikimedia.org/wiki/Help:SSH_Fingerprints/bast2001.wikimedia.org [production]
20:38 <mutante> bast2001 - revoking old, signing new puppet certs, salt key.. [production]
20:21 <mutante> bast2001 - reinstall after disk replacement [production]
20:01 <ottomata> stopping eventlogging, uninstalling globally installed eventlogging python code, running puppet, restarting eventlogging from /srv/deployment/eventlogging/eventlogging [production]
19:59 <ottomata> temporarily stopped puppet on eventlog1001 [production]
19:12 <volans> Starting slave for s2 on db1047 [production]
19:04 <thcipriani@tin> rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.27.0-wmf.19 [production]
17:46 <mutante> rcs1002 - stop ferm [production]
15:56 <tgr> running checkLocalUser.php --delete on some wikis for T119736 [production]
15:17 <thcipriani@tin> Synchronized php-1.27.0-wmf.19/extensions/CirrusSearch/includes/ElasticsearchIntermediary.php: SWAT: Ignore ResultSets that do not return pages [[gerrit:280669]] (duration: 00m 38s) [production]
14:01 <volans> manually running puppet on es2018 to double verify merged changes [production]
13:55 <mutante> hooft - reboot to pxe, one more time [production]
13:49 <mutante> netmon1001 - re-enabled puppet (was for torrus issue earlier) [production]
13:44 <elukey> forced puppet agent on netmon1001 [production]
13:27 <ema> repooling cp1044, upgraded to varnish 4 (T122880) [production]
13:17 <moritzm> installing rsync security updates [production]
13:09 <ema> depooling cp1044 for varnish 4 upgrade (T122880) [production]
12:02 <moritzm> removed rsync 3.10-2ubuntu0.1~wmf1 from carbon. this backport was only needed when the hosts used a mix of precise and trusty. this is no longer the case, so remove the backport and allow to use stock Ubuntu updates on precise again [production]
10:42 <elukey> stopping torrus-common on netmon1001 to try https://wikitech.wikimedia.org/wiki/Torrus#Deadlock_problem [production]
10:35 <elukey> restarted torrus-common on netmon1001 [production]
10:24 <moritzm> logstash on logstash100[1-3] is now using systemd [production]
09:50 <moritzm> disabled puppet on logstash1002/1003 (to activate the new logstash systemd unit in steps) [production]
09:00 <volans> Forced WriteBack cache policy mode on db1047 RAID [production]
06:11 <Krinkle> mwscript deleteEqualMessages.php --wiki zh_min_nanwiki (T45917) [production]
05:31 <krinkle@tin> Synchronized docroot/wikipedia.org/speed-tests/: (no message) (duration: 00m 33s) [production]
05:13 <krinkle@tin> Synchronized php-1.27.0-wmf.19/extensions/MobileFrontend/: Iaa5ed38c712b19e (duration: 00m 31s) [production]
05:10 <krinkle@tin> Synchronized php-1.27.0-wmf.18/extensions/MobileFrontend/: Iaa5ed38c712b19e (duration: 00m 42s) [production]
02:48 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.19) (duration: 10m 26s) [production]
02:27 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.18) (duration: 11m 52s) [production]
00:30 <mutante> argon - removing apache and config [production]
00:04 <krinkle@tin> Synchronized errorpages/: (no message) (duration: 00m 33s) [production]
2016-03-30 §
23:42 <maxsem@tin> Synchronized php-1.27.0-wmf.19/extensions/Kartographer/: (no message) (duration: 00m 27s) [production]
23:35 <yuvipanda> cleaned salt keys for analytics1017 and 1021 [production]
23:34 <yuvipanda> cleaned out puppet cert for analytics 1017 and 1021 [production]
23:10 <maxsem@tin> Synchronized php-1.27.0-wmf.18/extensions/Kartographer/: https://gerrit.wikimedia.org/r/#/c/280600/ (duration: 00m 31s) [production]
23:08 <maxsem@tin> Synchronized php-1.27.0-wmf.19/extensions/Kartographer/: https://gerrit.wikimedia.org/r/#/c/280601/ (duration: 00m 34s) [production]
23:06 <mutante> torrus - follow instruction for deadlock problem [production]
23:06 <maxsem@tin> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/280449/ (duration: 00m 43s) [production]
22:13 <mutante> smokeping/netmon - remove hooft/bast3001, restart service [production]
21:05 <maxsem@tin> Synchronized php-1.27.0-wmf.19/extensions/CirrusSearch/: https://gerrit.wikimedia.org/r/#/c/280549/ (duration: 00m 40s) [production]
20:20 <subbu> finished deploying parsoid version a20ef276 [production]
20:15 <Pchelolo> finished update restbase to 1b52276f [production]
20:11 <subbu> synced code; restarted parsoid on wtp1004 as a canary [production]
20:10 <Pchelolo> starting update restbase to 1b52276f [production]
20:07 <subbu> starting parsoid deploy [production]