8401-8450 of 10000 results (45ms)
2016-01-28 §
15:00 <hashar> Running puppet on deployment-memc02 and deployment-elastic07 . It is catching up with lot of changes [releng]
14:59 <hashar> fixing puppet hostnames on deployment-elastic07 [releng]
14:59 <hashar> fixing puppet hostnames on deployment-memc02 [releng]
14:55 <hashar> Deleted salt keys deployment-pdf01.eqiad.wmflabs and deployment-memc04.eqiad.wmflabs (obsolete, entries with '.deployment-prep.' are already there) [releng]
14:09 <moritzm> rebooting serpens/seaborgium for kernel update [production]
13:59 <mforns> stop EventLogging until kafka is ok [analytics]
13:58 <faidon@mira> Synchronized wmf-config/InitialiseSettings.php: depool kafka1012 (duration: 02m 10s) [production]
13:31 <bblack> citoid and cxserver public hostnames moving to cache_text [production]
13:23 <mforns> restart EventLogging to overcome connection problems following kafka maintenance [analytics]
12:59 <moritzm> rebooting rutherfordium (peopleweb) for kernel update [production]
12:53 <elukey> stopping kafka on kafka1012 + host reboot for kernel upgrade [production]
12:50 <elukey> stopping kafka1012 for kernel upgrade [analytics]
12:23 <jynus> generating empty schema for new codfw parsercaches [production]
12:14 <jynus@mira> Synchronized wmf-config/db-codfw.php: New parsercache servers for codfw datacenter (duration: 03m 10s) [production]
12:11 <jynus@mira> Synchronized wmf-config/db-eqiad.php: New parsercache servers for codfw datacenter (duration: 02m 15s) [production]
12:07 <jynus> pooling new parsercaches for codfw datacenter [production]
12:01 <moritzm> powercycled mw1163, was unreachable after reboot of the jobrunners (but now up again after powercycle via mgmt) [production]
11:37 <joal> run camus manually to check if succesful [analytics]
11:31 <elukey> disabled puppet and camus webrequestlog in analytics1027 [analytics]
11:31 <joal> Moving faulty camus imported files to a temporary place [analytics]
11:31 <elukey> disabled puppet on analytics1027 due to some issues with camus and hdfs [production]
11:29 <elukey> disabled puppet and # Puppet Name: camus-webrequest [analytics]
10:42 <moritzm> rebooted parsoid systems in codfw for kernel update, rolling reboot for eqiad [production]
10:39 <_joe_> rolling reboot of jobrunners in eqiad [production]
07:38 <jzerebecki> reload zuul for 4951444..43a030b [releng]
05:55 <jzerebecki> doing https://www.mediawiki.org/wiki/Continuous_integration/Jenkins#Hung_beta_code.2Fdb_update [releng]
03:49 <mobrovac> deployment-prep re-enabled puppet on deployment-restbase0x [releng]
02:49 <mobrovac> deployment-prep deployment-restbase01 disabled puppet to set up cassandra for [releng]
02:46 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.11) (duration: 06m 16s) [production]
02:41 <tgr@mira> Synchronized php-1.27.0-wmf.11/includes/: deploy SessionManager patch for T124971: gerrit 266944, 266946 (duration: 03m 20s) [production]
02:27 <mobrovac> deployment-prep recreating deployment-restbase01 for T125003 [releng]
02:27 <mwdeploy@tin> sync-l10n completed (1.27.0-wmf.10) (duration: 10m 21s) [production]
02:23 <mobrovac> deployment-prep deployment-restbase02 disabled puppet to recreate deployment-restbase01 for T125003 [releng]
01:42 <mobrovac> deployment-prep recreating deployment-sca02 for T125003 [releng]
01:28 <mobrovac> deployment-prep recreating deployment-sca01 for T125003 [releng]
01:03 <krenair@mira> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/264460/ (duration: 02m 30s) [production]
00:58 <krenair@mira> Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/264066/ (duration: 02m 26s) [production]
00:46 <krenair@mira> Synchronized php-1.27.0-wmf.11/extensions/Gather/resources: https://gerrit.wikimedia.org/r/#/c/266793/ and https://gerrit.wikimedia.org/r/#/c/266792/ (duration: 02m 23s) [production]
00:41 <krenair@mira> Synchronized php-1.27.0-wmf.11/extensions/Flow/: https://gerrit.wikimedia.org/r/#/c/266939/ (duration: 02m 27s) [production]
00:36 <mobrovac> deployment-prep re-imaging deployment-mathoid for T125003 [releng]
00:27 <krenair@mira> Synchronized php-1.27.0-wmf.10/extensions/Flow/includes: https://gerrit.wikimedia.org/r/#/c/266938/ (duration: 02m 29s) [production]
00:09 <krenair@mira> Synchronized wmf-config/InitialiseSettings-labs.php: https://gerrit.wikimedia.org/r/#/c/266945/ (duration: 02m 36s) [production]
00:02 <jzerebecki> integration-slave-trusty-1016:~$ sudo -i rm -rf /mnt/jenkins-workspace/workspace/mwext-testextension-hhvm/src/skins/Donate [releng]
2016-01-27 §
23:49 <jzerebecki> integration-slave-precise-1011:~$ sudo -i /etc/init.d/salt-minion restart [releng]
23:46 <jzerebecki> work around https://phabricator.wikimedia.org/T117710 : salt --show-timeout '*slave*' cmd.run 'rm -rf /mnt/jenkins-workspace/workspace/mwext-testextension-hhvm/src/skins/BlueSky' [releng]
23:07 <YuviPanda> removed all members of templatetiger, added self instead, removed active shell sessions [tools]
22:36 <robh> restarting parsoid-rt-client service on ruthenium [production]
22:29 <ottomata> starting mysqldump of MobileWebSectionUsage_14321266 from db1047 into m4-master [production]
22:29 <ottomata> starting mysqldump of MobileWebSectionUsage_14321266 from db1047 into m4-master [analytics]
21:45 <yurik> updated graphoid on scb* [production]