201-250 of 10000 results (34ms)
2017-07-13 ยง
21:28 <robh@puppetmaster1001> conftool action : set/pooled=yes; selector: name=wdqs2002.codfw.wmnet [production]
21:28 <robh@puppetmaster1001> conftool action : set/pooled=yes; selector: name=wdqs2003.codfw.wmnet [production]
20:56 <demon@tin> Synchronized wmf-config/InitialiseSettings.php: MinervaNeue on testwiki (duration: 00m 47s) [production]
20:01 <smalyshev@tin> Finished deploy [wdqs/wdqs@a32dbeb]: Redeploy GUI due to breakage in T165228 (duration: 02m 19s) [production]
19:59 <smalyshev@tin> Started deploy [wdqs/wdqs@a32dbeb]: Redeploy GUI due to breakage in T165228 [production]
18:39 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2202.codfw.wmnet [production]
18:38 <dzahn@neodymium> conftool action : set/pooled=yes; selector: name=mw2201.codfw.wmnet [production]
18:31 <arlolra> Updated Parsoid to 71c07681 (T169293) [production]
18:29 <bblack> upgrading nginx on +wmf1 hosts: conf[1001-1003].eqiad.wmnet,cp1048.eqiad.wmnet,cp3036.esams.wmnet,elastic2020.codfw.wmnet,hassaleh.codfw.wmnet,hassium.eqiad.wmnet [production]
18:22 <arlolra@tin> Finished deploy [parsoid/deploy@d0041f2]: Updating Parsoid to 71c07681 (duration: 11m 12s) [production]
18:11 <arlolra@tin> Started deploy [parsoid/deploy@d0041f2]: Updating Parsoid to 71c07681 [production]
17:46 <volans> re-enabling puppet and force run on 'R:Package = nginx-common' [production]
17:38 <bblack> restarting varnish-be on cp1049 (mailbox lag) [production]
17:36 <bblack> restarting puppetmasters, staggered [production]
17:06 <volans> disabled puppet on nitrogen [production]
16:34 <chasemp> labstore2001:~# systemctl disable lvm2-activation && systemctl disable lvm2-activation-early && systemctl reset-failed (slated to be reimaged by madhu -- this alert is non-actionable) [production]
16:19 <urandom> Starting cassandra-a, restbase2007 (OOM) [production]
16:03 <dzahn@neodymium> conftool action : set/pooled=no; selector: name=mw2202.codfw.wmnet [production]
16:03 <dzahn@neodymium> conftool action : set/pooled=no; selector: name=mw2201.codfw.wmnet [production]
15:33 <marostegui> Deploy alter table on s1 - labsdb1009 - T166204 [production]
15:14 <ejegg> updated civicrm from 0aa0f8fb45e161ba2e3a2e2353075cf6bdc67f6c to 8840b94254bd258ae96157dd81adc4e2ebf68531 [production]
14:49 <marostegui> Skip maiwikimedia database creation which is breaking dbstore2001 replication - T168788 [production]
14:42 <godog> roll-restart cassandra in services-test to pick up renewed certs [production]
14:21 <marostegui> Run redact_sanitarium on db1069 and db1095 for maiwikimedia - T168788 [production]
14:19 <Reedy> `mwscript extensions/WikimediaMaintenance/createExtensionTables.php --wiki=maiwikimedia Translate` for T168782 [production]
14:13 <moritzm> rebooting graphite1* for kernel update [production]
13:11 <zeljkof> EU SWAT finished [production]
13:09 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:364983|Add enwiki as import source for specieswiki (T170094)]] (duration: 00m 47s) [production]
12:52 <moritzm> installing nginx security updates on cp1* [production]
12:12 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1053 - T168661 (duration: 01m 03s) [production]
11:40 <akosiaris> stop ircecho, icinga is misbehaving badly, no point it having it around [production]
11:28 <akosiaris> restart icinga, it's reporting wrong stuff all over the place [production]
10:35 <moritzm> installing nginx security updates on cp3* [production]
10:09 <moritzm> rebooting graphite2* for kernel update [production]
10:04 <ema> lvs[12]006: upgrade pybal to 1.13.9 T82747 T154759 [production]
09:43 <ema> lvs1010: upgrade pybal to 1.13.9 T82747 T154759 [production]
09:41 <ema> pybal 1.13.9 uploaded to apt.w.o [production]
09:21 <moritzm> installing nginx security updates on cp2* [production]
08:32 <moritzm> enabling jobrunner/jobchron on mw1260 (jessie video scaler) [production]
08:19 <godog> upgrade grafana to 4.4.1 on krypton - T169773 [production]
08:11 <jynus> powercycle pc2006, was down [production]
08:09 <jmm@puppetmaster1001> conftool action : set/pooled=yes; selector: mw1260.eqiad.wmnet [production]
07:58 <marostegui> Deploy alter table on s4 - db1053 - T168661 [production]
07:48 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1053 - T168661 (duration: 00m 47s) [production]
07:33 <moritzm> rebooting netmon1001 [production]
06:57 <moritzm> installing apache security updates on remaining mw1* hosts [production]
06:51 <moritzm> installing nginx security updates on cp4* [production]
06:51 <marostegui> Manually deploy some alter tables on dbstore1001 for enwiki - T166204 [production]
06:42 <_joe_> rolling restart of pybal on low-traffic balancers [production]
06:14 <XioNoX> restricting ssh algorithms on network devices - T170369 [production]