2051-2100 of 10000 results (41ms)
2016-10-28 §
09:20 <hashar> Pulling CirrusSearch patch https://gerrit.wikimedia.org/r/#/c/318505/ on mw1099 for T149254 (fix log spam/fatal/warnings) [production]
09:10 <moritzm> rebooting pool counters in codfw for kernel update [production]
09:06 <marostegui> Deploying schema change s1.enwiki - only codfw - T147166 [production]
08:01 <jynus> applying schema change (imagelinks) to s3 wikis T139090 [production]
07:17 <moritzm> installing PHP security updates on jessie [production]
02:32 <l10nupdate@tin> ResourceLoader cache refresh completed at Fri Oct 28 02:32:31 UTC 2016 (duration 5m 12s) [production]
02:27 <l10nupdate@tin> scap sync-l10n completed (1.28.0-wmf.23) (duration: 09m 07s) [production]
01:32 <eileen1> update civicrm from 31bea5b36fb22792472990672a49e8dea637546c to 56eadabf705b3d035e11bb9fd3478457c159e40d [production]
00:20 <bd808> Testing logging to SAL via stashbot [production]
2016-10-27 §
23:39 <yurik@tin> Synchronized php-1.28.0-wmf.23/extensions/Kartographer/modules/dialog/dialog.js: https://gerrit.wikimedia.org/r/#/c/318457/ (duration: 00m 47s) [production]
22:08 <godog> "cassandra" graphite machines LV at 90% used, add 300G via lvresize [production]
21:55 <yurik> deployed kartotherian [production]
21:41 <yurik> about to deploy kartotherian update [production]
21:10 <urandom> T133395: Altering mobileapps keyspaces to use time-windowed compaction [production]
19:27 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: all wikis to 1.28.0-wmf.23 [production]
19:25 <twentyafterfour> Bumping all wikis to 1.28.0-wmf.23 refs T147517 [production]
19:18 <ejegg> updated payments-wiki from df4c72dbd328307019a82449527dd13c84bf41ab to e86f23a371e75a1684de5c102c06d993ead660e0 [production]
19:07 <maxsem@tin> Finished scap: https://gerrit.wikimedia.org/r/#/c/318343/ (duration: 37m 38s) [production]
19:06 <ejegg> updated SmashPig from f5f49d79fac0887df78ddcc68a2f5ced0670c387 to 142e60bfe09982f9f86b7839cbf35d9e0e96b8d7 [production]
18:29 <maxsem@tin> Started scap: https://gerrit.wikimedia.org/r/#/c/318343/ [production]
18:26 <legoktm@tin> Synchronized php-1.28.0-wmf.23/includes/parser/Parser.php: Remove tracking category stuff that accidentally slipped into 61adc1e14 - T149310 (duration: 00m 46s) [production]
18:14 <thcipriani@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:318293|Get rid of ip/IP tolerance for throttle rules (T131469)]] (duration: 00m 46s) [production]
18:09 <gehel> wdqs deployment of latest GUI [production]
17:54 <godog> upgrading prometheus to 1.2.1 in codfw/eqiad [production]
16:56 <moritzm> uploaded gerrit 2.12.5 to apt.wikimedia.org [production]
16:43 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: scb1003.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=cxserver']) [production]
16:43 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: mw1241.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=appserver', 'service=apache2']) [production]
16:33 <akosiaris@puppetmaster1001> conftool action : set/pooled=no; selector: mw1241.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=appserver', 'service=apache2']) [production]
16:24 <akosiaris@puppetmaster1001> conftool action : set/pooled=no; selector: scb1003.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=cxserver']) [production]
16:18 <hashar> Restarted Jenkins Gearman client due to a deadlock with the beta cluster jobs [production]
15:26 <akosiaris> start confd on puppetmaster1001 and puppetmaster2001 [production]
15:02 <akosiaris> disable puppet across the fleet for puppetmaster kernel upgrades [production]
14:26 <moritzm> migrating nodes from ganeti2001 for kernel reboot [production]
14:24 <moritzm> restarted ntp on ganeti2006 (stuck in XFAC state) [production]
14:17 <moritzm> failover of ganeti2002 to new master node in codfw [production]
13:59 <moritzm> migrating nodes from ganeti2002 for kernel reboot [production]
13:42 <hashar> European SWAT completed [production]
13:39 <moritzm> migrating nodes from ganeti2003 for kernel reboot [production]
13:35 <hashar@tin> Synchronized php-1.28.0-wmf.23/extensions/CirrusSearch/includes/HTMLCompletionProfileSettings.php: Fix comp suggest pref page (duration: 00m 48s) [production]
13:34 <gehel> maps / postgres replication checks in error after deployment of https://gerrit.wikimedia.org/r/#/c/315271/ (T147194) - replication is working, only check is failing - icinga is silenced [production]
13:33 <gehel> postgres replication checks in error after deployment of https://gerrit.wikimedia.org/r/#/c/315271/ (T147194) - replication is working, only check is failing - icinga is silenced [production]
13:32 <moritzm> migrating nodes from ganeti2004 for kernel reboot [production]
13:17 <moritzm> migrating nodes from ganeti2005 for kernel reboot [production]
13:10 <hashar@tin> Synchronized wmf-config/throttle.php: T146600 T149200 (duration: 00m 53s) [production]
12:53 <moritzm> uploaded openjdk-8 8u111 for jessie-wikimedia to apt.wikimedia.org [production]
12:36 <moritzm> migrating nodes from ganeti2006 for kernel reboot [production]
12:35 <gehel> disabling puppet on maps servers for deployment of https://gerrit.wikimedia.org/r/#/c/315271/ [production]
12:20 <moritzm> restarted ntp on conf1001 (stuck in XFAC state) [production]
12:04 <gehel> restart elasticsearch on relforge to activate GC logs - T134853 [production]
11:33 <_joe_> stopping all cache-related services on esams spares cp3012-22 [production]