201-250 of 10000 results (42ms)
2018-03-26 §
12:30 <arturo> reboot labnet100[2,3,4]* for T189115 [production]
12:30 <arturo> reboot labbwr100[2,3,4] for T189115 [production]
12:00 <arturo> reboot labmon100[1,2] for T189115 [production]
12:00 <moritzm> restarting HHVM on mediawiki canaries to pick up ICU security update [production]
11:47 <arturo> reboot labcontrol100[3,4] for T189115 [production]
11:31 <arturo> reboot labcontrol1002 for T189115 [production]
11:16 <akosiaris> depool scb hosts for mathoid service. T184919 [production]
11:16 <akosiaris@puppetmaster1001> conftool action : set/pooled=no; selector: service=mathoid,cluster=scb,name=scb.* [production]
10:56 <moritzm> installing ICU security updates for jessie/stretch [production]
10:39 <arturo> reboot silver for T189115 [production]
10:34 <arturo> reboot californium for T189115 [production]
10:26 <moritzm> upgrading debdeploy across the fleet to 0.0.99.4 [production]
10:23 <moritzm> uploaded debdeploy 0.0.99.4 to apt.wikimedia (for trusty/jessie/stretch) [production]
08:17 <moritzm> upgrading debdeploy across the fleet to latest release [production]
07:33 <elukey> stop eventlogging zmq-forwarder on eventlog1001 as part of decom process - T189566 [production]
05:39 <_joe_> restarting pdfrenderer on scb1001,1003 [production]
02:00 <l10nupdate@tin> LocalisationUpdate failed: git pull of core failed [production]
2018-03-24 §
20:22 <foks> rm 2fa from Awight@officewiki [production]
15:00 <elukey> rm -rf /srv/mediawiki/core on stat100[456] and force puppet run (git pull returned fatal: protocol error: bad pack header) [production]
02:33 <bblack> powercycle cp3048 [production]
02:31 <bblack@neodymium> conftool action : set/pooled=no; selector: name=cp3048.esams.wmnet [production]
01:27 <Krinkle> Correct retention rules for Whisper files on graphite2001 and graphite1001 per T179622 (/var/lib/carbon/whisper/VisualEditor/*) [production]
00:39 <Krinkle> Correct retention rules for Whisper files on graphite2001 and graphite1001 per T179622 (/var/lib/carbon/whisper/mw/*) [production]
2018-03-23 §
21:35 <ebernhardson> delete indices for deleted wikis (from deleted.dblist) in eqiad and codfw elasticsearch clusters: alswikiquote, alswiktionary, mowiki, mowiktionary, ukwikimedia [production]
19:24 <sbisson@tin> Finished deploy [kartotherian/deploy@f716cde]: Deploying i18n feature to maps-test* (take 4) (duration: 06m 58s) [production]
19:17 <sbisson@tin> Started deploy [kartotherian/deploy@f716cde]: Deploying i18n feature to maps-test* (take 4) [production]
19:11 <sbisson@tin> Finished deploy [kartotherian/deploy@f716cde]: Deploying i18n feature to maps-test* (take 3) (duration: 04m 19s) [production]
19:07 <sbisson@tin> Started deploy [kartotherian/deploy@f716cde]: Deploying i18n feature to maps-test* (take 3) [production]
19:06 <sbisson@tin> Finished deploy [kartotherian/deploy@f716cde]: Deploying i18n feature to maps-test* (take 2) (duration: 06m 23s) [production]
18:59 <sbisson@tin> Started deploy [kartotherian/deploy@f716cde]: Deploying i18n feature to maps-test* (take 2) [production]
18:28 <sbisson@tin> Finished deploy [kartotherian/deploy@a66ff1d]: Deploying i18n feature to maps-test* (duration: 00m 29s) [production]
18:28 <sbisson@tin> Started deploy [kartotherian/deploy@a66ff1d]: Deploying i18n feature to maps-test* [production]
15:43 <moritzm> uploaded debdeploy 0.0.99.3 to apt.wikimedia.org (now based on Python 3 for the clients) [production]
15:08 <ema> cache_codfw: begin reboots for retpoline kernel upgrades T188092 [production]
15:02 <bawolff@tin> Synchronized php-1.31.0-wmf.26/includes/api/ApiQueryUserContributions.php: T190507 (duration: 00m 59s) [production]
13:24 <moritzm> installing postgres security updates on rhenium [production]
12:51 <oblivian@puppetmaster2001> conftool action : set/pooled=yes; selector: dc=eqiad,cluster=appserver,service=apache2 [production]
12:48 <oblivian@puppetmaster2001> conftool action : set/pooled=yes; selector: dc=eqiad,cluster=api_appserver,service=apache2 [production]
11:46 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Increase db1072 weight (duration: 00m 59s) [production]
11:19 <moritzm> installing libvorbis security updates on trusty (Debian already fixed) [production]
11:09 <elukey> restarting jvm daemons on analytics100[12] (Hadoop Masters) for openjdk-8 upgrade [production]
10:59 <jynus> deployed new replication filter for labsdb1004 on u2815__p.all_articles T190488 [production]
10:49 <ladsgroup@tin> Synchronized wmf-config/Wikibase-production.php: [[gerrit:421333|Disable reading wb_terms search fields on wikidata (T189777)]] (duration: 00m 59s) [production]
10:36 <elukey> upload cassandra2.2.6-wmf3 to jessie/stretch-wikimedia -C component/cassandra22 - T189529 [production]
10:22 <moritzm> restarting apache on krypton to pick up curl security update [production]
10:00 <moritzm> installing plexus-utils2 security updates [production]
09:49 <moritzm> armed keyholder on deploy1001 [production]
08:19 <elukey> reboot eventlog1001 for kernel upgrades [production]
2018-03-22 §
23:40 <Amir1> Evening SWAT is done [production]
23:40 <Amir1> Just to note, if you are seeing any performance regression (specially database-wise) 421333 might be the reason [production]