301-350 of 10000 results (44ms)
2018-03-26 §
08:17 <moritzm> upgrading debdeploy across the fleet to latest release [production]
07:33 <elukey> stop eventlogging zmq-forwarder on eventlog1001 as part of decom process - T189566 [production]
05:39 <_joe_> restarting pdfrenderer on scb1001,1003 [production]
02:00 <l10nupdate@tin> LocalisationUpdate failed: git pull of core failed [production]
2018-03-24 §
20:22 <foks> rm 2fa from Awight@officewiki [production]
15:00 <elukey> rm -rf /srv/mediawiki/core on stat100[456] and force puppet run (git pull returned fatal: protocol error: bad pack header) [production]
02:33 <bblack> powercycle cp3048 [production]
02:31 <bblack@neodymium> conftool action : set/pooled=no; selector: name=cp3048.esams.wmnet [production]
01:27 <Krinkle> Correct retention rules for Whisper files on graphite2001 and graphite1001 per T179622 (/var/lib/carbon/whisper/VisualEditor/*) [production]
00:39 <Krinkle> Correct retention rules for Whisper files on graphite2001 and graphite1001 per T179622 (/var/lib/carbon/whisper/mw/*) [production]
2018-03-23 §
21:35 <ebernhardson> delete indices for deleted wikis (from deleted.dblist) in eqiad and codfw elasticsearch clusters: alswikiquote, alswiktionary, mowiki, mowiktionary, ukwikimedia [production]
19:24 <sbisson@tin> Finished deploy [kartotherian/deploy@f716cde]: Deploying i18n feature to maps-test* (take 4) (duration: 06m 58s) [production]
19:17 <sbisson@tin> Started deploy [kartotherian/deploy@f716cde]: Deploying i18n feature to maps-test* (take 4) [production]
19:11 <sbisson@tin> Finished deploy [kartotherian/deploy@f716cde]: Deploying i18n feature to maps-test* (take 3) (duration: 04m 19s) [production]
19:07 <sbisson@tin> Started deploy [kartotherian/deploy@f716cde]: Deploying i18n feature to maps-test* (take 3) [production]
19:06 <sbisson@tin> Finished deploy [kartotherian/deploy@f716cde]: Deploying i18n feature to maps-test* (take 2) (duration: 06m 23s) [production]
18:59 <sbisson@tin> Started deploy [kartotherian/deploy@f716cde]: Deploying i18n feature to maps-test* (take 2) [production]
18:28 <sbisson@tin> Finished deploy [kartotherian/deploy@a66ff1d]: Deploying i18n feature to maps-test* (duration: 00m 29s) [production]
18:28 <sbisson@tin> Started deploy [kartotherian/deploy@a66ff1d]: Deploying i18n feature to maps-test* [production]
15:43 <moritzm> uploaded debdeploy 0.0.99.3 to apt.wikimedia.org (now based on Python 3 for the clients) [production]
15:08 <ema> cache_codfw: begin reboots for retpoline kernel upgrades T188092 [production]
15:02 <bawolff@tin> Synchronized php-1.31.0-wmf.26/includes/api/ApiQueryUserContributions.php: T190507 (duration: 00m 59s) [production]
13:24 <moritzm> installing postgres security updates on rhenium [production]
12:51 <oblivian@puppetmaster2001> conftool action : set/pooled=yes; selector: dc=eqiad,cluster=appserver,service=apache2 [production]
12:48 <oblivian@puppetmaster2001> conftool action : set/pooled=yes; selector: dc=eqiad,cluster=api_appserver,service=apache2 [production]
11:46 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Increase db1072 weight (duration: 00m 59s) [production]
11:19 <moritzm> installing libvorbis security updates on trusty (Debian already fixed) [production]
11:09 <elukey> restarting jvm daemons on analytics100[12] (Hadoop Masters) for openjdk-8 upgrade [production]
10:59 <jynus> deployed new replication filter for labsdb1004 on u2815__p.all_articles T190488 [production]
10:49 <ladsgroup@tin> Synchronized wmf-config/Wikibase-production.php: [[gerrit:421333|Disable reading wb_terms search fields on wikidata (T189777)]] (duration: 00m 59s) [production]
10:36 <elukey> upload cassandra2.2.6-wmf3 to jessie/stretch-wikimedia -C component/cassandra22 - T189529 [production]
10:22 <moritzm> restarting apache on krypton to pick up curl security update [production]
10:00 <moritzm> installing plexus-utils2 security updates [production]
09:49 <moritzm> armed keyholder on deploy1001 [production]
08:19 <elukey> reboot eventlog1001 for kernel upgrades [production]
2018-03-22 §
23:40 <Amir1> Evening SWAT is done [production]
23:40 <Amir1> Just to note, if you are seeing any performance regression (specially database-wise) 421333 might be the reason [production]
23:39 <ladsgroup@tin> Synchronized wmf-config/Wikibase-production.php: [[gerrit:421333|Disable reading wb_terms search fields on wikidata (T189777)]] (duration: 00m 58s) [production]
23:29 <ladsgroup@tin> Synchronized static/images/project-logos/nds_nlwiki.png: [[gerrit:420934|Update logo for Dutch Low Saxon Wikipedia (T190051)]] (duration: 00m 58s) [production]
23:27 <ladsgroup@tin> Synchronized static/images/project-logos/nds_nlwiki-2x.png: [[gerrit:420934|Update logo for Dutch Low Saxon Wikipedia (T190051)]] (duration: 00m 56s) [production]
23:26 <ladsgroup@tin> Synchronized static/images/project-logos/nds_nlwiki-1.5x.png: [[gerrit:420934|Update logo for Dutch Low Saxon Wikipedia (T190051)]] (duration: 00m 58s) [production]
23:23 <ladsgroup@tin> Synchronized static/images/project-logos/nds_nlwiki-1.5x.png: static/images/project-logos/nds_nlwiki-2x.png static/images/project-logos/nds_nlwiki.png [[gerrit:420934|Update logo for Dutch Low Saxon Wikipedia (T190051)]] (duration: 00m 59s) [production]
22:47 <mutante> restarting Gerrit to apply config changes gerrit:406145 and gerrit:410474 [production]
22:25 <mutante> icinga - re-enabling notifications for a LOT of "systemd checks" that were all OK since a longer time but had not been re-enabled after some maintenance [production]
20:18 <andrewbogott> reimaged labtestvirt2002 [production]
19:52 <demon@tin> rebuilt and synchronized wikiversions files: group2 to wmf.26 [production]
19:34 <cmjohnson1> db1052 replacing disk slot 8 [production]
18:52 <XioNoX> done with the asw-a/b/c-eqiad switches uplink work [production]
18:43 <Amir1> Morning SWAT is done [production]
18:41 <ladsgroup@tin> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:421352|Enable VirtualPageViews on s6 (ja,ru,fr) wikis (T189906)]] (duration: 01m 16s) [production]