1301-1350 of 10000 results (55ms)
2018-10-01 §
12:19 <banyek> stopping replication on s2@dbstore20002: the tables being compressed [production]
12:15 <banyek> enabling puppet on labsdb1009, labsdb1010, labsdb1011 (T183983) [production]
12:13 <zeljkof> EU SWAT finished [production]
12:12 <zfilipin@deploy1001> Synchronized php-1.32.0-wmf.23/extensions/ContentTranslation/: SWAT: [[gerrit:463446|Fix error in CXTransclusionNode#afterRender method (T205521)]] (duration: 00m 59s) [production]
11:56 <jynus> stopping db1093 to clone it to dbstore1001 [production]
11:52 <arturo> install prometheus-openstack-exporte 0.0.8-3 in reprepro T203177 [production]
11:41 <zfilipin@deploy1001> Synchronized wmf-config: SWAT: [[gerrit:460492|Remove unused default source language config for CX]] (duration: 00m 57s) [production]
11:16 <jynus@deploy1001> Synchronized wmf-config/db-codfw.php: Repool db2058 (duration: 00m 55s) [production]
11:09 <_joe_> killed bash runner.sh by user ladsgroup on mwmaint2001 [production]
10:58 <jynus@deploy1001> Synchronized wmf-config/db-codfw.php: Depool db2058 (duration: 00m 57s) [production]
10:52 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1093, db1064 (duration: 00m 57s) [production]
10:42 <jdrewniak@deploy1001> Synchronized portals: Wikimedia Portals Update: [[gerrit:463723|Bumping portals to master (T128546)]] (duration: 00m 56s) [production]
10:41 <jdrewniak@deploy1001> Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:463723|Bumping portals to master (T128546)]] (duration: 00m 59s) [production]
10:21 <godog> repair /dev/sdf1 /dev/sde1 on ms-be1041 - T199198 [production]
10:15 <Amir1> ladsgroup@mwmaint2001:~$ mwscript extensions/CentralAuth/maintenance/deleteLocalPasswords.php --prefix on all CentralAuth wikis (T201009) [production]
10:10 <Amir1> mwscript extensions/CentralAuth/maintenance/deleteLocalPasswords.php --wiki=fawiki --delete (T201009) [production]
09:33 <godog> test formatting sdh and sdi on ms-be2040 with crc=0 - T199198 [production]
09:15 <volans> Set Racktables in read-only mode - T199083 [production]
08:56 <_joe_> rolling restart of parsoid in codfw; afterwards, parsoid will connect to the MediaWiki API via HTTPS [production]
08:54 <_joe_> rolling restart of parsoid in eqiad [production]
07:54 <banyek> disabling puppet on labsdb1009, labsdb1010, labsdb1011 (T183983) [production]
07:54 <banyek> disabling puppet on labsdb1009, labsdb1010, labsdb1011 [production]
07:00 <mholloway-shell@deploy1001> Finished deploy [kartotherian/deploy@ab6cb74] (maps1004): Update kartotherian to latest (T205462) (duration: 00m 16s) [production]
06:59 <mholloway-shell@deploy1001> Started deploy [kartotherian/deploy@ab6cb74] (maps1004): Update kartotherian to latest (T205462) [production]
06:39 <mholloway-shell@deploy1001> Finished deploy [tilerator/deploy@22f90ee] (maps1004): Update tilerator to latest (T205462) (duration: 00m 19s) [production]
06:39 <mholloway-shell@deploy1001> Started deploy [tilerator/deploy@22f90ee] (maps1004): Update tilerator to latest (T205462) [production]
05:35 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1103:3312 (duration: 00m 56s) [production]
05:19 <marostegui> Stop replication on dbstore1002 and db1103:3312 in sync [production]
05:19 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1103:3312 (duration: 01m 01s) [production]
05:19 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@07cbfb4]: Update mobileapps to a1fa41b (duration: 03m 18s) [production]
05:15 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@07cbfb4]: Update mobileapps to a1fa41b [production]
05:07 <marostegui> Deploy schema change on s1 codfw msater - T203709 [production]
03:21 <onimisionipe> restarting inplace reindexing of enwiki and viwiki at codfw - T204362 [production]
2018-09-30 §
12:41 <ariel@deploy1001> Finished deploy [dumps/dumps@26aaee6]: make location of MWScript.php configurable (duration: 00m 03s) [production]
12:41 <ariel@deploy1001> Started deploy [dumps/dumps@26aaee6]: make location of MWScript.php configurable [production]
2018-09-29 §
13:01 <gtirloni> tools-mail cleaned frozen messages in exim queue [production]
01:13 <krinkle@deploy1001> Synchronized php-1.32.0-wmf.23/extensions/ORES/includes/ORESService.php: T205651 - I1beaeab732a31d (duration: 00m 59s) [production]
2018-09-28 §
20:57 <mutante> analytics1003 - unmounted and remounted /mnt/hdfs after Icinga alerts that it was not accessible - commands from https://wikitech.wikimedia.org/wiki/Analytics/Systems/Cluster/Hadoop/Administration#Fixing_HDFS_mount_at_/mnt/hdfs - like it happened before on stat1004 and others (T182342) [production]
19:18 <mutante> phab1001 (Phabricator), scheduled downtime, reboot for maintenance [production]
19:03 <mutante> phab2001 - scheduled downtime, rebooting for kernel [production]
16:25 <XioNoX> add HKBN BGP sessions to esams and eqsin [production]
16:05 <jynus> compressing tables at db1116:3317, stopping replication [production]
16:01 <Amir1> ladsgroup@mwmaint2001:~$ mwscript extensions/CentralAuth/maintenance/deleteLocalPasswords.php --wiki=fawiki --prefix (T201009) [production]
15:51 <Amir1> ladsgroup@mwmaint2001:~$ mwscript extensions/CentralAuth/maintenance/deleteLocalPasswords.php --delete on mediawiki.org and testwiki [production]
15:10 <XioNoX> activate Equinix peering sessions on cr4-ulsfo [production]
14:29 <jynus@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1086, db1104 (duration: 00m 55s) [production]
14:22 <banyek> converting dewiki.flaggedimages to TokuDB on host dbstrore1002 (T205544) [production]
13:27 <moritzm> rebooting tungsten for kernel security update [production]
13:15 <mobrovac@deploy1001> Finished deploy [restbase/deploy@7caf4d8]: Update metrics top endpoints, take #4 (duration: 06m 36s) [production]
13:09 <mobrovac@deploy1001> Started deploy [restbase/deploy@7caf4d8]: Update metrics top endpoints, take #4 [production]