401-450 of 10000 results (66ms)
2019-07-22 ยง
16:48 <jforrester@deploy1001> Synchronized wmf-config/extension-list: Load Collection i18n via extension.json directly (duration: 00m 47s) [production]
16:36 <jeh> redirecting dumps.wikimedia.org dns to labstore1006 T224228 [production]
15:49 <jijiki> Rolling depool and pool of mw1293, mw1294, mw1295, mw1296, mw1299 - T219148 [production]
15:38 <marostegui> Stop mysql and power off pc2010 for on-site maintenance - T227552 [production]
15:35 <jforrester@deploy1001> Synchronized php-1.34.0-wmf.14/extensions/Wikibase/lib/WikibaseLib.php: T227814 Wikibase: Define $wgMessagesDirs in WikibaseLib PHP entry point (duration: 00m 48s) [production]
15:27 <jijiki> Depool mw1300 and pool back [production]
15:24 <jforrester@deploy1001> Synchronized php-1.34.0-wmf.14/includes/export/XmlDumpWriter.php: T228614 XmlDumpWriter: don't load revision text content unless requested to (duration: 00m 48s) [production]
15:17 <jijiki> Disable puppet on jobrunners to enable php7_only [production]
14:55 <otto@> helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-main' for release 'main' . [production]
14:53 <otto@> helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-main' for release 'main' . [production]
14:43 <otto@> helmfile [EQIAD] Ran 'apply' command on namespace 'eventgate-analytics' for release 'analytics' . [production]
14:38 <otto@> helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics' for release 'analytics' . [production]
14:30 <otto@> helmfile [CODFW] Ran 'apply' command on namespace 'eventgate-analytics' for release 'analytics' . [production]
14:30 <ottomata> deploying refactored eventgate chart using eventgate-wikimedia image to eventgate-* services - T226668 [production]
14:28 <liw@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.34.0-wmf.14 [production]
13:12 <kart_> Updated cxserver to 2019-07-17-074415-production (T227553, T216812) [production]
13:07 <kartik@deploy1001> scap-helm cxserver finished [production]
13:07 <kartik@deploy1001> scap-helm cxserver cluster eqiad completed [production]
13:07 <kartik@deploy1001> scap-helm cxserver upgrade -f cxserver-eqiad-values.yaml production stable/cxserver [namespace: cxserver, clusters: eqiad] [production]
13:02 <kartik@deploy1001> scap-helm cxserver finished [production]
13:02 <kartik@deploy1001> scap-helm cxserver cluster codfw completed [production]
13:02 <kartik@deploy1001> scap-helm cxserver upgrade -f cxserver-codfw-values.yaml production stable/cxserver [namespace: cxserver, clusters: codfw] [production]
13:00 <kartik@deploy1001> scap-helm cxserver finished [production]
13:00 <kartik@deploy1001> scap-helm cxserver cluster staging completed [production]
12:59 <kartik@deploy1001> scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging stable/cxserver [namespace: cxserver, clusters: staging] [production]
12:58 <marostegui> Stop MySQL on db1117:3321 to test dbproxy1014 (replacement for dbproxy1006) on m1 - T202367 [production]
12:22 <moritzm> installing debian-archive-keyring Stretch update (SUA 164) [production]
11:20 <awight@deploy1001> Synchronized wmf-config/InitialiseSettings.php: [[gerrit:524685|Enable wgNamespacesWithSubpages on main NS for kowikiversity (T228481)]] (duration: 00m 54s) [production]
11:14 <awight@deploy1001> Synchronized wmf-config/CommonSettings-labs.php: SWAT: [[gerrit:523661|Enable FileImporter source wiki edit and delete, (remove labs customizations) (T225617, T226532)]] (duration: 00m 54s) [production]
11:13 <awight@deploy1001> Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:523661|Enable FileImporter source wiki edit and delete (T225617, T226532)]] (duration: 00m 56s) [production]
10:55 <jijiki> Enable puppet on jobrunners [production]
10:27 <jijiki> Depool and pool mw1300 [production]
10:23 <jijiki> Disable puppet on jobrunners for 524336 - T219148 [production]
10:21 <root@> helmfile [STAGING] Ran 'apply' command on namespace 'kube-system' for release 'coredns' . [production]
10:20 <fsero> deploy coredns in staging T226516 [production]
09:47 <elukey> failover + restart of Hadoop HDFS namenode on an-master1001 to apply GC settings - T228620 [production]
09:40 <marostegui> Deploy grants on m1 to allow connections from dbproxy1014 - T202367 [production]
09:32 <elukey> restart hadoop hdfs namenode on an-master1002 to apply new GC settings - T228620 [production]
08:33 <marostegui> Rename table enwiki.math on db2116 T196055 [production]
07:56 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1134 after schema change T226851 (duration: 00m 51s) [production]
07:54 <elukey> sudo -i depool on elastic1046 - broken disk (srv partition not available) - T228606 [production]
07:40 <elukey> systemctl reset-failed restbase on restbase1007->15 (decommed nodes) [production]
07:27 <marostegui> Drop afl_log_id column from enwiki.abuse_filter_log on db1134 T226851 [production]
07:27 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1134 for schema change T226851 (duration: 00m 56s) [production]
07:17 <moritzm> installing openjdk-11 security updates [production]
06:47 <marostegui> Stop MySQL on db2062 to test dbproxy2001 notification T202367 [production]
06:23 <elukey> restart hadoop-hdfs-namenode on an-master1002 to verify if out-of-the-ordinary GC activity [production]
06:15 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Remove db1104 from s8 API (duration: 00m 55s) [production]
05:53 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1109 into API (duration: 00m 58s) [production]
05:24 <marostegui> Compress more tables on labsdb1009 - T222978 [production]