251-300 of 10000 results (55ms)
2019-03-14 ยง
12:06 <arturo> T216497 drop some packages from jessie-wikimedia/openstack-mtiaka-jessie: libvirt*, librados2, librbd1, because they induce the resolver to conflict with those included in stretch [production]
12:02 <kartik@deploy1001> Synchronized wmf-config: SWAT: Revert [[gerrit:496412]] Fix content detection config (duration: 00m 56s) [production]
11:58 <kartik@deploy1001> scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) [production]
11:45 <kartik@deploy1001> Synchronized php-1.33.0-wmf.21/skins/MinervaNeue: SWAT: [[gerrit:496364|Ensure page-actions icons are `display:block` (T218182) (duration: 00m 57s) [production]
11:15 <kartik@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:493672]] Enable ExternalGuidance to all Wikipedias (T216129) (duration: 00m 57s) [production]
10:57 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Slowly repool db1081 (duration: 00m 57s) [production]
10:50 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp2002.codfw.wmnet,service=varnish-fe [production]
10:50 <ema@puppetmaster1001> conftool action : set/pooled=yes; selector: name=cp2002.codfw.wmnet,service=nginx [production]
10:50 <ema> cp2002: pool varnish-fe to resume ATS testing T213263 [production]
10:44 <moritzm> installing libsdl1.2 security updates for jessie [production]
10:21 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1081 (duration: 00m 58s) [production]
09:54 <hashar> ci: live hacked job https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-hhvm-docker/ in attempt to capture 'core' files from hhvm | https://gerrit.wikimedia.org/r/#/c/integration/config/+/496392/ | T216689 [production]
09:02 <mutante> ms-be2037 - down since a couple hours, no SAL or ticket, powercycling [production]
08:44 <marostegui> Deploy schema change on s4 codfw master (db2051), this will generate lag on codfw [production]
08:26 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1088 (duration: 00m 53s) [production]
08:21 <marostegui> Upgrade s3 codfw master (db2043) there will be lag on s3 codfw [production]
08:10 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1088 (duration: 00m 55s) [production]
07:54 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Slowly repool db1088 (duration: 00m 55s) [production]
07:48 <akosiaris@deploy1001> scap-helm cxserver finished [production]
07:48 <akosiaris@deploy1001> scap-helm cxserver cluster codfw completed [production]
07:48 <akosiaris@deploy1001> scap-helm cxserver upgrade -f cxserver-codfw-values.yaml production stable/cxserver [namespace: cxserver, clusters: codfw] [production]
07:42 <marostegui> Upgrade db1088 [production]
07:26 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1088 (duration: 00m 54s) [production]
07:22 <kartik@deploy1001> Finished deploy [cxserver/deploy@3ba57a5]: Update cxserver to b16f4a1 (T212577, T208386) (duration: 03m 50s) [production]
07:21 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Fully repool db1098 (duration: 00m 55s) [production]
07:18 <kartik@deploy1001> Started deploy [cxserver/deploy@3ba57a5]: Update cxserver to b16f4a1 (T212577, T208386) [production]
07:16 <akosiaris@deploy1001> scap-helm cxserver finished [production]
07:16 <akosiaris@deploy1001> scap-helm cxserver cluster codfw completed [production]
07:16 <akosiaris@deploy1001> scap-helm cxserver upgrade -f cxserver-codfw-values.yaml production stable/cxserver [namespace: cxserver, clusters: codfw] [production]
07:16 <akosiaris@deploy1001> scap-helm cxserver finished [production]
07:16 <akosiaris@deploy1001> scap-helm cxserver cluster eqiad completed [production]
07:16 <akosiaris@deploy1001> scap-helm cxserver upgrade -f cxserver-eqiad-values.yaml production stable/cxserver [namespace: cxserver, clusters: eqiad] [production]
07:16 <akosiaris@deploy1001> scap-helm cxserver finished [production]
07:15 <akosiaris@deploy1001> scap-helm cxserver cluster staging completed [production]
07:15 <akosiaris@deploy1001> scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging stable/cxserver [namespace: cxserver, clusters: staging] [production]
07:07 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1098 (duration: 00m 55s) [production]
06:52 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1098 (duration: 00m 54s) [production]
06:51 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1097 (duration: 00m 55s) [production]
06:50 <marostegui@deploy1001> sync-file aborted: More traffic to db1097 (duration: 00m 00s) [production]
06:46 <akosiaris@deploy1001> scap-helm cxserver finished [production]
06:46 <akosiaris@deploy1001> scap-helm cxserver cluster staging completed [production]
06:46 <akosiaris@deploy1001> scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging /home/akosiaris/deployment-charts/charts/cxserver/ [namespace: cxserver, clusters: staging] [production]
06:40 <marostegui> Upgrade mysql on dbstore2002 [production]
06:34 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: More traffic to db1098:3317 (duration: 00m 55s) [production]
06:21 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Slowly repool db1098:3317 (duration: 00m 55s) [production]
06:08 <kart_> Finished manual run of unpublished ContentTranslation draft purge script (T217818) [production]
06:04 <marostegui> Upgrade MySQL on db1098 [production]
06:04 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1098 (duration: 00m 56s) [production]
04:00 <kart_> Started manual run of unpublished ContentTranslation draft purge script (T217818) [production]
01:39 <ejegg> updated fundraising CiviCRM from 5c45e4c24d to b4e3cf16cc [production]