|
2019-03-14
§
|
| 11:58 |
<kartik@deploy1001> |
scap failed: average error rate on 3/11 canaries increased by 10x (rerun with --force to override this check, see https://logstash.wikimedia.org/goto/db09a36be5ed3e81155041f7d46ad040 for details) |
[production] |
| 11:45 |
<kartik@deploy1001> |
Synchronized php-1.33.0-wmf.21/skins/MinervaNeue: SWAT: [[gerrit:496364|Ensure page-actions icons are `display:block` (T218182) (duration: 00m 57s) |
[production] |
| 11:15 |
<kartik@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:493672]] Enable ExternalGuidance to all Wikipedias (T216129) (duration: 00m 57s) |
[production] |
| 10:57 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1081 (duration: 00m 57s) |
[production] |
| 10:50 |
<ema@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=cp2002.codfw.wmnet,service=varnish-fe |
[production] |
| 10:50 |
<ema@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=cp2002.codfw.wmnet,service=nginx |
[production] |
| 10:50 |
<ema> |
cp2002: pool varnish-fe to resume ATS testing T213263 |
[production] |
| 10:44 |
<moritzm> |
installing libsdl1.2 security updates for jessie |
[production] |
| 10:21 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1081 (duration: 00m 58s) |
[production] |
| 09:54 |
<hashar> |
ci: live hacked job https://integration.wikimedia.org/ci/job/quibble-vendor-mysql-hhvm-docker/ in attempt to capture 'core' files from hhvm | https://gerrit.wikimedia.org/r/#/c/integration/config/+/496392/ | T216689 |
[production] |
| 09:02 |
<mutante> |
ms-be2037 - down since a couple hours, no SAL or ticket, powercycling |
[production] |
| 08:44 |
<marostegui> |
Deploy schema change on s4 codfw master (db2051), this will generate lag on codfw |
[production] |
| 08:26 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1088 (duration: 00m 53s) |
[production] |
| 08:21 |
<marostegui> |
Upgrade s3 codfw master (db2043) there will be lag on s3 codfw |
[production] |
| 08:10 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: More traffic to db1088 (duration: 00m 55s) |
[production] |
| 07:54 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1088 (duration: 00m 55s) |
[production] |
| 07:48 |
<akosiaris@deploy1001> |
scap-helm cxserver finished |
[production] |
| 07:48 |
<akosiaris@deploy1001> |
scap-helm cxserver cluster codfw completed |
[production] |
| 07:48 |
<akosiaris@deploy1001> |
scap-helm cxserver upgrade -f cxserver-codfw-values.yaml production stable/cxserver [namespace: cxserver, clusters: codfw] |
[production] |
| 07:42 |
<marostegui> |
Upgrade db1088 |
[production] |
| 07:26 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1088 (duration: 00m 54s) |
[production] |
| 07:22 |
<kartik@deploy1001> |
Finished deploy [cxserver/deploy@3ba57a5]: Update cxserver to b16f4a1 (T212577, T208386) (duration: 03m 50s) |
[production] |
| 07:21 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Fully repool db1098 (duration: 00m 55s) |
[production] |
| 07:18 |
<kartik@deploy1001> |
Started deploy [cxserver/deploy@3ba57a5]: Update cxserver to b16f4a1 (T212577, T208386) |
[production] |
| 07:16 |
<akosiaris@deploy1001> |
scap-helm cxserver finished |
[production] |
| 07:16 |
<akosiaris@deploy1001> |
scap-helm cxserver cluster codfw completed |
[production] |
| 07:16 |
<akosiaris@deploy1001> |
scap-helm cxserver upgrade -f cxserver-codfw-values.yaml production stable/cxserver [namespace: cxserver, clusters: codfw] |
[production] |
| 07:16 |
<akosiaris@deploy1001> |
scap-helm cxserver finished |
[production] |
| 07:16 |
<akosiaris@deploy1001> |
scap-helm cxserver cluster eqiad completed |
[production] |
| 07:16 |
<akosiaris@deploy1001> |
scap-helm cxserver upgrade -f cxserver-eqiad-values.yaml production stable/cxserver [namespace: cxserver, clusters: eqiad] |
[production] |
| 07:16 |
<akosiaris@deploy1001> |
scap-helm cxserver finished |
[production] |
| 07:15 |
<akosiaris@deploy1001> |
scap-helm cxserver cluster staging completed |
[production] |
| 07:15 |
<akosiaris@deploy1001> |
scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging stable/cxserver [namespace: cxserver, clusters: staging] |
[production] |
| 07:07 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: More traffic to db1098 (duration: 00m 55s) |
[production] |
| 06:52 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: More traffic to db1098 (duration: 00m 54s) |
[production] |
| 06:51 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: More traffic to db1097 (duration: 00m 55s) |
[production] |
| 06:50 |
<marostegui@deploy1001> |
sync-file aborted: More traffic to db1097 (duration: 00m 00s) |
[production] |
| 06:46 |
<akosiaris@deploy1001> |
scap-helm cxserver finished |
[production] |
| 06:46 |
<akosiaris@deploy1001> |
scap-helm cxserver cluster staging completed |
[production] |
| 06:46 |
<akosiaris@deploy1001> |
scap-helm cxserver upgrade -f cxserver-staging-values.yaml staging /home/akosiaris/deployment-charts/charts/cxserver/ [namespace: cxserver, clusters: staging] |
[production] |
| 06:40 |
<marostegui> |
Upgrade mysql on dbstore2002 |
[production] |
| 06:34 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: More traffic to db1098:3317 (duration: 00m 55s) |
[production] |
| 06:21 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1098:3317 (duration: 00m 55s) |
[production] |
| 06:08 |
<kart_> |
Finished manual run of unpublished ContentTranslation draft purge script (T217818) |
[production] |
| 06:04 |
<marostegui> |
Upgrade MySQL on db1098 |
[production] |
| 06:04 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1098 (duration: 00m 56s) |
[production] |
| 04:00 |
<kart_> |
Started manual run of unpublished ContentTranslation draft purge script (T217818) |
[production] |
| 01:39 |
<ejegg> |
updated fundraising CiviCRM from 5c45e4c24d to b4e3cf16cc |
[production] |