|
2018-05-28
§
|
| 12:55 |
<elukey> |
re-run webrequest-load-wf-misc-2018-5-28-10 |
[analytics] |
| 12:09 |
<arturo> |
T194665 aborrero@install1002:~$ sudo -i reprepro --noskipold -C 'thirdparty/mono-project-stretch' update stretch-wikimedia |
[production] |
| 12:09 |
<arturo> |
T194665 adding mono packages to apt.wikimedia.org for jessie-wikimedia and stretch-wikimedia |
[tools] |
| 12:08 |
<arturo> |
T194665 aborrero@install1002:~$ sudo -i reprepro --noskipold -C 'thirdparty/mono-project-jessie' update jessie-wikimedia |
[production] |
| 12:06 |
<arturo> |
T194665 adding mono packages to apt.wikimedia.org for trusty-wikimedia |
[tools] |
| 12:05 |
<arturo> |
aborrero@install1002:~$ sudo -i reprepro --noskipold -C 'thirdparty/mono-project-trusty' update trusty-wikimedia |
[production] |
| 11:31 |
<ema> |
cp1008: reboot with intel-microcode T127825 |
[production] |
| 11:27 |
<moritzm> |
upgrading API servers in codfw to hhvm-wikidiff 1.7.0 (HHVM bytecode cache needs to be pruned during rollout) |
[production] |
| 11:10 |
<marostegui> |
Stop MySQL on db2092 to copy its content to db2094 - T190704 |
[production] |
| 11:09 |
<hashar> |
Building Quibble Docker images 0.0.13 | T195634 |
[releng] |
| 11:01 |
<hashar> |
tagging quibble 0.0.13 hhvm server should set .svg Content-Type | T195634 |
[releng] |
| 10:36 |
<moritzm> |
upgrading mw1266-mw1275 to hhvm-wikidiff 1.7.0 (HHVM bytecode cache needs to be pruned during rollout) |
[production] |
| 10:14 |
<moritzm> |
upgrading eqiad video scalers to hhvm-wikidiff 1.7.0 |
[production] |
| 10:09 |
<jdrewniak@tin> |
Synchronized portals: Wikimedia Portals Update: [[gerrit:435759|Bumping portals to master (T128546)]] (duration: 01m 20s) |
[production] |
| 10:08 |
<jdrewniak@tin> |
Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:435759|Bumping portals to master (T128546)]] (duration: 01m 21s) |
[production] |
| 09:07 |
<moritzm> |
upgrading mw1299-mw1306 to hhvm-wikidiff 1.7.0 (HHVM bytecode cache needs to be pruned during rollout) |
[production] |
| 09:04 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1083 after alter table (duration: 01m 20s) |
[production] |
| 09:04 |
<marostegui> |
Deploy schema change on s1 primary master (db1052) - T191519 |
[production] |
| 09:00 |
<marostegui> |
Deploy schema change on db1052 (s1 primary master) - T190148 |
[production] |
| 08:27 |
<moritzm> |
upgrading mw1221-mw1235 to hhvm-wikidiff 1.7.0 (HHVM bytecode cache needs to be pruned during rollout) |
[production] |
| 07:40 |
<XioNoX> |
enable backup tunnel routing between cr2-ulsfo and cr1-eqdfw - T195584 |
[production] |
| 07:31 |
<marostegui> |
Deploy schema change on db1083 - T190148 T191519 T188299 |
[production] |
| 07:31 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1083 for alter table (duration: 01m 20s) |
[production] |
| 07:29 |
<moritzm> |
upgrading mw1238-mw1258 to hhvm-wikidiff 1.7.0 (HHVM bytecode cache needs to be pruned during rollout) |
[production] |
| 07:27 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1106 after alter table (duration: 01m 22s) |
[production] |
| 07:10 |
<moritzm> |
uploaded hhvm-wikidiff2 1.7.0 (source package name php-wikidiff2) to apt.wikimedia.org |
[production] |
| 06:44 |
<moritzm> |
installing ruby-loofah security updates |
[production] |
| 06:36 |
<elukey> |
reimage druid1003 to Debian Stretch (Analytics cluster, backend for Pivot/Turnilo) |
[production] |
| 05:50 |
<elukey> |
re-run webrequest-load-wf-misc-2018-5-27-22, webrequest-load-wf-text-2018-5-28-2, webrequest-load-wf-upload-2018-5-28-3 |
[analytics] |
| 05:25 |
<marostegui> |
Stop MySQL on db2075 to copy its content to db2095 - T190704 |
[production] |
| 05:23 |
<marostegui> |
Deploy schema change on db1106 with replication, this will generate lag on labs - T190148 T191519 T188299 |
[production] |
| 05:23 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1106 for alter table (duration: 01m 24s) |
[production] |
| 04:47 |
<legoktm> |
running modified version of hashar's gear_client.py on contint1001, feel free to kill if it causes problems |
[releng] |
| 03:14 |
<l10nupdate@tin> |
scap sync-l10n completed (1.32.0-wmf.4) (duration: 14m 30s) |
[production] |
|
2018-05-26
§
|
| 23:09 |
<Krinkle> |
Killed a bunch of stuck beta-mediawiki-config-update-eqiad jobs in Jenkins |
[releng] |
| 23:06 |
<Krinkle> |
beta-mediawiki-config-update-eqiad jobs have been stuck in Zuul for 17 hours |
[releng] |
| 21:47 |
<reedy@tin> |
Synchronized composer.json: (no justification provided) (duration: 01m 19s) |
[production] |
| 21:45 |
<reedy@tin> |
Synchronized multiversion/: multiversion (duration: 01m 21s) |
[production] |
| 21:42 |
<reedy@tin> |
Synchronized vendor/: canhasvendor (duration: 01m 46s) |
[production] |
| 19:01 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1101:3318 after alter table (duration: 01m 21s) |
[production] |
| 14:25 |
<marostegui> |
Add tmp1 index back on db1101:3318 - T194273 |
[production] |
| 14:25 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1101:3318 for alter table (duration: 01m 07s) |
[production] |
| 14:17 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1087 after alter table (duration: 01m 20s) |
[production] |
| 09:56 |
<marostegui> |
Add tmp1 index back on db1087 (sanitarium master), this will generate lag on labsdb hosts - T194273 |
[production] |
| 09:56 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1087 for alter table (duration: 01m 20s) |
[production] |