|
2018-07-19
§
|
| 08:08 |
<elukey> |
restart eventstreams on scb2* hosts to pick up new Kafka settings (pointing it to main-codfw) - T199813 |
[production] |
| 08:04 |
<kartik@deploy1001> |
Finished deploy [cxserver/deploy@fe0d521]: Update cxserver to 92e3d2e (T199380, T199885) (duration: 03m 58s) |
[production] |
| 08:00 |
<kartik@deploy1001> |
Started deploy [cxserver/deploy@fe0d521]: Update cxserver to 92e3d2e (T199380, T199885) |
[production] |
| 07:58 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3314 after MySQL upgrade (duration: 00m 54s) |
[production] |
| 07:54 |
<marostegui> |
Deploy schema change on s2 codfw masters (db2035) this will generate lag on s2 codfw T144010 T51190 T199368 |
[production] |
| 07:50 |
<jynus> |
stop es1019 and reimage it |
[production] |
| 07:48 |
<jynus@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool es1019 (duration: 00m 54s) |
[production] |
| 07:43 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3312 after MySQL upgrade (duration: 00m 55s) |
[production] |
| 07:26 |
<moritzm> |
removing cdrom and sr_mod (related module) kernel modules across the fleet (following the blacklisting of the kernel module via puppet) |
[production] |
| 06:00 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3312 after MySQL upgrade (duration: 00m 54s) |
[production] |
| 05:44 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Increase weight for db1103:3312 after MySQL upgrade (duration: 00m 55s) |
[production] |
| 05:30 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1103:3312 after MySQL upgrade (duration: 00m 54s) |
[production] |
| 05:14 |
<marostegui> |
Stop MySQL on db1103 to upgrade MySQL |
[production] |
| 05:11 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1103:3312 for MySQL upgrade (duration: 00m 56s) |
[production] |
| 04:12 |
<kart_> |
Finished ContentTranslation draft purge script on mwmaint1001 (T199658) |
[production] |
| 04:05 |
<kart_> |
Starting ContentTranslation draft purge script on mwmaint1001, dry run first and then --really |
[production] |
| 03:57 |
<krinkle@deploy1001> |
Synchronized wmf-config/CommonSettings.php: I978f3eda8 - Farewell temporary hack from 2013 (duration: 00m 56s) |
[production] |
| 03:20 |
<ejegg> |
updated CiviCRM from b21d783e7f to 6f311f48d9 |
[production] |
| 03:09 |
<l10nupdate@deploy1001> |
ResourceLoader cache refresh completed at Thu Jul 19 03:09:19 UTC 2018 (duration 10m 35s) |
[production] |
| 02:58 |
<l10nupdate@deploy1001> |
scap sync-l10n completed (1.32.0-wmf.13) (duration: 15m 05s) |
[production] |
| 02:24 |
<l10nupdate@deploy1001> |
scap sync-l10n completed (1.32.0-wmf.12) (duration: 10m 41s) |
[production] |
|
2018-07-18
§
|
| 23:35 |
<thcipriani@deploy1001> |
Synchronized php-1.32.0-wmf.13/includes/logging/LogEventsList.php: SWAT: [[gerrit:446635|LogEventsList: Use GET in HTMLForm]] T199856 (duration: 00m 54s) |
[production] |
| 23:33 |
<thcipriani@deploy1001> |
Synchronized php-1.32.0-wmf.13/extensions/VisualEditor/modules/ve-mw/ui/dialogs/ve.ui.MWMediaDialog.js: SWAT: [[gerrit:446529|ve.ui.MWMediaDialog: Fix confusion between #getSetupProcess and #getReadyProcess]] T185944 T199841 (duration: 00m 56s) |
[production] |
| 22:16 |
<ejegg> |
updated SmashPig payments listener from 2b4186715e to 2736e41045 |
[production] |
| 19:24 |
<reedy@deploy1001> |
Synchronized wmf-config/CommonSettings.php: Unset wgVipsThumbnailHost T199937 (duration: 00m 55s) |
[production] |
| 16:28 |
<catrope@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Enable new backend for Special:Tags on fawikisource (T199334) (duration: 00m 54s) |
[production] |
| 16:14 |
<catrope@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Enable ORES on testwiki (T199913) (duration: 00m 55s) |
[production] |
| 15:25 |
<volans> |
installing conftool 1.0.1 on jessie and stretch |
[production] |
| 14:50 |
<mobrovac@deploy1001> |
Finished deploy [eventstreams/deploy@09f0efe]: Set the maximum rdkafka receive buffer size to 64MB - T199813 (duration: 02m 28s) |
[production] |
| 14:48 |
<mobrovac@deploy1001> |
Started deploy [eventstreams/deploy@09f0efe]: Set the maximum rdkafka receive buffer size to 64MB - T199813 |
[production] |
| 14:47 |
<marostegui> |
Partition commonswiki.logging table on db1103:3314 - T199790 |
[production] |
| 14:46 |
<volans@sarin> |
conftool action : set/pooled=yes; selector: name=mw2224.codfw.wmnet |
[production] |
| 14:43 |
<volans> |
uploaded conftool (with python-conftool and python3-conftool) version 1.0.1 for jessie and stretch to apt.w.o |
[production] |
| 14:42 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1103:3314 for alter table - T199790 (duration: 00m 52s) |
[production] |
| 14:37 |
<moritzm> |
rebooting poolcounter2001 for some tests |
[production] |
| 14:22 |
<moritzm> |
rebooting vega for some tests |
[production] |
| 13:59 |
<anomie@deploy1001> |
Synchronized wmf-config/InitialiseSettings-labs.php: Sync labs config file, no prod impact (duration: 00m 54s) |
[production] |
| 13:53 |
<moritzm> |
installing ruby2.1 security updates for jessie |
[production] |
| 13:17 |
<marostegui> |
Deploy schema change on db1052 - T187089 |
[production] |
| 13:13 |
<zfilipin@deploy1001> |
Synchronized php: group1 wikis to 1.32.0-wmf.13 (duration: 00m 53s) |
[production] |
| 13:13 |
<zfilipin@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.32.0-wmf.13 |
[production] |
| 12:58 |
<marostegui> |
Stop MySQL on db1052 to upgrade socket and MySQL |
[production] |
| 12:57 |
<elukey> |
restart eventstreams on scb200[5,6] as precautionary after mem consumption too high |
[production] |
| 12:57 |
<elukey> |
restart eventstreams on scb2003 as precautionary after mem consumption too high |
[production] |
| 12:56 |
<elukey> |
restart eventstreams on scb2001 as precautionary after mem consumption too high (still investigating a fix) |
[production] |
| 12:54 |
<dcausse> |
T156137: unbanning elastic1030 |
[production] |
| 12:52 |
<dcausse> |
T156137: restarting elastic1030 to disable G1GC |
[production] |
| 12:51 |
<moritzm> |
installing PHP5 security updates (remaining hosts which only use -cli) |
[production] |
| 12:48 |
<moritzm> |
installing PHP security updates on tungsten |
[production] |
| 12:36 |
<moritzm> |
installing PHP security updates on icinga.wikimedia.org |
[production] |