2018-04-04
§
|
11:13 |
<akosiaris> |
upgrade apertium on all scb hosts. Rolling update with in groups of 2 hosts with a 30 seconds delay |
[production] |
11:06 |
<marostegui> |
Stop MySQL on db2057 for binlog format change, mariadb and kernel upgrade |
[production] |
11:02 |
<akosiaris> |
upgrade apertium on scb1001 |
[production] |
09:46 |
<marostegui> |
Deploy schema change on s1 codfw master db2048 (this will generate lag on codfw) - T187089 T185128 T153182 |
[production] |
09:30 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Restore original weight for db1077 (duration: 01m 16s) |
[production] |
09:25 |
<Amir1> |
end of the deleteAutoPatrolLogs.php script on mediawikiwiki (T184485) |
[production] |
09:24 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: db2041 is now a candidate master for s2 - T191275 (duration: 01m 16s) |
[production] |
09:16 |
<elukey> |
executed systemctl reset-failed kafka-mirror-main-eqiad_to_jumbo-eqiad.service on kafka1020 |
[production] |
09:02 |
<Amir1> |
start of mwscript deleteAutoPatrolLogs.php --wiki=mediawikiwiki--before 20180223210426 --sleep 2 (T184485) |
[production] |
09:02 |
<marostegui> |
Stop MySQL on db2041 for binlog format change and kernel upgrade |
[production] |
09:01 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2041 (duration: 01m 17s) |
[production] |
08:46 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Restore original weight for db1072 (duration: 01m 17s) |
[production] |
08:19 |
<Amir1> |
start of ladsgroup@terbium:~$ mwscript deleteAutoPatrolLogs.php --wiki=mediawikiwiki --check-old --before 20160423210426 (T184485) |
[production] |
08:17 |
<Amir1> |
start of ladsgroup@terbium:~$ mwscript deleteAutoPatrolLogs.php --wiki=mediawikiwiki --dry-run --check-old --before 20160423210426 |
[production] |
08:08 |
<marostegui> |
Deploy schema change on s3 primary master (db1075) - T153182 T185128 |
[production] |
08:05 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1072 (duration: 01m 17s) |
[production] |
07:59 |
<godog> |
depool ms-fe2005 to test rewrite.py - T183902 |
[production] |
07:53 |
<marostegui> |
Drop flaggedrevs from s3 mediawikiwiki - T186865 |
[production] |
07:37 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: db2055 is now a candidate master - T191275 (duration: 01m 16s) |
[production] |
07:37 |
<moritzm> |
running some apache/stretch tests on mw2261 |
[production] |
07:36 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Depool db2083 - T188279 (duration: 01m 17s) |
[production] |
07:30 |
<ema> |
finish up cache@eqiad reboots for retpoline kernel updates T188092 |
[production] |
07:26 |
<marostegui> |
Restart MySQL on db2055 to change its binlog to STATEMENT - T191275 |
[production] |
05:59 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db2083 - T188279 (duration: 01m 17s) |
[production] |
05:48 |
<marostegui> |
Deploy schema change on db1072 - s3 - with replication. This will generate lag on labs T187089 T185128 T153182 |
[production] |
05:43 |
<marostegui> |
Drop click_tracking_events table from where it still exists - T115982 |
[production] |
05:21 |
<marostegui> |
Stop mariadb for upgrade and kernel upgrade on db1072 - this will generate lag on s3 labs |
[production] |
05:19 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1072 for alter table, kernel and mariadb upgrade (duration: 01m 17s) |
[production] |
02:32 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.27) (duration: 05m 31s) |
[production] |
01:02 |
<eileen> |
update civicrm - civicrm revision changed from d6855cd281 to 7010f0f5d6, config revision is 3b900436c9 |
[production] |
2018-04-03
§
|
23:55 |
<XioNoX> |
re-activating graceful-switchover on cr1-codfw - T189588 |
[production] |
23:16 |
<dereckson@tin> |
Synchronized wmf-config/CommonSettings.php: Make a note about the loading order of GlobalPreferences and Echo ([[Gerrit:422642]]) (no-op) (duration: 01m 17s) |
[production] |
23:10 |
<dereckson@tin> |
Synchronized wmf-config/InitialiseSettings.php: Rollout VirtualPageViews (final stage) (T189906) (duration: 01m 19s) |
[production] |
22:34 |
<mutante> |
cobalt - puppet disabled temporarily to apply fix to "simplify directory structure" change .. on gerrit2001 first |
[production] |
22:25 |
<mutante> |
restarting Apache on phab1001 - T182832 |
[production] |
22:14 |
<twentyafterfour> |
Finished MediaWiki Train for group0, 1.31.0-wmf.28 refs T183967 |
[production] |
22:12 |
<twentyafterfour@tin> |
Pruned MediaWiki: 1.31.0-wmf.25 [keeping static files] (duration: 01m 55s) |
[production] |
22:10 |
<twentyafterfour@tin> |
Pruned MediaWiki: 1.31.0-wmf.24 [keeping static files] (duration: 04m 18s) |
[production] |
21:30 |
<twentyafterfour@tin> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.31.0-wmf.28 refs T183967 |
[production] |
21:15 |
<twentyafterfour@tin> |
Finished scap: testwikis wikis to 1.31.0-wmf.28 refs T183967 (duration: 46m 38s) |
[production] |
21:13 |
<urandom> |
(re)starting restbase-dev1004-{a,b} (ooms), and enabling alternately patched cassandra 3.11.2 build - T186751 |
[production] |
20:28 |
<twentyafterfour@tin> |
Started scap: testwikis wikis to 1.31.0-wmf.28 refs T183967 |
[production] |
20:22 |
<ejegg> |
disabled thank you mail sender |
[production] |
19:46 |
<urandom> |
restarting restbase-dev1004-{a,b} to enable patched cassandra 3.11.2 build - T186751 |
[production] |
19:07 |
<twentyafterfour> |
Preparing to deploy 1.31.0-wmf.28 refs T183967 |
[production] |
18:25 |
<urandom> |
upgrading restbase-dev1006-b to cassandra 3.11.2 - T186751 |
[production] |
18:23 |
<urandom> |
upgrading restbase-dev1006-a to cassandra 3.11.2 - T186751 |
[production] |
18:20 |
<urandom> |
upgrading restbase-dev1005-b to cassandra 3.11.2 - T186751 |
[production] |
18:18 |
<urandom> |
upgrading restbase-dev1005-a to cassandra 3.11.2 - T186751 |
[production] |
18:15 |
<urandom> |
upgrading restbase-dev1004-b to cassandra 3.11.2 - T186751 |
[production] |