|
2017-05-29
§
|
| 07:38 |
<marostegui> |
Stop MySQL on db1095 to take a backup - this will make labsdb1009,10 and 11 break replication while it is down - T153743 |
[production] |
| 07:01 |
<_joe_> |
reeanbling scap on mw2140, T166328 |
[production] |
| 06:45 |
<_joe_> |
restarting changeprop on scb1002, using 15 gigs of RAM |
[production] |
| 06:42 |
<marostegui> |
Deploy alter table s3 - dbstore2002 - T166278 |
[production] |
| 06:41 |
<marostegui> |
Deploy alter table s4 - dbstore1002 - T166206 |
[production] |
| 06:33 |
<_joe_> |
trying to restart pdfrender on scb1002 |
[production] |
| 06:32 |
<marostegui> |
Deploy alter table s3 - db2036 - T166278 |
[production] |
| 06:32 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2043, depool db2036 - T166278 (duration: 01m 44s) |
[production] |
| 06:29 |
<_joe_> |
powercycling mw1294 |
[production] |
| 06:11 |
<marostegui> |
Deploy alter table on s4 db1084 - T166206 |
[production] |
| 06:10 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1091, depool db1084 - T166206 (duration: 02m 45s) |
[production] |
| 06:01 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1091 - T166206 (duration: 03m 01s) |
[production] |
| 05:54 |
<marostegui> |
Restart MySQL on db1047 - T166452 |
[production] |
| 02:24 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.1) (duration: 08m 20s) |
[production] |
|
2017-05-26
§
|
| 14:29 |
<marostegui> |
Stop pt-table-checksum on s1 - T162807 |
[production] |
| 14:04 |
<marostegui> |
Deploy alter tabel on s3 revision table db2043 - T166278 |
[production] |
| 14:03 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2050, depool db2043 - T166278 (duration: 00m 41s) |
[production] |
| 13:57 |
<_joe_> |
consuming the backlog of htmlCacheUpdate jobs for enwiktionary |
[production] |
| 13:19 |
<gehel> |
restart wdqs-updater on all wdqs nodes - T166378 |
[production] |
| 12:55 |
<marostegui> |
Deploy alter table s4 on db1097 - T166206 |
[production] |
| 12:44 |
<elukey> |
Restart Hadoop daemons on analytics100[12] (Hadoop master nodes) for jvm upgrades |
[production] |
| 12:43 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1097 - T166206 (duration: 00m 41s) |
[production] |
| 10:56 |
<gehel> |
restart wdqs-updater on all wdqs nodes - T166378 |
[production] |
| 09:30 |
<volans> |
slowly testing if puppet stringify_facts=false is a noop across the fleet T166372 |
[production] |
| 08:45 |
<volans> |
killed daemonized puppet on tegmen, lvs1006 T166203 |
[production] |
| 06:38 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1097 - T166206 (duration: 00m 40s) |
[production] |
| 06:10 |
<marostegui> |
Deploy alter table on s3 - db2050 - T166278 |
[production] |
| 06:09 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Repool db2057, depool db2050 - T166278 (duration: 00m 56s) |
[production] |
| 06:05 |
<marostegui> |
Resume pt-table-checksum on s1 - T162807 |
[production] |
| 02:58 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Fri May 26 02:58:48 UTC 2017 (duration 6m 37s) |
[production] |
| 02:52 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.2) (duration: 07m 59s) |
[production] |
| 02:25 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.1) (duration: 08m 31s) |
[production] |
| 01:33 |
<bsitzmann@tin> |
Finished deploy [mobileapps/deploy@a8d0c91]: Update mobileapps to db6493c (duration: 03m 45s) |
[production] |
| 01:29 |
<bsitzmann@tin> |
Started deploy [mobileapps/deploy@a8d0c91]: Update mobileapps to db6493c |
[production] |
| 00:16 |
<thcipriani@tin> |
Finished scap: SWAT: [[gerrit:355660|Fix version of DonationInterface deployed to donatewiki]] T166302 (duration: 19m 44s) |
[production] |
|
2017-05-25
§
|
| 23:56 |
<thcipriani@tin> |
Started scap: SWAT: [[gerrit:355660|Fix version of DonationInterface deployed to donatewiki]] T166302 |
[production] |
| 23:44 |
<thcipriani@tin> |
Synchronized php-1.30.0-wmf.2/resources/src/jquery/jquery.makeCollapsible.js: SWAT: [[gerrit:355721|jquery.makeCollapsible: Restore considering empty <a> as part of toggle]] T166298 (duration: 00m 42s) |
[production] |
| 23:20 |
<thcipriani@tin> |
Synchronized wmf-config/CommonSettings.php: SWAT: [[gerrit:355722|Revert "Revert "Add Code of Conduct footer links to wikitech and mw.o""]] PART II (duration: 00m 41s) |
[production] |
| 23:19 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:355722|Revert "Revert "Add Code of Conduct footer links to wikitech and mw.o""]] PART I (duration: 00m 43s) |
[production] |
| 22:58 |
<thcipriani> |
mw1170 wikipedias back to 1.30.0-wmf.1 |
[production] |
| 22:26 |
<thcipriani> |
mw1170 running wmf.2 for all wikis for troubleshooting T166345 |
[production] |
| 22:24 |
<thcipriani> |
mw1161 wikipedias back to running running wmf.1 |
[production] |
| 22:20 |
<thcipriani> |
mw1161 running wmf.2 for all wikis for troubleshooting T166345 |
[production] |
| 22:17 |
<papaul> |
ores200[1-9] - signing puppet certs, salt-key, initial run |
[production] |
| 21:43 |
<papaul> |
OS install on ores200[1-9] |
[production] |