|
2018-09-04
ยง
|
| 19:26 |
<gehel> |
rolling restart of elasticsearch / cirrus / eqiad for various updates and data directory migration completed - T198351 |
[production] |
| 18:38 |
<XioNoX> |
change internal NAT for 208.80.155.12 - T203475 |
[production] |
| 18:02 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1078 (duration: 00m 57s) |
[production] |
| 16:31 |
<elukey> |
reboot aqs1004 again for kernel + openjdk-8 upgrades (now available since the root partition is not read only anymore) |
[production] |
| 16:26 |
<thcipriani@deploy1001> |
Synchronized README: noop sync file - test scap 3.8.5-1 (duration: 00m 54s) |
[production] |
| 16:24 |
<thcipriani@deploy1001> |
rebuilt and synchronized wikiversions files: noop wikiversions sync for T198640 |
[production] |
| 16:21 |
<godog> |
upload scap 3.8.5-1 - T203271 |
[production] |
| 16:18 |
<fdans@deploy1001> |
Finished deploy [analytics/refinery@2c4ec7a]: deploying refinery to update pageview def (duration: 09m 57s) |
[production] |
| 16:08 |
<fdans@deploy1001> |
Started deploy [analytics/refinery@2c4ec7a]: deploying refinery to update pageview def |
[production] |
| 15:30 |
<elukey> |
reboot aqs1004 after running fsck on root (was read-only) |
[production] |
| 15:13 |
<papaul> |
shutting down backup2001 to disable 1GB NIC |
[production] |
| 15:08 |
<marostegui> |
Deploy schema change on db1078 |
[production] |
| 15:07 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1078 (duration: 00m 56s) |
[production] |
| 15:02 |
<marostegui> |
Deploy schema change on db1095:3313 |
[production] |
| 15:02 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1123 (duration: 00m 57s) |
[production] |
| 14:45 |
<addshore@deploy1001> |
Synchronized php-1.32.0-wmf.20/extensions/Wikibase: [[gerrit:457912|Track new ItemId formatter usages]] (duration: 01m 17s) |
[production] |
| 14:14 |
<bstorm_> |
Removing subtree_check from project nfs on labstore1004/5 |
[production] |
| 14:01 |
<jynus> |
stopping replication and running partitioning on logging on db1088:3311 T189107 |
[production] |
| 14:00 |
<hashar@deploy1001> |
rebuilt and synchronized wikiversions files: group0 to 1.32.0-wmf.20 |
[production] |
| 13:45 |
<hashar@deploy1001> |
Finished scap: testwiki to php-1.32.0-wmf.20 and rebuild l10n cache - T191066 (duration: 62m 55s) |
[production] |
| 13:07 |
<hashar> |
1.32.0-wmf.20 is still syncing for testwiki due to l10ncache generation |
[production] |
| 13:06 |
<elukey> |
restart memcached on mc1035 with -v option - T203429 |
[production] |
| 12:57 |
<moritzm> |
reimaging backup2001 |
[production] |
| 12:43 |
<hashar@deploy1001> |
Started scap: testwiki to php-1.32.0-wmf.20 and rebuild l10n cache - T191066 |
[production] |
| 12:42 |
<hashar@deploy1001> |
Pruned MediaWiki: 1.32.0-wmf.18 [keeping static files] (duration: 06m 58s) |
[production] |
| 12:35 |
<hashar> |
scap clean 1.32.0-wmf.18 | T191066 |
[production] |
| 12:32 |
<hashar> |
Applied security patches for 1.32.0-wmf.20 | T191066 |
[production] |
| 12:24 |
<hashar> |
scap prep 1.32.0-wmf.20 # T191066 |
[production] |
| 12:07 |
<marostegui> |
Deploy schema change on db1123 |
[production] |
| 12:07 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1123 (duration: 00m 48s) |
[production] |
| 11:58 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1090:3317 (duration: 00m 48s) |
[production] |
| 11:50 |
<hashar> |
Cutting branch 1.32.0-wmf.20 | T191066 |
[production] |
| 11:46 |
<hashar> |
Preparing train deploy 1.32.0-wmf.20 | T191066 |
[production] |
| 11:35 |
<hashar> |
European SWAT completed |
[production] |
| 11:34 |
<hashar@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Wikidata: Use new item ID formatter for Q1-Q100000 - T201835 (duration: 00m 49s) |
[production] |
| 11:19 |
<hashar@deploy1001> |
Synchronized php-1.32.0-wmf.19/extensions/DismissableSiteNotice: Revert "Use session storage instead of cookies for site notices" - T199274 (duration: 00m 50s) |
[production] |
| 11:11 |
<jynus> |
stopping replication and running partitioning on logging on db1085:3311 T189107 |
[production] |
| 11:10 |
<hashar@deploy1001> |
Synchronized static/images/project-logos: Update logos for the Russian Wikisource - T203343 (duration: 00m 49s) |
[production] |
| 11:06 |
<hashar@deploy1001> |
Synchronized wmf-config/throttle.php: Two throttle rules for SMEX editathon - T203392 (duration: 00m 51s) |
[production] |
| 11:05 |
<hashar@deploy1001> |
sync-file aborted: (no justification provided) (duration: 00m 01s) |
[production] |
| 10:29 |
<marostegui> |
Deploy schema change on dbstore1002:s3 |
[production] |
| 10:23 |
<marostegui> |
Deploy schema change on s3 codfw masters (this will generate lag on s3 codfw) |
[production] |
| 10:17 |
<elukey> |
restart ircecho on einstenium to force it re-join #wikimedia-analytics |
[production] |
| 09:57 |
<_joe_> |
restarted pdfrender on scb1001 |
[production] |
| 09:40 |
<jynus> |
deploying latest event schedulers to all core db hosts |
[production] |
| 09:32 |
<elukey> |
restart ircecho as attempt to see if icinga-vm re-joins the analytics chan |
[production] |
| 09:24 |
<jynus> |
stop, upgrade and running analyze on db1114 |
[production] |
| 09:23 |
<marostegui> |
Deploy schema change on db1090:3317 |
[production] |
| 09:23 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1090:3317 (duration: 00m 49s) |
[production] |
| 09:12 |
<akosiaris> |
depool pdfrender in eqiad, hopefully codfw will be better equipped to handle the load |
[production] |