2015-11-17
§
|
15:30 |
<mobrovac> |
restbase end deploy of e749f6ff |
[production] |
15:20 |
<mobrovac> |
restbase start deploy of e749f6ff |
[production] |
14:59 |
<bblack> |
stopping pybal on lvs300[12], fallback to lvs300[34] (pybal 1.10 vs 1.12) |
[production] |
14:55 |
<godog> |
swift eqiad-prod: set ms-be1019 / ms-be1020 / ms-be1021 weight 1500 |
[production] |
14:51 |
<bblack> |
stopping pybal on lvs200[123], fallback to lvs200[456] (pybal 1.10 vs 1.12) |
[production] |
14:37 |
<bblack> |
stopping pybal on lvs400[12], fallback to lvs400[34] (pybal 1.10 vs 1.12) |
[production] |
12:32 |
<akosiaris> |
depool restbase1002 |
[production] |
09:54 |
<godog> |
nodetool decommission on restbase2002 |
[production] |
06:18 |
<gwicke> |
restbase cassandra: Increased tombstone_threshold from 0.02 to 0.1 for wikipedia and wikimedia html and data-parsoid to reduce single-sstable compaction rate. |
[production] |
02:21 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.6/cache/l10n: l10nupdate for 1.27.0-wmf.6 (duration: 06m 26s) |
[production] |
00:21 |
<krinkle@tin> |
Synchronized wmf-config/jobqueue-codfw.php: (no message) (duration: 00m 26s) |
[production] |
00:16 |
<legoktm@tin> |
Synchronized wmf-config/CommonSettings.php: REL1_26 knocks on the door - https://gerrit.wikimedia.org/r/#/c/252399/ (duration: 00m 27s) |
[production] |
2015-11-16
§
|
22:47 |
<hoo@tin> |
Synchronized php-1.27.0-wmf.6/includes/Revision.php: Don't claim model validation failed if the content couldn't be loaded (duration: 00m 26s) |
[production] |
22:45 |
<gwicke> |
rolling restbase restart to apply https://gerrit.wikimedia.org/r/#/c/253468/ |
[production] |
21:52 |
<reedy@tin> |
Synchronized wmf-config/CommonSettings.php: Don't log sysops with short passwords (duration: 00m 27s) |
[production] |
21:47 |
<mobrovac> |
restbase end deployment of 54bc0517 |
[production] |
21:38 |
<mobrovac> |
restbase start deployment of 54bc0517 |
[production] |
21:26 |
<reedy@tin> |
Synchronized wmf-config/CommonSettings.php: Log username of users with short passwords (duration: 00m 26s) |
[production] |
21:23 |
<subbu> |
finished deploying parsoid 3a6f3b9e |
[production] |
21:21 |
<mobrovac> |
restbase canary deploy to restbase1001 of 54bc0517 |
[production] |
21:07 |
<subbu> |
synced fresh code; restarting parsoid on wtp1005 as a canary |
[production] |
21:06 |
<reedy@tin> |
Synchronized wmf-config/CommonSettings.php: Log privileged users with short passwords. Set minimum password length of 10 for wikitech. (duration: 00m 26s) |
[production] |
21:03 |
<subbu> |
starting parsoid deploy |
[production] |
19:52 |
<anomie> |
Running cleanupBlocks.php on arwiki, eswikibooks, eswikinews, and testwiki for [[phab:T118625]] |
[production] |
19:23 |
<RoanKattouw> |
Deployed patch for T116095 |
[production] |
16:14 |
<thcipriani@tin> |
Synchronized wmf-config/squid.php: SWAT: wgHTCPRouting: use separate address for upload [[gerrit:249121]] (duration: 00m 26s) |
[production] |
16:07 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: Disable first QuickSurveys survey [[gerrit:253038]] (duration: 00m 26s) |
[production] |
14:40 |
<godog> |
carbon daemon bounce on graphite1001 |
[production] |
13:43 |
<bblack> |
reinstalling lvs100[45] |
[production] |
13:39 |
<jynus> |
dropping ipblocks_old table from all wikis |
[production] |
13:19 |
<bblack> |
reinstalling lvs1006 |
[production] |
11:21 |
<jynus> |
defragementing, upgrading, general maintenance to mysql at db1027. Expect lag, etc. (it is depooled) |
[production] |
10:24 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1015, depool db1027 for maintenance (duration: 00m 49s) |
[production] |
10:03 |
<jynus> |
performing schema change on wikishared.bounce_records (x1) |
[production] |
09:39 |
<godog> |
bootstrap restbase2001-c cassandra instance |
[production] |
09:34 |
<jynus> |
adding missing tables to vewikimedia https://phabricator.wikimedia.org/rMW7389d7c69035c968553fbd2eaf1cf47038c4577c |
[production] |
09:19 |
<_joe_> |
reimaging terbium |
[production] |
09:16 |
<godog> |
swift eqiad-prod: add ms-be1019 / ms-be1020 / ms-be1021 weight 500 |
[production] |
08:56 |
<_joe_> |
rsyncing files from terbium to rutherfordium |
[production] |
08:10 |
<akosiaris> |
powered off plutonium, removed it from puppet and salt. context: https://phabricator.wikimedia.org/T118586 |
[production] |
02:22 |
<l10nupdate@tin> |
Synchronized php-1.27.0-wmf.6/cache/l10n: l10nupdate for 1.27.0-wmf.6 (duration: 06m 29s) |
[production] |
2015-11-15
§
|
18:03 |
<jynus> |
disabling puppet, restarting mysql on es2008, es2009, es2010 for configuration check/upgrade |
[production] |
16:41 |
<jynus> |
stopping eventlogging_sync for manual resync on dbstore1002 and db1047 |
[production] |
15:33 |
<reedy@tin> |
Synchronized wmf-config/: noop after chmod (duration: 00m 27s) |
[production] |
14:31 |
<reedy@tin> |
Synchronized wmf-config/InitialiseSettings.php: revert last, no file created on fluorine (duration: 00m 27s) |
[production] |
14:28 |
<reedy@tin> |
Synchronized wmf-config/InitialiseSettings.php: Temporarily enable error log. Will revert in a few minutes (duration: 00m 27s) |
[production] |
14:19 |
<reedy@tin> |
Synchronized php-1.27.0-wmf.6/extensions/BounceHandler/: Pull in a few fixes and improvements for BounceHandler (duration: 01m 12s) |
[production] |
12:16 |
<jynus> |
restarting mysql at db1015 to finish upgrade/maintenance process |
[production] |
12:10 |
<jynus> |
uploading upgraded mariadb package for trusty, too |
[production] |
09:02 |
<_joe_> |
rebooting krypton |
[production] |