|
2017-11-02
§
|
| 11:21 |
<mobrovac@tin> |
Started deploy [restbase/deploy@f6c4e2d]: Parsoid module: use the Cassandra 2 tables as fallback when needed - T179417 |
[production] |
| 10:54 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=inactive; selector: name=logstash1003.eqiad.wmnet |
[production] |
| 10:53 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=inactive; selector: name=logstash1002.eqiad.wmnet |
[production] |
| 10:53 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=inactive; selector: name=logstash1001.eqiad.wmnet |
[production] |
| 10:53 |
<gehel> |
depooling logstash100[123] in preparation for decommission - T175830 |
[production] |
| 10:38 |
<gehel> |
rolling restart of wdqs nodes for GC tuning - T175919 |
[production] |
| 10:13 |
<marostegui> |
Deploy alter table on db2019 - T174569 |
[production] |
| 09:41 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Restore db1091 original weight - T161088 (duration: 00m 50s) |
[production] |
| 09:06 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase db1091 weight after maintenance - T161088 (duration: 00m 50s) |
[production] |
| 08:46 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase db1091 weight after maintenance - T161088 (duration: 00m 50s) |
[production] |
| 08:28 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1091 with low weight after maintenance - T161088 (duration: 00m 50s) |
[production] |
| 08:15 |
<moritzm> |
restarting app server canaries to pick up curl security update |
[production] |
| 08:04 |
<moritzm> |
installing curl security updates |
[production] |
| 07:59 |
<marostegui> |
Stop mysql event scheduler on labsdb1001 - T179464 |
[production] |
| 06:54 |
<marostegui> |
Stop s3 instance on db2092 to copy it to db2085 - T178359 |
[production] |
| 06:33 |
<legoktm> |
done on mwdebug1002 |
[production] |
| 06:31 |
<marostegui> |
Stop MySQL on db1091 and db1103 to migrate db1091 to file per table |
[production] |
| 06:30 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1091 - T161088 (duration: 01m 07s) |
[production] |
| 06:27 |
<marostegui> |
Deploy optimize table wikidatawiki.pagelinks on s5 master (db1063) - T174509 |
[production] |
| 06:02 |
<legoktm> |
live-hacking mwdebug1002 |
[production] |
| 05:43 |
<TimStarling> |
on puppetmaster2001: disk full due to logs, so I'm truncating /var/log/debug which is apparently copied to daemon.log anyway |
[production] |
| 03:29 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Nov 2 03:29:35 UTC 2017 (duration 7m 12s) |
[production] |
| 03:22 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.6) (duration: 15m 37s) |
[production] |
| 02:43 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.5) (duration: 16m 06s) |
[production] |
| 00:52 |
<ebernhardson@tin> |
Synchronized php-1.31.0-wmf.5/extensions/WikimediaEvents/extension.json: SWAT followup: Update SearchSatisfaction eventlogging schema revision id (duration: 00m 50s) |
[production] |
| 00:51 |
<ebernhardson@tin> |
Synchronized php-1.31.0-wmf.6/extensions/WikimediaEvents/extension.json: (no justification provided) (duration: 00m 50s) |
[production] |
| 00:32 |
<bblack> |
cp4022 - varnish backend restart, mailbox |
[production] |
| 00:28 |
<bblack> |
lvs1001-3: re-enable ethernet flowcontrol (short ethernet blip), with pybal stopped to failover to backups during... |
[production] |
|
2017-11-01
§
|
| 23:37 |
<thcipriani@tin> |
Synchronized php-1.31.0-wmf.5/extensions/WikimediaEvents: SWAT: [[gerrit:387956|Turn on Cirrus AB test for DBN group sizing]] (duration: 00m 50s) |
[production] |
| 23:35 |
<thcipriani@tin> |
Synchronized php-1.31.0-wmf.6/extensions/WikimediaEvents: SWAT: [[gerrit:387957|Turn on Cirrus AB test for DBN group sizing]] (duration: 00m 51s) |
[production] |
| 23:29 |
<thcipriani@tin> |
Synchronized php-1.31.0-wmf.6/extensions/ParserMigration/includes/ApiParserMigration.php: SWAT: [[gerrit:387954|API: Fix WikiPage namespace]] (duration: 00m 52s) |
[production] |
| 23:25 |
<thcipriani@tin> |
Synchronized php-1.31.0-wmf.6/extensions/Wikibase/repo/Wikibase.hooks.php: SWAT: [[gerrit:387662|Allow turning Cirrus usage off from query]] T179428 (duration: 00m 49s) |
[production] |
| 23:23 |
<thcipriani@tin> |
Synchronized php-1.31.0-wmf.6/extensions/Wikidata/extensions/Wikibase/repo/Wikibase.hooks.php: SWAT: [[gerrit:387749|Allow turning Cirrus usage off from query]] T179428 (duration: 00m 51s) |
[production] |
| 23:09 |
<thcipriani@tin> |
Synchronized wmf-config/Wikibase-production.php: SWAT: [[gerrit:386554|Revert "Revert "Add negative weight to disambig entities""]] T148411 (duration: 00m 51s) |
[production] |
| 22:49 |
<ejegg> |
disabled fundraising unsubscribe import processing |
[production] |
| 22:33 |
<Krinkle> |
group2(all-wikidata) wikis to wmf.5 from 24 hours ago seems to have caused a 60% drop in navigation timing metric report count (100/min => 40/min) |
[production] |
| 22:19 |
<eileen1> |
process-control updated to 9c8b4bb1849f49e7a698107c09324b35b9b9d212 |
[production] |
| 22:17 |
<demon@tin> |
Synchronized wmf-config/CommonSettings.php: rel1_28 is dead (duration: 00m 50s) |
[production] |
| 22:06 |
<ejegg> |
re-enabled fundraising jobs |
[production] |
| 21:48 |
<ejegg> |
fundraising jobs disabled |
[production] |
| 20:10 |
<demon@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 to wmf.6 |
[production] |
| 20:05 |
<demon@tin> |
Synchronized php: symlink swap (duration: 00m 49s) |
[production] |
| 19:57 |
<krinkle@tin> |
Synchronized php-1.31.0-wmf.6/resources/src/startup.js: T178943 (duration: 00m 51s) |
[production] |
| 19:53 |
<demon@tin> |
Synchronized php-1.31.0-wmf.5/extensions/CentralNotice: fix weird git rebasing issue (duration: 00m 53s) |
[production] |
| 19:41 |
<demon@tin> |
Pruned MediaWiki: 1.31.0-wmf.4 [keeping static files] (duration: 01m 52s) |
[production] |
| 19:31 |
<awight@tin> |
Synchronized php-1.31.0-wmf.5/extensions/ORES: Fix for API=oresscores, T179430 (duration: 00m 50s) |
[production] |
| 19:28 |
<awight@tin> |
Synchronized php-1.31.0-wmf.6/extensions/ORES: Fix for API=oresscores, T179430 (duration: 00m 52s) |
[production] |
| 19:14 |
<bblack> |
all hosts: manual cumin+sed removal of ethernet autoneg params from /e/n/i to match https://gerrit.wikimedia.org/r/#/c/387849/ |
[production] |
| 19:08 |
<otto@tin> |
Finished deploy [analytics/refinery@6d11d67]: Deploying refinery-source artifacts for 0.0.54 for JsonRefine job, T162610 (duration: 03m 45s) |
[production] |
| 19:05 |
<otto@tin> |
Started deploy [analytics/refinery@6d11d67]: Deploying refinery-source artifacts for 0.0.54 for JsonRefine job, T162610 |
[production] |