|
2017-11-21
ยง
|
| 15:31 |
<_joe_> |
rolling restart of pybal on low-traffic in codfw, eqiad for the new depool thresholds for MW |
[production] |
| 15:00 |
<ppchelko@tin> |
Finished deploy [cpjobqueue/deploy@3e948de]: Revert: Temporarily disable deduplication (duration: 00m 26s) |
[production] |
| 15:00 |
<ppchelko@tin> |
Started deploy [cpjobqueue/deploy@3e948de]: Revert: Temporarily disable deduplication |
[production] |
| 14:42 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Restore original weight for db1096 (duration: 00m 48s) |
[production] |
| 14:39 |
<ppchelko@tin> |
Finished deploy [cpjobqueue/deploy@aac3201]: Temporarily disable deduplication (duration: 00m 29s) |
[production] |
| 14:39 |
<ppchelko@tin> |
Started deploy [cpjobqueue/deploy@aac3201]: Temporarily disable deduplication |
[production] |
| 14:29 |
<zeljkof> |
EU SWAT finished |
[production] |
| 14:25 |
<bblack> |
cr[12]-ulsfo: allow lvs400[567] as PyBal neighbors for BGP |
[production] |
| 14:18 |
<zfilipin@tin> |
Synchronized php-1.31.0-wmf.8/extensions/TimedMediaHandler/MwEmbedModules/EmbedPlayer/resources/mw.EmbedPlayerOgvJs.js: SWAT: [[gerrit:392643|Disable wasm, use asm.js codec modules for Safari/Edge (T181022)]] (duration: 00m 49s) |
[production] |
| 14:12 |
<jdrewniak@tin> |
Synchronized portals: SWAT: [[gerrit:392636|Bumping portals to master (T128546)]] (duration: 00m 49s) |
[production] |
| 14:11 |
<jdrewniak@tin> |
Synchronized portals/prod/wikipedia.org/assets: SWAT: [[gerrit:392636|Bumping portals to master (T128546)]] (duration: 00m 50s) |
[production] |
| 14:11 |
<ppchelko@tin> |
Started restart [cpjobqueue/deploy@5341d94]: Restart to try increased maxSockets |
[production] |
| 14:11 |
<Pchelolo> |
restart cpjobqueue to try increasing maxSockets |
[production] |
| 14:08 |
<bblack> |
not-abnormally-quick reboot on lvs4005 |
[production] |
| 14:08 |
<mobrovac@tin> |
Started restart [electron-render/deploy@8dd5f13]: electron stuck - T174916 |
[production] |
| 13:45 |
<ppchelko@tin> |
Finished deploy [cpjobqueue/deploy@5341d94]: Enable GC metrics reporting (duration: 00m 36s) |
[production] |
| 13:44 |
<ppchelko@tin> |
Started deploy [cpjobqueue/deploy@5341d94]: Enable GC metrics reporting |
[production] |
| 13:39 |
<_joe_> |
starting 2 manual runners for htmlcacheupdate on commons, 1 for htmlcacheupdate and 1 for refreshlinks on ruwiki, on terbium |
[production] |
| 13:39 |
<bblack> |
quick reboot on lvs4005 |
[production] |
| 12:02 |
<kartik@tin> |
Finished deploy [cxserver/deploy@b87a27a]: Update cxserver to 4301987 (duration: 03m 24s) |
[production] |
| 11:58 |
<kartik@tin> |
Started deploy [cxserver/deploy@b87a27a]: Update cxserver to 4301987 |
[production] |
| 11:04 |
<akosiaris> |
reboot ununpentium for serial tty change |
[production] |
| 11:03 |
<akosiaris> |
reboot oresrdb2001 for serial tty change |
[production] |
| 11:02 |
<akosiaris> |
reboot netmon1003 for serial tty change |
[production] |
| 11:01 |
<akosiaris> |
reboot install2002 for serial tty change |
[production] |
| 10:57 |
<akosiaris> |
reboot install1002 for serial tty change |
[production] |
| 10:35 |
<godog> |
bootstrap cassandra restbase2004-a - T179422 |
[production] |
| 10:11 |
<ppchelko@tin> |
Finished deploy [cpjobqueue/deploy@e35aa05]: Set consumer_batch_size to 10 T181007 (duration: 00m 31s) |
[production] |
| 10:10 |
<ppchelko@tin> |
Started deploy [cpjobqueue/deploy@e35aa05]: Set consumer_batch_size to 10 T181007 |
[production] |
| 09:39 |
<elukey> |
upload prometheus-druid-exporter 0.4 to jessie/stretch-wikimedia |
[production] |
| 09:28 |
<marostegui> |
Shutdown db2068 for maintenance - T180927 |
[production] |
| 09:19 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase weight for db1096 (duration: 00m 49s) |
[production] |
| 09:02 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase weight for db1096 (duration: 00m 49s) |
[production] |
| 08:39 |
<marostegui> |
Drop index on db1089 enwiki.ores_classification - T180045 |
[production] |
| 08:35 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1096 with low weight - T178359 (duration: 00m 48s) |
[production] |
| 08:27 |
<marostegui> |
Reboot db1096 for kernel and MariaDB upgrade |
[production] |
| 08:19 |
<marostegui> |
Compress s5 on db1101 - T178359 |
[production] |
| 08:11 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Fully pool db1109 and db1110 - T180700 (duration: 00m 48s) |
[production] |
| 07:36 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Increase weight for db1109 and db1110 - T180700 (duration: 00m 49s) |
[production] |
| 07:03 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Pool db1109 and db1110 in s5 with small weight - T180700 (duration: 00m 48s) |
[production] |
| 06:50 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1087 - T179106 (duration: 00m 48s) |
[production] |
| 06:47 |
<marostegui> |
Remove index wb_terms_language from db1087 - https://phabricator.wikimedia.org/T179106 |
[production] |
| 06:47 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1087 - T179106 (duration: 00m 48s) |
[production] |
| 06:27 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1096 - T178359 (duration: 00m 48s) |
[production] |
| 06:27 |
<marostegui> |
Stop MySQL on db1096 to clone db1101.s5 - T178359 |
[production] |
| 06:19 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Restore db1082 original weight - T177208 (duration: 00m 49s) |
[production] |
| 02:58 |
<mutante> |
phabricator back up |
[production] |
| 02:55 |
<mutante> |
phab1001 (phabricator prod) reboot for kernel upgrade |
[production] |
| 02:48 |
<krinkle@tin> |
Synchronized docroot/noc: clean up (duration: 00m 49s) |
[production] |
| 02:23 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.7) (duration: 05m 42s) |
[production] |