|
2018-03-19
ยง
|
| 14:34 |
<elukey> |
reboot kafka1002 (eventbus/jobqueue) for kernel upgrades |
[production] |
| 14:28 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: kubernetes2001.codfw.wmnet (tags: ['dc=codfw', 'cluster=scb', 'service=mathoid']) |
[production] |
| 14:28 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: kubernetes1001.eqiad.wmnet (tags: ['dc=eqiad', 'cluster=scb', 'service=mathoid']) |
[production] |
| 14:18 |
<ema> |
cp3040: discard old VCL T189892 |
[production] |
| 14:09 |
<moritzm> |
restarting apache on contint1001 to pick up curl security update |
[production] |
| 13:48 |
<anomie> |
Cleaning up orphaned image_comment_temp rows on all wikis for T189985 |
[production] |
| 13:44 |
<anomie@tin> |
Synchronized php-1.31.0-wmf.25/includes/filerepo/file/LocalFile.php: Applying fix for T189985 (duration: 00m 58s) |
[production] |
| 13:22 |
<zeljkof> |
EU SWAT finished |
[production] |
| 13:20 |
<zfilipin@tin> |
Synchronized wmf-config/flaggedrevs.php: SWAT: [[gerrit:418700|Revert "Restrict FlaggedRevs to only operated on NS_MAIN on arwiki" (T148603 T189224)]] (duration: 00m 58s) |
[production] |
| 13:10 |
<zfilipin@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:419535|Enable rollbacker user right at arwikiquote (T189732)]] (duration: 00m 57s) |
[production] |
| 13:09 |
<moritzm> |
reimage mw1294-1296 as video scalers |
[production] |
| 13:02 |
<arturo> |
labtestcontrol2001: set GRUB_TIMEOUT=30 in /etc/default/grub, the previous value (10) wasn't enough to display the menu via mgmt |
[production] |
| 12:52 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1091 (duration: 00m 57s) |
[production] |
| 12:40 |
<arturo> |
T189722 reboot labtestcontrol2001 |
[production] |
| 12:37 |
<moritzm> |
installing curl security updates |
[production] |
| 12:16 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Restore es1016 original weight after kernel, mariadb and socket location upgrade (duration: 00m 58s) |
[production] |
| 11:55 |
<_joe_> |
stopping hhvm on terbium for a test. |
[production] |
| 11:44 |
<moritzm> |
reimage mw1293 as video scaler |
[production] |
| 11:29 |
<godog> |
point codfw puppet to puppetmaster2001 |
[production] |
| 11:27 |
<hashar@tin> |
Synchronized docroot/wwwportal/portal: (no justification provided) (duration: 00m 57s) |
[production] |
| 11:17 |
<ema> |
cache_misc@esams: upgrade to varnish 5.1.3-1wm4 |
[production] |
| 11:14 |
<jdrewniak@tin> |
Synchronized portals: Wikimedia Portals Update: [[gerrit:393239|Switching portals submodule to portals-deploy (T180777)]] (duration: 00m 58s) |
[production] |
| 11:13 |
<jdrewniak@tin> |
Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:393239|Switching portals submodule to portals-deploy (T180777)]] (duration: 00m 58s) |
[production] |
| 11:06 |
<moritzm> |
uploaded openjdk-8 8u162-b12-1~bpo8+1 for jessie-wikimedia to apt.wikimedia.org |
[production] |
| 10:58 |
<godog> |
point eqsin puppet to puppetmaster2001 |
[production] |
| 10:53 |
<moritzm> |
restarting jenkins on releases1001 to pick up Java security update |
[production] |
| 10:47 |
<godog> |
point ulsfo puppet to puppetmaster2001 |
[production] |
| 10:37 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1065 - T183469 (duration: 00m 58s) |
[production] |
| 10:25 |
<marostegui> |
Remove db1009 from tendril - T189216 |
[production] |
| 10:14 |
<ema> |
cp3008: upgrade to varnish 5.1.3-1wm4 |
[production] |
| 09:55 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Remove db1009 from config - T189216 (duration: 00m 57s) |
[production] |
| 09:54 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Remove db1009 from config - T189216 (duration: 00m 58s) |
[production] |
| 09:45 |
<marostegui> |
Stop MySQL on db1009 - T189216 |
[production] |
| 09:37 |
<elukey> |
restart hadoop daemons on analytics1070 for openjdk upgrades (canary) |
[production] |
| 09:27 |
<godog> |
reimage puppetmaster2001 with stretch - T184562 |
[production] |
| 09:22 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Slowly repool es1016 after kernel, mariadb and socket location upgrade (duration: 00m 58s) |
[production] |
| 09:10 |
<godog> |
depool codfw puppetmaster - T184562 |
[production] |
| 09:08 |
<marostegui> |
Stop MySQL on es1016 for kernel, mariadb and socket location upgrade |
[production] |
| 09:07 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool es1016 for kernel, mariadb and socket location upgrade (duration: 00m 58s) |
[production] |
| 08:57 |
<moritzm> |
installing openjdk-8 security updates |
[production] |
| 08:41 |
<elukey> |
reboot thorium for kernel security upgrades (hosts all analytics websites, they will go down temporary) |
[production] |
| 08:26 |
<moritzm> |
installing libvorbis security updates |
[production] |
| 08:22 |
<elukey> |
revert previous state on aqs1004, the new pkg might need some more work - T189529 |
[production] |
| 08:19 |
<marostegui> |
Reset slave on db1106 to get it ready for s1 - https://phabricator.wikimedia.org/T183469 |
[production] |
| 08:11 |
<marostegui> |
Reboot db1106 for kernel upgrade |
[production] |
| 07:58 |
<elukey> |
manually installed cassandra-2.2.6-wmf3 on aqs1004 - T189529 |
[production] |
| 07:55 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1065 - T183469 (duration: 00m 57s) |
[production] |
| 07:47 |
<elukey> |
drain cassandra instances and reboot aqs1004 for kernel upgrades |
[production] |
| 07:44 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Move db1106 from s5 to s1 - T183469 (duration: 01m 00s) |
[production] |
| 07:27 |
<marostegui> |
Reload dbproxy1002 and dbproxy1007 to get the new config - T189773 |
[production] |