|
2018-03-19
§
|
| 13:02 |
<arturo> |
labtestcontrol2001: set GRUB_TIMEOUT=30 in /etc/default/grub, the previous value (10) wasn't enough to display the menu via mgmt |
[production] |
| 12:52 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Slowly repool db1091 (duration: 00m 57s) |
[production] |
| 12:40 |
<arturo> |
T189722 reboot labtestcontrol2001 |
[production] |
| 12:37 |
<moritzm> |
installing curl security updates |
[production] |
| 12:16 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Restore es1016 original weight after kernel, mariadb and socket location upgrade (duration: 00m 58s) |
[production] |
| 11:55 |
<_joe_> |
stopping hhvm on terbium for a test. |
[production] |
| 11:44 |
<moritzm> |
reimage mw1293 as video scaler |
[production] |
| 11:29 |
<godog> |
point codfw puppet to puppetmaster2001 |
[production] |
| 11:27 |
<hashar@tin> |
Synchronized docroot/wwwportal/portal: (no justification provided) (duration: 00m 57s) |
[production] |
| 11:17 |
<ema> |
cache_misc@esams: upgrade to varnish 5.1.3-1wm4 |
[production] |
| 11:14 |
<jdrewniak@tin> |
Synchronized portals: Wikimedia Portals Update: [[gerrit:393239|Switching portals submodule to portals-deploy (T180777)]] (duration: 00m 58s) |
[production] |
| 11:13 |
<jdrewniak@tin> |
Synchronized portals/wikipedia.org/assets: Wikimedia Portals Update: [[gerrit:393239|Switching portals submodule to portals-deploy (T180777)]] (duration: 00m 58s) |
[production] |
| 11:06 |
<moritzm> |
uploaded openjdk-8 8u162-b12-1~bpo8+1 for jessie-wikimedia to apt.wikimedia.org |
[production] |
| 10:58 |
<godog> |
point eqsin puppet to puppetmaster2001 |
[production] |
| 10:53 |
<moritzm> |
restarting jenkins on releases1001 to pick up Java security update |
[production] |
| 10:47 |
<godog> |
point ulsfo puppet to puppetmaster2001 |
[production] |
| 10:37 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1065 - T183469 (duration: 00m 58s) |
[production] |
| 10:25 |
<marostegui> |
Remove db1009 from tendril - T189216 |
[production] |
| 10:14 |
<ema> |
cp3008: upgrade to varnish 5.1.3-1wm4 |
[production] |
| 09:55 |
<marostegui@tin> |
Synchronized wmf-config/db-codfw.php: Remove db1009 from config - T189216 (duration: 00m 57s) |
[production] |
| 09:54 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Remove db1009 from config - T189216 (duration: 00m 58s) |
[production] |
| 09:45 |
<marostegui> |
Stop MySQL on db1009 - T189216 |
[production] |
| 09:37 |
<elukey> |
restart hadoop daemons on analytics1070 for openjdk upgrades (canary) |
[production] |
| 09:27 |
<godog> |
reimage puppetmaster2001 with stretch - T184562 |
[production] |
| 09:22 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Slowly repool es1016 after kernel, mariadb and socket location upgrade (duration: 00m 58s) |
[production] |
| 09:10 |
<godog> |
depool codfw puppetmaster - T184562 |
[production] |
| 09:08 |
<marostegui> |
Stop MySQL on es1016 for kernel, mariadb and socket location upgrade |
[production] |
| 09:07 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool es1016 for kernel, mariadb and socket location upgrade (duration: 00m 58s) |
[production] |
| 08:57 |
<moritzm> |
installing openjdk-8 security updates |
[production] |
| 08:41 |
<elukey> |
reboot thorium for kernel security upgrades (hosts all analytics websites, they will go down temporary) |
[production] |
| 08:26 |
<moritzm> |
installing libvorbis security updates |
[production] |
| 08:22 |
<elukey> |
revert previous state on aqs1004, the new pkg might need some more work - T189529 |
[production] |
| 08:19 |
<marostegui> |
Reset slave on db1106 to get it ready for s1 - https://phabricator.wikimedia.org/T183469 |
[production] |
| 08:11 |
<marostegui> |
Reboot db1106 for kernel upgrade |
[production] |
| 07:58 |
<elukey> |
manually installed cassandra-2.2.6-wmf3 on aqs1004 - T189529 |
[production] |
| 07:55 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1065 - T183469 (duration: 00m 57s) |
[production] |
| 07:47 |
<elukey> |
drain cassandra instances and reboot aqs1004 for kernel upgrades |
[production] |
| 07:44 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Move db1106 from s5 to s1 - T183469 (duration: 01m 00s) |
[production] |
| 07:27 |
<marostegui> |
Reload dbproxy1002 and dbproxy1007 to get the new config - T189773 |
[production] |
| 06:20 |
<marostegui> |
Deploy schema change on db1091 - T187089 T185128 T153182 |
[production] |
| 06:13 |
<marostegui> |
Stop MySQL on db1091 for kernel and mariadb upgrade |
[production] |
| 06:13 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1091 for schema change, kernel upgrade and mariadb upgrade (duration: 00m 58s) |
[production] |
| 02:39 |
<l10nupdate@tin> |
scap sync-l10n completed (1.31.0-wmf.25) (duration: 10m 54s) |
[production] |