|
2018-03-20
§
|
| 17:29 |
<elukey> |
test a depool/repool action for kafka1001 (eventbus/jobqueue) - part of an investigation to figure out where timeouts come from |
[production] |
| 17:24 |
<mholloway-shell@tin> |
Started deploy [mobileapps/deploy@fad1009]: Update mobileapps to 634a15f |
[production] |
| 17:06 |
<demon@tin> |
Pruned MediaWiki: 1.31.0-wmf.24 [keeping static files] (duration: 01m 23s) |
[production] |
| 17:04 |
<demon@tin> |
Pruned MediaWiki: 1.31.0-wmf.22 (duration: 02m 57s) |
[production] |
| 16:38 |
<jynus> |
running reset slave all on db1063 T189655 |
[production] |
| 16:16 |
<akosiaris> |
restart bacula-dir T189655 |
[production] |
| 16:14 |
<akosiaris> |
restart etherpad T189655 |
[production] |
| 16:13 |
<jynus> |
db1063 in read-write (m1) again |
[production] |
| 16:10 |
<jynus> |
set m1 in read only |
[production] |
| 16:09 |
<jynus> |
heartbeat killed on m1-master |
[production] |
| 16:02 |
<herron> |
restarted apache2 on puppetmaster1001 |
[production] |
| 16:00 |
<jynus> |
disable puppet on db1063, db1016 |
[production] |
| 15:57 |
<jynus> |
changing replication topology of m1 |
[production] |
| 15:51 |
<no_justification> |
gerrit: restarting services to pick up 2.14.6 -> 2.14.7 upgrade |
[production] |
| 15:49 |
<demon@tin> |
Finished deploy [gerrit/gerrit@09534cb]: gerrit 2.14.7 (duration: 00m 12s) |
[production] |
| 15:49 |
<demon@tin> |
Started deploy [gerrit/gerrit@09534cb]: gerrit 2.14.7 |
[production] |
| 15:20 |
<marostegui> |
Drop empty (confirmed) table slots from s3 - T190153 |
[production] |
| 14:59 |
<herron> |
codfw puppet masters upgraded to puppetdb4. placing puppet agents into icinga downtime and beginning puppet —noop runs (to send facts to new puppetdb) T177253 |
[production] |
| 14:58 |
<marostegui> |
Drop empty (confirmed) table slots from s7 - T190153 |
[production] |
| 14:55 |
<marostegui> |
Drop empty (confirmed) table slots from s6 - T190153 |
[production] |
| 14:53 |
<twentyafterfour@tin> |
testing scap on tin |
[production] |
| 14:53 |
<marostegui> |
Drop empty (confirmed) table slots from s8 - T190153 |
[production] |
| 14:52 |
<marostegui> |
Drop empty (confirmed) table slots from s5 - T190153 |
[production] |
| 14:52 |
<marostegui> |
Drop empty (confirmed) table slots from s4 - T190153 |
[production] |
| 14:47 |
<godog> |
upload scap 3.7.7-1 - T189306 |
[production] |
| 14:42 |
<marostegui> |
Drop empty (confirmed) table slots from s2 - T190153 |
[production] |
| 14:40 |
<marostegui> |
Drop empty (confirmed) table slots from s1 - T190153 |
[production] |
| 14:14 |
<moritzm> |
rolling restart of elasticsearch in deployment-prep for new Java update |
[production] |
| 14:03 |
<ema> |
cp3007: upgrade varnish to 5.1.3-1wm5 |
[production] |
| 14:00 |
<ema> |
upload varnish_5.1.3-1wm5 to apt.w.o |
[production] |
| 13:59 |
<ayounsi@tin> |
Finished deploy [netbox/deploy@7e29963]: Fixing netbox typo LDAP (duration: 00m 28s) |
[production] |
| 13:59 |
<ayounsi@tin> |
Started deploy [netbox/deploy@7e29963]: Fixing netbox typo LDAP |
[production] |
| 13:52 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1065, give main traffic to db1106 - T183469 (duration: 00m 58s) |
[production] |
| 13:29 |
<herron> |
depooling codfw puppet masters via dns T177253 |
[production] |
| 12:59 |
<moritzm> |
restarting apache on bohrium/piwik to pick up curl security update |
[production] |
| 12:53 |
<jynus> |
applying schema change to wikishared.cx_translations T190133 |
[production] |
| 12:50 |
<arturo> |
reboot labtestservices2003 for T189722 |
[production] |
| 12:33 |
<arturo> |
reboot labtestservices2002 for T189722 |
[production] |
| 12:04 |
<arturo> |
reboot labtestservices2001 for T189722 |
[production] |
| 11:28 |
<godog> |
run compiler-update-facts |
[production] |
| 11:07 |
<arturo> |
reboot labtestnet2002 for T189722 |
[production] |
| 11:03 |
<jynus> |
upgrade and reboot db1095 - this can create temp. lag on wikireplicas |
[production] |
| 10:50 |
<arturo> |
reboot again labtestnet2001 for T189722. Now with a proper grub menu |
[production] |
| 10:44 |
<jynus> |
upgrade and reboot db1102 - this can create tempory lag on wikireplicas |
[production] |
| 10:44 |
<arturo> |
reboot labtestnet2001 for T189722 |
[production] |
| 09:54 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Fully repool es1012 after kernel, mariadb and socket location upgrade (duration: 00m 58s) |
[production] |
| 09:28 |
<jynus> |
repool labsdb1009 after upgrade |
[production] |
| 09:11 |
<moritzm> |
restarting apache on netmon* to pick up curl security updates |
[production] |
| 09:09 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Slowly repool es1012 after kernel, mariadb and socket location upgrade (duration: 00m 57s) |
[production] |
| 09:01 |
<hashar> |
restarting Jenkins for java update |
[production] |