|
2016-10-24
§
|
| 18:05 |
<bblack> |
downgrading nginx(+linked openssl implicitly) on cp* |
[production] |
| 17:02 |
<gehel> |
deplyoing latest GUI for WDQS |
[production] |
| 16:22 |
<ejegg> |
updated SmashPig from e28b2cd9f0c1429acdd2a08c68f95884dbffb594 to f9e185b7b14749ae24155c69bc1927dc6222e5f7 |
[production] |
| 16:19 |
<andrewbogott> |
upgrading deployment-puppetmaster to puppet 3.8.5 packages |
[releng] |
| 15:35 |
<paladox> |
deploying https://gerrit.wikimedia.org/r/317526 |
[tools.lolrrit-wm] |
| 15:29 |
<mforns> |
actually it was webrequest-load-check_sequence_statistics-wf-upload-2016-10-24-14 |
[analytics] |
| 15:29 |
<mforns> |
created 0005238-161020124223818-oozie-oozi-C to re-run webrequest-load-check_sequence_statistics-wf-upload-2016-10-21-17 (oozie errors) |
[analytics] |
| 15:04 |
<bblack> |
enabling/running puppet on caches for 8x varnish ports changes - T107749 |
[production] |
| 14:57 |
<paravoid> |
restarting ferm on es2015 |
[production] |
| 14:54 |
<bblack> |
starting ferm server on eeden, radon |
[production] |
| 14:51 |
<Krenair> |
T142288: Shut off -pdf02 and -conftool |
[releng] |
| 14:41 |
<gehel@puppetmaster1001> |
conftool action : set/pooled=yes; selector: dc=eqiad,cluster=maps,service=kartotherian,name=maps1002.eqiad.wmnet |
[production] |
| 14:38 |
<dereckson@mira> |
Synchronized wmf-config/CommonSettings.php: Toggle wgDefaultUserOptions['watchdefault'] on for cs.wikipedia, off elsewhere (T148328, 2/2) (duration: 00m 50s) |
[production] |
| 14:36 |
<dereckson@mira> |
Synchronized wmf-config/InitialiseSettings.php: Toggle wgDefaultUserOptions['watchdefault'] on for cs.wikipedia, off elsewhere (T148328, 1/2) (duration: 00m 54s) |
[production] |
| 14:36 |
<bblack> |
disabling puppet on all caches ahead of port# work, to test - T107749 / https://gerrit.wikimedia.org/r/#/c/317405 |
[production] |
| 14:29 |
<yurik> |
re-deployed current kartotherian to all servers (maps1002 & maps-test* were stale) |
[production] |
| 14:11 |
<marostegui> |
Deploy schema change s5 dewiki.revision - only codfw T148967 |
[production] |
| 14:03 |
<l10nupdate@mira> |
ResourceLoader cache refresh completed at Mon Oct 24 14:03:07 UTC 2016 (duration 6m 17s) |
[production] |
| 13:56 |
<dereckson@mira> |
scap sync-l10n completed (1.28.0-wmf.22) (duration: 10m 46s) |
[production] |
| 13:42 |
<bblack> |
restarting all varnish frontends (serially per-cluster with proper depooling, etc) |
[production] |
| 13:20 |
<elukey> |
reimaging mc120[89] and mc1030 |
[production] |
| 13:18 |
<Dereckson> |
Started manually l10nupdate, as it didn't run for 6 days, and more especially to fix T148921 user-facing issue. |
[production] |
| 13:13 |
<dereckson@mira> |
Synchronized wmf-config/throttle.php: Edit-a-thon BDA (Poitiers) throttle rule (T148852) (duration: 01m 13s) |
[production] |
| 10:47 |
<elukey> |
reimaged mc102[56], currently doing mc1027 |
[production] |
| 10:21 |
<_joe_> |
rebooting kubernetes1002 |
[production] |
| 09:20 |
<mobrovac> |
change-prop deploying c7feda2 |
[production] |
| 09:14 |
<hashar> |
rebasing integration puppet master |
[releng] |
| 09:09 |
<mobrovac> |
restbase deploy end of f9017ad |
[production] |
| 08:55 |
<akosiaris> |
rebooting cobalt (gerrit) for kernel upgrades |
[production] |
| 08:53 |
<elukey> |
reimaging mc1024 |
[production] |
| 08:46 |
<mobrovac> |
restbase deploy start of f9017ad |
[production] |
| 08:38 |
<gehel> |
continue rolling restart of elasticsearch eqiad cluster |
[production] |
| 08:38 |
<hashar> |
Restarting gallium (Jenkins/Zuul) for kernel upgrades |
[production] |
| 08:36 |
<akosiaris> |
rebooting labnodepool1001 for kernel upgrades |
[production] |
| 08:36 |
<akosiaris> |
rebooting scandium for kernel upgrades |
[production] |
| 08:33 |
<hashar> |
rebooting contint1001 |
[production] |
| 08:20 |
<elukey> |
reimaging mc1023.eqiad.wmnet |
[production] |
| 07:46 |
<elukey> |
reimaging mc1022.eqiad.wmnet (T137345) |
[production] |
| 07:09 |
<marosteg1i> |
Deploying alter table s1.enwiki on codfw - T147166 |
[production] |
| 03:45 |
<Krenair> |
reset host keys for tools-puppetmaster-02 on -01, looks like it was recreated 5-6 days ago |
[tools] |
|
2016-10-22
§
|
| 15:37 |
<oblivian@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=cp1052.eqiad.wmnet |
[production] |
| 15:02 |
<bblack@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=cp1052.eqiad.wmnet |
[production] |
| 15:02 |
<bblack> |
repool cp1052 - T148891 |
[production] |
| 14:52 |
<bblack> |
rebooted cp1052 - T148891 |
[production] |
| 14:26 |
<bblack> |
depooled cp1052 (cache_text@eqiad, ethernet linkdown for unknown reasons) |
[production] |
| 13:45 |
<mforns> |
created 0002687-161020124223818-oozie-oozi-C to re-run webrequest-load-check_sequence_statistics-wf-upload-2016-10-21-17 (oozie errors) |
[analytics] |
| 12:52 |
<paladox> |
deploying https://gerrit.wikimedia.org/r/317315 T147582 |
[tools.lolrrit-wm] |
| 12:44 |
<elukey> |
created 0002631-161020124223818-oozie-oozi-C to re-run webrequest-load-check_sequence_statistics-wf-upload-2016-10-21-17 (oozie errors) |
[analytics] |
| 12:34 |
<marostegui> |
Stopping replication in db2055 to use it to clone another host - T146261 |
[production] |