|
2017-07-13
§
|
| 08:11 |
<jynus> |
powercycle pc2006, was down |
[production] |
| 08:09 |
<jmm@puppetmaster1001> |
conftool action : set/pooled=yes; selector: mw1260.eqiad.wmnet |
[production] |
| 07:58 |
<marostegui> |
Deploy alter table on s4 - db1053 - T168661 |
[production] |
| 07:48 |
<marostegui@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1053 - T168661 (duration: 00m 47s) |
[production] |
| 07:33 |
<moritzm> |
rebooting netmon1001 |
[production] |
| 06:57 |
<moritzm> |
installing apache security updates on remaining mw1* hosts |
[production] |
| 06:51 |
<moritzm> |
installing nginx security updates on cp4* |
[production] |
| 06:51 |
<marostegui> |
Manually deploy some alter tables on dbstore1001 for enwiki - T166204 |
[production] |
| 06:42 |
<_joe_> |
rolling restart of pybal on low-traffic balancers |
[production] |
| 06:14 |
<XioNoX> |
restricting ssh algorithms on network devices - T170369 |
[production] |
| 06:11 |
<moritzm> |
fixed salt setup for reimaged stat1006 |
[production] |
| 03:09 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Jul 13 03:09:35 UTC 2017 (duration 7m 8s) |
[production] |
| 03:02 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.9) (duration: 07m 57s) |
[production] |
| 02:34 |
<l10nupdate@tin> |
scap sync-l10n completed (1.30.0-wmf.7) (duration: 09m 54s) |
[production] |
| 02:26 |
<mutante> |
labtestpuppetmaster2001 - flapping icinga alerts about salt-minion starting and stopping constantly - there is an accepted salt-key but it was rejected by the master, server was reinstalled but still old key - deleted old key, accepted new key (T167157) |
[production] |
|
2017-07-12
§
|
| 23:28 |
<thcipriani@tin> |
Synchronized php-1.30.0-wmf.9/extensions/CirrusSearch/resources/ext.cirrus.explore-similar.js: SWAT: [[gerrit:364834|Adding full URLs to Explore Similar API calls]] T149809 T164856 (duration: 00m 47s) |
[production] |
| 23:08 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:363669|Index deletes everywhere]] T163235 (duration: 00m 47s) |
[production] |
| 22:08 |
<mobrovac@tin> |
Finished deploy [recommendation-api/deploy@d5076c2]: (no justification provided) (duration: 01m 50s) |
[production] |
| 22:06 |
<mobrovac@tin> |
Started deploy [recommendation-api/deploy@d5076c2]: (no justification provided) |
[production] |
| 21:54 |
<andrewbogott> |
restarting nodepool to pick up a config change |
[production] |
| 21:42 |
<mobrovac@tin> |
Finished deploy [recommendation-api/deploy@ca816ac]: (no justification provided) (duration: 02m 24s) |
[production] |
| 21:40 |
<mobrovac@tin> |
Started deploy [recommendation-api/deploy@ca816ac]: (no justification provided) |
[production] |
| 21:29 |
<demon@tin> |
Synchronized wmf-config/mobile.php: MinervaNeue config (duration: 00m 46s) |
[production] |
| 21:28 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: MinervaNeue config (duration: 00m 46s) |
[production] |
| 21:27 |
<demon@tin> |
Synchronized wmf-config/InitialiseSettings.php: MinervaNeue config (duration: 00m 47s) |
[production] |
| 21:22 |
<demon@tin> |
Finished scap: Rebuilding l10n cache for new skin (duration: 38m 47s) |
[production] |
| 20:43 |
<demon@tin> |
Started scap: Rebuilding l10n cache for new skin |
[production] |
| 20:16 |
<bsitzmann@tin> |
Finished deploy [mobileapps/deploy@3f90bf1]: Update mobileapps to d30dae2 (T169930, T170225) (duration: 05m 00s) |
[production] |
| 20:11 |
<bsitzmann@tin> |
Started deploy [mobileapps/deploy@3f90bf1]: Update mobileapps to d30dae2 (T169930, T170225) |
[production] |
| 19:37 |
<XioNoX> |
adding ignore-l3-incompletes to all peering/transit interfaces - T163542 |
[production] |
| 19:27 |
<thcipriani@tin> |
Synchronized php: promote php symlink group1 wikis to 1.30.0-wmf.9 (duration: 00m 45s) |
[production] |
| 19:25 |
<thcipriani@tin> |
rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.30.0-wmf.9 |
[production] |
| 19:10 |
<demon@tin> |
Synchronized php-1.30.0-wmf.9/skins/MinervaNeue/: Latest code (duration: 00m 47s) |
[production] |
| 19:09 |
<demon@tin> |
Synchronized php-1.30.0-wmf.7/skins/MinervaNeue/: Latest code (duration: 00m 48s) |
[production] |
| 18:16 |
<mobrovac@tin> |
Finished deploy [recommendation-api/deploy@7fd10f2]: Use the domain parameter as the target language - T170439 (duration: 00m 40s) |
[production] |
| 18:15 |
<mobrovac@tin> |
Started deploy [recommendation-api/deploy@7fd10f2]: Use the domain parameter as the target language - T170439 |
[production] |
| 18:15 |
<andrewbogott> |
depooling labvirt1015, deleting a bunch of stuck contintcloud instances |
[production] |
| 18:14 |
<demon@tin> |
Synchronized static/images/project-logos/: Fixing srwikiquote logos (duration: 00m 48s) |
[production] |
| 17:52 |
<chasemp> |
labnodepool1001:~# sudo puppet agent --enable |
[production] |
| 17:29 |
<chasemp> |
labnodepool1001:~# service nodepool stop |
[production] |
| 17:21 |
<_joe_> |
rolling restart of pybal on low-traffic LVS in eqiad,codfw |
[production] |
| 17:19 |
<chasemp> |
labnet1001:~# service nova-api restart |
[production] |
| 17:15 |
<chasemp> |
labcontrol1001:~# service rabbitmq-server restart |
[production] |
| 17:13 |
<robh@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=wdqs2002.codfw.wmnet |
[production] |
| 17:13 |
<robh@puppetmaster1001> |
conftool action : set/pooled=no; selector: name=wdqs2003.codfw.wmnet |
[production] |
| 17:07 |
<moritzm> |
upgrading nginx on mwdebug* |
[production] |
| 16:52 |
<godog> |
roll-restart and upgrade thumbor in eqiad |
[production] |
| 16:47 |
<oblivian@puppetmaster1001> |
conftool action : set/pooled=true; selector: dnsdisc=recommendation-api |
[production] |
| 16:36 |
<oblivian@puppetmaster1001> |
conftool action : set/pooled=yes; selector: service=recommendation-api,dc=eqiad |
[production] |
| 16:15 |
<oblivian@puppetmaster1001> |
conftool action : set/pooled=yes; selector: service=recommendation-api,dc=codfw |
[production] |