|
2017-02-14
§
|
| 13:50 |
<ema> |
lvs400[12]: upgrade to jessie 8.7, pybal 1.13.5, reboot into kernel 4.4.2-3+wmf8 T155401 T147425 |
[production] |
| 13:32 |
<ema> |
lvs400[34]: upgrade to jessie 8.7, pybal 1.13.5, reboot into kernel 4.4.2-3+wmf8 T155401 T147425 |
[production] |
| 13:28 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Repool db1051,66,80,74,77,56,81,70,82 (duration: 00m 44s) |
[production] |
| 13:15 |
<jynus@tin> |
Synchronized wmf-config/db-eqiad.php: Depool db1051,66,80,74,77,56,81,70,82 (duration: 00m 40s) |
[production] |
| 12:59 |
<jynus> |
reloading/restarting gerrint on cobalt, too slow |
[production] |
| 11:57 |
<elukey@puppetmaster1001> |
conftool action : set/pooled=yes; selector: name=mw2221.codfw.wmnet |
[production] |
| 11:30 |
<moritzm> |
manual fix up of exim spool permissions on krypton (used to run the heavy exim variant) |
[production] |
| 11:28 |
<jynus> |
performing schema change on all mariadb servers T150474 |
[production] |
| 10:51 |
<ema> |
lvs200[123]: upgrade to jessie 8.7, pybal 1.13.5, reboot into kernel 4.4.2-3+wmf8 T155401 T147425 |
[production] |
| 10:48 |
<moritzm> |
installing tomcat security updates |
[production] |
| 10:23 |
<ema> |
lvs200[456]: upgrade to jessie 8.7, pybal 1.13.5, reboot into kernel 4.4.2-3+wmf8 T155401 T147425 |
[production] |
| 10:17 |
<ema> |
uploading pybal 1.13.5 to apt.w.o T147425 |
[production] |
| 09:05 |
<moritzm> |
upgrading firejail on sca cluster |
[production] |
| 08:45 |
<moritzm> |
installing vim security updates |
[production] |
| 08:33 |
<moritzm> |
restarting zookeeper on conf1003 |
[production] |
| 08:23 |
<moritzm> |
restarting zookeeper on conf1002 to pick up OpenJDK update (restarts were stopped yesterday to further investigate gc behaviour) |
[production] |
| 06:56 |
<marostegui> |
Deploy alter table on x1 echo_notification tables - T136428 |
[production] |
| 02:40 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Tue Feb 14 02:40:22 UTC 2017 (duration 5m 19s) |
[production] |
| 02:35 |
<l10nupdate@tin> |
scap sync-l10n completed (1.29.0-wmf.11) (duration: 11m 50s) |
[production] |
| 00:40 |
<maxsem@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/337442/ (duration: 00m 40s) |
[production] |
| 00:39 |
<eileen1> |
update civicrm from 7b36996e87387bb4982cc6937dc8bcbc7952eaf2 to 8d04e75939c5300f0a18e03fdb044c6673b3a74e |
[production] |
| 00:38 |
<maxsem@tin> |
Synchronized static/images/mobile/copyright/wikipedia-wordmark-he.svg: https://gerrit.wikimedia.org/r/#/c/337442/ (duration: 00m 40s) |
[production] |
| 00:22 |
<maxsem@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/337441/ (duration: 00m 40s) |
[production] |
| 00:21 |
<maxsem@tin> |
Synchronized static/images/mobile/copyright/wikipedia-wordmark-hi.svg: https://gerrit.wikimedia.org/r/#/c/337441/ (duration: 00m 42s) |
[production] |
| 00:16 |
<maxsem@tin> |
Synchronized wmf-config/InitialiseSettings.php: https://gerrit.wikimedia.org/r/#/c/337064/ (duration: 00m 48s) |
[production] |
|
2017-02-13
§
|
| 23:45 |
<Pchelolo> |
update RESTBase to 0e9106ab8 |
[production] |
| 23:35 |
<Pchelolo> |
update RESTBase to 0e9106ab8 - canary on restbase1007 |
[production] |
| 23:29 |
<Pchelolo> |
update RESTBase to 0e9106ab8 - staging |
[production] |
| 23:27 |
<bsitzmann@tin> |
Finished deploy [mobileapps/deploy@cd3b897]: Update mobileapps to 776211b (duration: 03m 19s) |
[production] |
| 23:24 |
<bsitzmann@tin> |
Started deploy [mobileapps/deploy@cd3b897]: Update mobileapps to 776211b |
[production] |
| 22:39 |
<Pchelolo> |
rollback RESTBase to ea980cc5d - staging |
[production] |
| 22:26 |
<Pchelolo> |
update RESTBase to 0e9106ab8 - staging |
[production] |
| 22:14 |
<kaldari@tin> |
Synchronized dblists/: Turning on Echo for loginwiki (duration: 00m 41s) |
[production] |
| 22:14 |
<kaldari> |
scap sync-dir dblists/ 'Turning on Echo for loginwiki' |
[production] |
| 21:43 |
<bsitzmann@tin> |
Finished deploy [mobileapps/deploy@f6b4435]: Update mobileapps to 3af473f (duration: 03m 44s) |
[production] |
| 21:39 |
<bsitzmann@tin> |
Started deploy [mobileapps/deploy@f6b4435]: Update mobileapps to 3af473f |
[production] |
| 20:51 |
<mutante> |
carbon/install - adjusted Letsencrypt cert creation, deactivated reprepro to protect from accidental use, switching rsync direction from install1002->install2002, disabled cron on carbon (T132757) |
[production] |
| 20:33 |
<Reedy> |
dropped old out of date echo tables from extension1.loginwiki T157105 |
[production] |
| 19:38 |
<mutante> |
carbon - synced /srv/ data to install1002/2002 for the last time, switching apt.wikimedia.org CNAME to install1002 - carbon deprecated (T132757) |
[production] |
| 19:22 |
<legoktm> |
running namespaceDupes.php on fiwiki (T103786) |
[production] |
| 19:11 |
<thcipriani@tin> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:337423|properly set wgCirrusSearchUseIcuFolding]] T155515 (duration: 00m 41s) |
[production] |
| 19:00 |
<moritzm> |
upgrading mw1236 with the security updates it missed while it was powered off |
[production] |
| 18:33 |
<chasemp> |
labstore1005 service maintain-dbusers restart |
[production] |
| 18:18 |
<mutante> |
scandium - shutdown -h now (T150936) |
[production] |
| 18:05 |
<mutante> |
scandium - ex-zuul merger - removing from puppet, revoking puppet cert, salt key.. |
[production] |
| 16:08 |
<ema> |
lvs1003: upgrade to jessie 8.7, pybal 1.13.4, reboot into kernel 4.4.2-3+wmf8 T155401 |
[production] |
| 15:58 |
<ema> |
lvs1002: upgrade to jessie 8.7, pybal 1.13.4, reboot into kernel 4.4.2-3+wmf8 T155401 |
[production] |
| 15:52 |
<gehel> |
copy old blazegraph metrics to new path (wikidata.query.(triple|lag).* -> servers.<server_name>...) |
[production] |
| 15:36 |
<ema> |
lvs1001: upgrade to jessie 8.7, pybal 1.13.4, reboot into kernel 4.4.2-3+wmf8 T155401 |
[production] |
| 15:18 |
<moritzm> |
switched krypton to exim4-daemon-light (the -heavy variant was installed from an earlier role it carried) |
[production] |