|
2016-10-27
§
|
| 13:10 |
<hashar@tin> |
Synchronized wmf-config/throttle.php: T146600 T149200 (duration: 00m 53s) |
[production] |
| 12:53 |
<moritzm> |
uploaded openjdk-8 8u111 for jessie-wikimedia to apt.wikimedia.org |
[production] |
| 12:36 |
<moritzm> |
migrating nodes from ganeti2006 for kernel reboot |
[production] |
| 12:35 |
<gehel> |
disabling puppet on maps servers for deployment of https://gerrit.wikimedia.org/r/#/c/315271/ |
[production] |
| 12:20 |
<moritzm> |
restarted ntp on conf1001 (stuck in XFAC state) |
[production] |
| 12:04 |
<gehel> |
restart elasticsearch on relforge to activate GC logs - T134853 |
[production] |
| 11:33 |
<_joe_> |
stopping all cache-related services on esams spares cp3012-22 |
[production] |
| 10:30 |
<moritzm> |
rebooting conf1003 for kernel update |
[production] |
| 10:30 |
<hashar> |
integration: on Trusty slaves, remove jenkins-deploy from KVM which is only needed for Android testing for T149294: salt -v '*slave-trusty*' cmd.run 'deluser jenkins-deploy kvm' |
[releng] |
| 10:29 |
<hashar> |
integration: on Trusty slaves, remove jenkins-deploy from KVM which is only needed for Android testing: salt -v '*slave-trusty*' cmd.run 'groupdeluser jenkins-deploy kvm' |
[releng] |
| 10:26 |
<moritzm> |
rebooting conf1002 for kernel update |
[production] |
| 10:25 |
<hashar> |
integration: purge Android packages from Trusty slaves for T149294 : salt -v '*slave-trusty*' cmd.run 'apt-get --yes remove --purge gcc-multilib lib32z1 lib32stdc++6 qemu' |
[releng] |
| 10:20 |
<moritzm> |
rebooting conf1001 for kernel update |
[production] |
| 10:02 |
<gehel> |
reboot maps eqiad cluster for kernel update |
[production] |
| 09:54 |
<moritzm> |
rolling reboot of zookeeper cluster in codfw for kernel update |
[production] |
| 09:45 |
<gehel> |
reboot maps codfw cluster for kernel update |
[production] |
| 09:42 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: wtp2019.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:42 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=no; selector: wtp2019.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:41 |
<akosiaris@puppetmaster1001> |
conftool action : set/pooled=yes; selector: wtp2019.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) |
[production] |
| 09:15 |
<jynus> |
applying schema change (imagelinks) to s2 wikis T139090 |
[production] |
| 08:24 |
<moritzm> |
rolling reboot of logstash cluster for kernel update |
[production] |
| 07:47 |
<marostegui> |
Deploying ALTER table s4 commonswiki.templatelinks - https://phabricator.wikimedia.org/T149079 (db2065 only) |
[production] |
| 07:26 |
<_joe_> |
creating darmstadtium on ganeti, T148961 |
[production] |
| 07:24 |
<marostegui> |
Deploying schema change db2034- enwiki.change_tag/tag_summary - T147166 |
[production] |
| 07:15 |
<marostegui> |
Removed /srv/s5.sql.gz (54G - may 2015) from db1045 to free up some space |
[production] |
| 06:57 |
<marostegui> |
Deploy schema change s5 dewiki.revision only codfw - T148967 |
[production] |
| 05:07 |
<bd808> |
Tried to switch main bot from OGE to k8s but pod ended in CrashLoopBackOff status with no log output that I could find |
[tools.stashbot] |
| 03:00 |
<l10nupdate@tin> |
ResourceLoader cache refresh completed at Thu Oct 27 03:00:35 UTC 2016 (duration 5m 20s) |
[production] |
| 02:55 |
<l10nupdate@tin> |
scap sync-l10n completed (1.28.0-wmf.23) (duration: 10m 36s) |
[production] |
| 02:32 |
<tgr@tin> |
Synchronized php-1.28.0-wmf.23/extensions/OAuth/: deploy fix for T149194 (duration: 00m 47s) |
[production] |
| 02:31 |
<tgr@tin> |
Synchronized php-1.28.0-wmf.22/extensions/OAuth/: deploy fix for T149194 (duration: 00m 51s) |
[production] |
| 02:28 |
<l10nupdate@tin> |
scap sync-l10n completed (1.28.0-wmf.22) (duration: 10m 28s) |
[production] |
| 01:46 |
<eileen1> |
disable GlobalCollect Recurring Donations |
[production] |
| 01:21 |
<mutante> |
mw1208 - service hhvm restart |
[production] |
| 00:57 |
<Krenair> |
Restart - it looks like this started during a NickServ outage, resulting in no authentication, resulting in IRC ops getting pinged by an anti-flood bot about this bot's behaviour |
[tools.stewardbots] |
| 00:42 |
<ejegg> |
updated civicrm from 586433b81decb90b80c40acdbfde4548ca67af43 to 31bea5b36fb22792472990672a49e8dea637546c |
[production] |
| 00:32 |
<mutante> |
palladium - removed from DNS |
[production] |
| 00:30 |
<mutante> |
palladium - re-shutdown |
[production] |
| 00:26 |
<bd808> |
Testing stashbot wiki and twitter bridges |
[tools.stashbot] |
|
2016-10-26
§
|
| 23:57 |
<dereckson@tin> |
Synchronized docroot/noc/conf/: Update noc.wikimedia.org dblist and config files (duration: 00m 45s) |
[production] |
| 23:55 |
<bd808> |
Testing stashbot wiki and twitter bridges |
[tools.stashbot] |
| 23:52 |
<dereckson@tin> |
Synchronized php-1.28.0-wmf.23/extensions/UploadWizard/resources/details/uw.DateDetailsWidget.js: Unbreak Flickr uploads (T149259) (duration: 00m 48s) |
[production] |
| 23:46 |
<madhuvishy> |
tools reenabled puppet across proxy hosts. /.well-known/healthz now live on tools-proxy T143638 |
[production] |
| 23:41 |
<dereckson@tin> |
Synchronized wmf-config/CommonSettings.php: For $wmgGalleryOptions, use isset() ([[Gerrit:318223]]) (duration: 00m 45s) |
[production] |
| 23:22 |
<dereckson@tin> |
Synchronized wmf-config/CommonSettings.php: Fix for current Undefined variable: wmgGalleryOptions issue (duration: 00m 48s) |
[production] |
| 23:20 |
<madhuvishy> |
Disabling puppet on tools proxy hosts for applying proxy health check endpoint T143638 |
[tools] |
| 23:19 |
<dereckson@tin> |
Synchronized wmf-config/CommonSettings.php: Test setting gallery config differently on Beta Cluster enwiki (T141349, 2/2) (duration: 00m 45s) |
[production] |
| 23:18 |
<dereckson@tin> |
Synchronized wmf-config/InitialiseSettings-labs.php: Test setting gallery config differently on Beta Cluster enwiki (T141349, 1/2, no-op in prod) (duration: 00m 49s) |
[production] |
| 23:17 |
<godog> |
upgrade prometheus on tools-prometheus-02 |
[tools] |
| 23:03 |
<JeanFred> |
Deploy latest from Git master: c943e89, e3ba148, 063f9e2 (T148772 & T148773), 1db9f42, fe119e1, de2e590, 82147b8, f6ff350 & 63a1819 (T140795) |
[tools.heritage] |