4301-4350 of 10000 results (42ms)
2016-10-27 §
12:36 <moritzm> migrating nodes from ganeti2006 for kernel reboot [production]
12:35 <gehel> disabling puppet on maps servers for deployment of https://gerrit.wikimedia.org/r/#/c/315271/ [production]
12:20 <moritzm> restarted ntp on conf1001 (stuck in XFAC state) [production]
12:04 <gehel> restart elasticsearch on relforge to activate GC logs - T134853 [production]
11:33 <_joe_> stopping all cache-related services on esams spares cp3012-22 [production]
10:30 <moritzm> rebooting conf1003 for kernel update [production]
10:26 <moritzm> rebooting conf1002 for kernel update [production]
10:20 <moritzm> rebooting conf1001 for kernel update [production]
10:02 <gehel> reboot maps eqiad cluster for kernel update [production]
09:54 <moritzm> rolling reboot of zookeeper cluster in codfw for kernel update [production]
09:45 <gehel> reboot maps codfw cluster for kernel update [production]
09:42 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: wtp2019.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) [production]
09:42 <akosiaris@puppetmaster1001> conftool action : set/pooled=no; selector: wtp2019.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) [production]
09:41 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: wtp2019.codfw.wmnet (tags: ['dc=codfw', 'cluster=parsoid', 'service=parsoid']) [production]
09:15 <jynus> applying schema change (imagelinks) to s2 wikis T139090 [production]
08:24 <moritzm> rolling reboot of logstash cluster for kernel update [production]
07:47 <marostegui> Deploying ALTER table s4 commonswiki.templatelinks - https://phabricator.wikimedia.org/T149079 (db2065 only) [production]
07:26 <_joe_> creating darmstadtium on ganeti, T148961 [production]
07:24 <marostegui> Deploying schema change db2034- enwiki.change_tag/tag_summary - T147166 [production]
07:15 <marostegui> Removed /srv/s5.sql.gz (54G - may 2015) from db1045 to free up some space [production]
06:57 <marostegui> Deploy schema change s5 dewiki.revision only codfw - T148967 [production]
03:00 <l10nupdate@tin> ResourceLoader cache refresh completed at Thu Oct 27 03:00:35 UTC 2016 (duration 5m 20s) [production]
02:55 <l10nupdate@tin> scap sync-l10n completed (1.28.0-wmf.23) (duration: 10m 36s) [production]
02:32 <tgr@tin> Synchronized php-1.28.0-wmf.23/extensions/OAuth/: deploy fix for T149194 (duration: 00m 47s) [production]
02:31 <tgr@tin> Synchronized php-1.28.0-wmf.22/extensions/OAuth/: deploy fix for T149194 (duration: 00m 51s) [production]
02:28 <l10nupdate@tin> scap sync-l10n completed (1.28.0-wmf.22) (duration: 10m 28s) [production]
01:46 <eileen1> disable GlobalCollect Recurring Donations [production]
01:21 <mutante> mw1208 - service hhvm restart [production]
00:42 <ejegg> updated civicrm from 586433b81decb90b80c40acdbfde4548ca67af43 to 31bea5b36fb22792472990672a49e8dea637546c [production]
00:32 <mutante> palladium - removed from DNS [production]
00:30 <mutante> palladium - re-shutdown [production]
2016-10-26 §
23:57 <dereckson@tin> Synchronized docroot/noc/conf/: Update noc.wikimedia.org dblist and config files (duration: 00m 45s) [production]
23:52 <dereckson@tin> Synchronized php-1.28.0-wmf.23/extensions/UploadWizard/resources/details/uw.DateDetailsWidget.js: Unbreak Flickr uploads (T149259) (duration: 00m 48s) [production]
23:46 <madhuvishy> tools reenabled puppet across proxy hosts. /.well-known/healthz now live on tools-proxy T143638 [production]
23:41 <dereckson@tin> Synchronized wmf-config/CommonSettings.php: For $wmgGalleryOptions, use isset() ([[Gerrit:318223]]) (duration: 00m 45s) [production]
23:22 <dereckson@tin> Synchronized wmf-config/CommonSettings.php: Fix for current Undefined variable: wmgGalleryOptions issue (duration: 00m 48s) [production]
23:19 <dereckson@tin> Synchronized wmf-config/CommonSettings.php: Test setting gallery config differently on Beta Cluster enwiki (T141349, 2/2) (duration: 00m 45s) [production]
23:18 <dereckson@tin> Synchronized wmf-config/InitialiseSettings-labs.php: Test setting gallery config differently on Beta Cluster enwiki (T141349, 1/2, no-op in prod) (duration: 00m 49s) [production]
21:08 <hashar> gallium: stopped rsync server [production]
21:02 <jynus> restarting mysql and rebooting db1035 [production]
20:54 <jynus> restarting mariadb on db2011 to test configuration change [production]
20:50 <hashar> syncing /var/lib/jenkins from gallium to contint1001 . rsync server spawned on gallium in a term, contint1001 using rsync --bwlimit=5m --delete --info=progress2 -az rsync://gallium.wikimedia.org/jenkins /var/lib/jenkins [production]
20:49 <Pchelolo> RESTBase deploy e835f9b8 [production]
20:46 <Pchelolo> RESTBase deploy e835f9b8 - canary on restbase1007 [production]
20:43 <arlolra> reverted Parsoid to version 63f1e151 [production]
20:41 <Pchelolo> RESTBase deploy e835f9b8 - staging [production]
20:36 <twentyafterfour@tin> rebuilt wikiversions.php and synchronized wikiversions files: group1 wikis to 1.28.0-wmf.23 [production]
20:31 <arlolra> reverting Parsoid to version 63f1e151 [production]
20:31 <arlolra> updated Parsoid to version ede4353 [production]
20:28 <twentyafterfour@tin> Synchronized php-1.28.0-wmf.23/extensions/GlobalBlocking/: Deploy fix for T149232 to unblock the train refs T147517 (duration: 00m 51s) [production]