4001-4050 of 10000 results (51ms)
2018-02-13 §
09:52 <filippo@neodymium> conftool action : set/pooled=no; selector: name=ms-fe2005.codfw.wmnet [production]
09:49 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2075, depool db2038 and db2059 (duration: 00m 55s) [production]
09:32 <marostegui> Stop mysql on db2075 for mysql and kernel upgrade [production]
09:30 <marostegui> Stop replication in sync on db1089 and dbstore1002 - T162807 [production]
09:29 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1065 - T162807 (duration: 00m 54s) [production]
09:22 <elukey> powercycle analytics1062 - not reachable via ssh, frozen via serial console [production]
09:22 <jynus> disabling puppet on all eqiad databases [production]
09:20 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1065 - T162807 (duration: 00m 55s) [production]
09:20 <marostegui> Stop replication in sync on db1089 and db1065 - T162807 [production]
09:12 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2084:3315, depool db2075 (duration: 00m 55s) [production]
09:01 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1099:3311 - T162807 (duration: 00m 55s) [production]
08:52 <marostegui> Stop replication in sync on db1089 and db1099:3311 - T162807 [production]
08:51 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1089, db1099 - T162807 (duration: 00m 55s) [production]
08:41 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2084:3315 (duration: 00m 56s) [production]
08:37 <hashar> tin.eqiad.wmnet: removing live hack in /srv/mediawiki-staging/scap/plugins/clean.py | T187160 [production]
08:32 <moritzm> installing wavpack security updates [production]
08:09 <moritzm> installing exim security updates on trusty hosts [production]
07:02 <marostegui> Deploy schema change on s5 db2089 db2084 db2075 db2039 db2059 - T187089 [production]
06:28 <marostegui> reload haproxy on dbproxy1005 [production]
05:10 <bblack@neodymium> conftool action : set/pooled=yes; selector: name=cp50(0[12345789]|1[12]).eqsin.wmnet [production]
02:34 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.20) (duration: 05m 29s) [production]
00:24 <cwd> re-enabled p-c [production]
00:16 <demon@tin> Synchronized php-1.31.0-wmf.20/extensions/VisualEditor/modules/ve-mw/ui/pages/: T187112 (duration: 00m 56s) [production]
00:10 <cwd> disabled p-c jobs for reboot [production]
00:04 <demon@tin> Synchronized wmf-config/: cleanup Sentry inclusion for labs, should be no-op (duration: 00m 57s) [production]
00:03 <demon@tin> Synchronized wmf-config/InitialiseSettings.php: cleanup Sentry inclusion for labs, should be no-op (duration: 00m 56s) [production]
2018-02-12 §
23:47 <demon@tin> Finished deploy [gerrit/gerrit@6adde70]: reviewers plugin (duration: 00m 12s) [production]
23:46 <demon@tin> Started deploy [gerrit/gerrit@6adde70]: reviewers plugin [production]
23:32 <mutante> terbium,wasat: touch /var/log/mediawwiki/purge_abusefilter.log ; set owner/permissions like other logfiles [production]
23:13 <elukey> manual restart of Yarn Node Managers on analytics1058/31 (failed due to root partition filled up for the issue logged before) [production]
23:09 <elukey> cleaned up tmp files on all analytics hadoop worker nodes, job filling up tmp [production]
21:27 <andrew@tin> Finished deploy [horizon/deploy@2f70002]: updating several submodules, probably breaking static content (duration: 03m 18s) [production]
21:24 <andrew@tin> Started deploy [horizon/deploy@2f70002]: updating several submodules, probably breaking static content [production]
21:06 <mholloway-shell@tin> Finished deploy [mobileapps/deploy@0639c31]: Update mobileapps to f14bdd5 (duration: 05m 46s) [production]
21:00 <mholloway-shell@tin> Started deploy [mobileapps/deploy@0639c31]: Update mobileapps to f14bdd5 [production]
20:21 <andrew@tin> Finished deploy [horizon/deploy@c009388]: updating puppet dashboard (duration: 03m 22s) [production]
20:17 <andrew@tin> Started deploy [horizon/deploy@c009388]: updating puppet dashboard [production]
20:12 <demon@tin> Synchronized php-1.31.0-wmf.20/extensions/Flow/includes/Model/UUID.php: T186909 (duration: 00m 56s) [production]
20:08 <andrew@tin> Finished deploy [horizon/deploy@cba66d2]: more submodule tinkering (duration: 01m 15s) [production]
20:07 <ppchelko@tin> Finished deploy [restbase/deploy@b257b4f]: Support batching in the reading lists API (duration: 15m 10s) [production]
20:07 <andrew@tin> Started deploy [horizon/deploy@cba66d2]: more submodule tinkering [production]
20:01 <andrew@tin> Finished deploy [horizon/deploy@1fcd9ff]: fixes to post-install checks (duration: 01m 02s) [production]
20:00 <andrew@tin> Started deploy [horizon/deploy@1fcd9ff]: fixes to post-install checks [production]
19:58 <andrew@tin> Finished deploy [horizon/deploy@9d73005]: fixes to post-isntall checks (duration: 01m 01s) [production]
19:57 <andrew@tin> Started deploy [horizon/deploy@9d73005]: fixes to post-isntall checks [production]
19:52 <ppchelko@tin> Started deploy [restbase/deploy@b257b4f]: Support batching in the reading lists API [production]
19:50 <andrew@tin> Finished deploy [horizon/deploy@8cf0c3c]: updating with sudo dashboard fixes -- take two (duration: 00m 45s) [production]
19:50 <andrew@tin> Started deploy [horizon/deploy@8cf0c3c]: updating with sudo dashboard fixes -- take two [production]
19:48 <andrew@tin> Finished deploy [horizon/deploy@8cf0c3c]: updating with sudo dashboard fixes -- take two (duration: 00m 03s) [production]
19:47 <andrew@tin> Started deploy [horizon/deploy@8cf0c3c]: updating with sudo dashboard fixes -- take two [production]