2951-3000 of 10000 results (35ms)
2017-12-05 §
15:03 <urandom> bootstrapping cassandra, restbase1014-c - T179422 [production]
14:54 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool db1076 (duration: 00m 43s) [production]
14:41 <zeljkof> EU SWAT finished [production]
14:40 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:395540|Revert "Add category collation for sewiki" (T181503)]] (duration: 00m 44s) [production]
14:15 <zfilipin@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:395009|Enable RemexHTML on itwiki and dewiki (T181188 T181190)]] (duration: 00m 43s) [production]
13:39 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1076 weight (duration: 00m 44s) [production]
13:14 <moritzm> reimaging mw2118/mw2119 (video scalers) to stretch [production]
12:21 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool db1034 (duration: 00m 43s) [production]
12:18 <hashar> deployment-videoscaler01: rm /var/log/hhvm/* /var/log/apache2/* . Restarted apache2/hhvm/syslog [releng]
12:16 <hashar> integration: sudo cumin --force '*' 'apt-get clean' [releng]
12:16 <hashar> deployment-prep: sudo cumin --force '*' 'apt-get clean' [releng]
12:15 <hashar> deployment-videoscaler01: apt-get clean to free up disk space [releng]
12:13 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1076 with low weight (duration: 00m 44s) [production]
11:58 <marostegui> Upgrade MariaDB and kernel on db1076 [production]
11:53 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1034 - T178359! (duration: 00m 43s) [production]
10:53 <moritzm> rebooting meitnerium/archiva.wikimedia.org for update to 4.9.51 [production]
10:46 <moritzm> rebooting einsteinium (icinga.wikimedia.org) for update to 4.9,51 [production]
10:45 <elukey> reboot druid1003 for kernel+jvm updates - T179943 [production]
10:35 <elukey> re-enable webrequest bundle and camus after reboots [analytics]
10:33 <addshore@tin> Synchronized wmf-config/extension-list: [[gerrit:394283|extension-list extension.json entrypoint for ArticlePlaceholder]] (duration: 00m 43s) [production]
10:33 <moritzm> rebooting tegmen for update to 4.9,51 [production]
10:31 <elukey> disabled druid middlemanager on druid1003 with curl -X POST http://druid1003.eqiad.wmnet:8091/druid/worker/v1/disable [analytics]
10:07 <jynus> stopping dbstore1002 (s5) and dbstore2001 (s5) for maintenance [production]
10:05 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase traffic for db1034 - T178359! (duration: 00m 43s) [production]
10:03 <elukey> stop camus as precautionary measure before Hadoop masters reboot [analytics]
10:00 <ema> cp4021: restart varnish-be due to mbox lag/fetch failures [production]
09:57 <elukey> suspend webrequest load bundle as extra precaution before Hadoop masters reboot [analytics]
09:49 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1034 with low weight - T178359! (duration: 00m 43s) [production]
09:42 <elukey> reboot analytics100[12] for kernel+jvm updates (Hadoop Master nodes) - T179943 [production]
09:39 <godog> bootstrap restbase1014-b - T179422 [production]
09:20 <marostegui> Optimize s7 on db1098 - T178359 [production]
09:03 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1076 - T174569 (duration: 00m 43s) [production]
09:01 <marostegui> Deploy schema change on db1076 (s2) - T174569 [production]
08:57 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1090 - T174569 (duration: 00m 44s) [production]
08:54 <moritzm> enabling test production traffic for mw1259 (stretch-based video scaler) [production]
08:51 <hashar> jenkins: adding global property FORCE_COLOR=1 to https://integration.wikimedia.org/ci/configure . That forces webdriver.io to spurts color in the Jenkins console when not using a TTY [releng]
08:24 <jmm@puppetmaster1001> conftool action : set/pooled=yes; selector: mw1259.eqiad.wmnet [production]
08:08 <moritzm> installing python updates on trusty [production]
07:27 <kartik@tin> Finished deploy [cxserver/deploy@4b74f03]: Update cxserver to 1693bcf (duration: 03m 22s) [production]
07:23 <kartik@tin> Started deploy [cxserver/deploy@4b74f03]: Update cxserver to 1693bcf [production]
06:58 <marostegui> Stop MySQL on db1034 to clone db1098:3317 - T178359 [production]
06:55 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1034 - T178359! (duration: 00m 43s) [production]
06:48 <marostegui> Fix dbstore1002 replication [production]
06:37 <kart_> Updated cxserver to 1693bcf [releng]
06:20 <marostegui> Deploy schema change on db1090 (s2) - T174569 [production]
06:20 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1090 - T174569 (duration: 00m 43s) [production]
06:15 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1103:3312 - T174569 (duration: 00m 44s) [production]
02:29 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.10) (duration: 06m 36s) [production]
00:29 <mutante> bast4001 - removing ganglia aggregators, package, config... [production]
2017-12-04 §
23:44 <mutante> bast3002 - killall -u ganglia to kill all aggregator procs, apt-get remove --purge ganglia-monitor, rm -rf /etc/ganglia, rm -rf /usr/lib/ganglia, apt-get autoremove [production]