4401-4450 of 10000 results (48ms)
2017-02-22 ยง
16:29 <gehel> reimage of relforge1001 starting [production]
16:21 <marostegui> Shutdown db1060 for BBU replacement - T158194 [production]
16:20 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1060 - T158194 (duration: 00m 40s) [production]
16:19 <ema> cp3006 upgraded to varnish 4.1.5 [production]
16:15 <ema> cp4019 upgraded to varnish 4.1.5 [production]
15:48 <moritzm> installing tcpdump security updates on ubuntu systems (jessie already fixed for a while) [production]
15:43 <jynus> stopping mariadb replication on db1026 for maintenance T147747 [production]
15:21 <marostegui> Restart MySQL on db1095 to apply new replication filters - https://phabricator.wikimedia.org/T154485 [production]
15:16 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Depool db1026 for maintenance (duration: 00m 41s) [production]
15:11 <marostegui> Restart MySQL on db1069 to apply new replication filters - https://phabricator.wikimedia.org/T154485 [production]
14:50 <zeljkof> finished EU SWAT [production]
14:49 <zfilipin@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:339172|New throttle rule (T158762)]] (duration: 00m 41s) [production]
14:30 <gehel> resetting to usual values for low/high watermark on elasticsearch eqiad (75% / 80%) [production]
14:17 <hashar> Nuked Jenkins workspaces for the job operations-puppet-typos [production]
14:17 <zfilipin@tin> Synchronized dblists/compact-language-links.dblist: SWAT: [[gerrit:338790|Deploy Compact Language Links in Swedish Wikipedia (T157114)]] (duration: 00m 50s) [production]
14:17 <gehel> temporary raising high/low watermarks on elasticsearch eqiad to allow allocation of all shards [production]
14:04 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic1047.eqiad.wmnet [production]
12:38 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1045 with low load (3rd time a charm) (duration: 00m 39s) [production]
12:22 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1045 with low load (again) (duration: 02m 47s) [production]
12:18 <dcausse> rebuild of translation memories index is done [production]
12:05 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1045 with low load (duration: 02m 49s) [production]
12:03 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic10(45|46).eqiad.wmnet [production]
11:48 <paravoid> upgrading labmon1001 to grafana 4.1 [production]
10:55 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=elastic10(45|46|47).eqiad.wmnet [production]
10:54 <moritzm> upgrading remaining mediawiki servers to HHVM 3.12.14 [production]
10:54 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic10(35|37|39|43|44).eqiad.wmnet [production]
10:42 <elukey> reinstall mw211[89] as MW videoscalers (trusty) and mw2243 as MW jobrunner [production]
10:05 <filippo@tin> Synchronized wmf-config/ProductionServices.php: Move udp2log from fluorine to mwlog1001 - T123728 (duration: 00m 41s) [production]
10:01 <hashar> enabling puppet on contint1001 and running it [production]
09:56 <volans> restarting salt-master on neodymium after openssl upgrade [production]
09:37 <ema> cache_text, cache_upload: libssl1.1 upgraded to 1.1.0e-1+wmf1, libevent-2.0-5 upgraded to 2.0.21-stable-2+deb8u1 [production]
09:28 <hashar> disable puppet on contint1001. Will use contint2001 as a canary [production]
09:14 <marostegui> Run pt-table-checksum on s2.nlwiki over some tables - T154485 [production]
09:04 <dcausse> rebuilding translation memories index - ETA ~4hours (from terbium, logs in ~dcausse/ttm-refresh) [production]
09:02 <gehel@puppetmaster1001> conftool action : set/pooled=no; selector: name=elastic10(35|39|43|44).eqiad.wmnet [production]
08:07 <moritzm> upgrading openssl on redis clusters / various base service restarts [production]
07:44 <gehel> restart elasticsearch on elastic1035 [production]
07:43 <gehel> trncating logs on elastic10(35|39|44) [production]
07:23 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Depool db2062 - T132416 (duration: 00m 40s) [production]
07:23 <marostegui> Deploy alter table enwiki.revision db2062 - T132416 [production]
07:18 <marostegui@tin> Synchronized wmf-config/db-codfw.php: Repool db2055 - T132416 (duration: 00m 40s) [production]
03:10 <l10nupdate@tin> ResourceLoader cache refresh completed at Wed Feb 22 03:10:13 UTC 2017 (duration 5m 46s) [production]
03:04 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.13) (duration: 13m 54s) [production]
02:32 <l10nupdate@tin> scap sync-l10n completed (1.29.0-wmf.12) (duration: 11m 48s) [production]
01:03 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:339090|Enable ORES review tool in cswiki]] T151611 (duration: 00m 39s) [production]
00:48 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:323111|Send "exception" channel to logstash]] [[gerrit:323330|Do not send "exception-json" channel to logstash]] T136849 (duration: 00m 40s) [production]
00:34 <thcipriani@tin> Synchronized wmf-config: SWAT: [[gerrit:324215|Set $wgSoftBlockRanges]] T154698 PART II (duration: 00m 42s) [production]
00:33 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:324215|Set $wgSoftBlockRanges]] T154698 PART I (duration: 00m 40s) [production]
00:20 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings-labs.php: SWAT: [[gerrit:336747|Fix SiteConfiguration array merge syntax]] T157656 [[gerrit:339012|Fix Sentry URL scheme on beta]] [[gerrit:339041|Fix PageViewInfo config]] T158698 (beta-only changes) (duration: 00m 39s) [production]
00:17 <thcipriani@tin> Synchronized php-1.29.0-wmf.12/extensions/WikimediaEvents/modules/ext.wikimediaEvents.searchSatisfaction.js: SWAT: [[gerrit:339010|Turn off sister search AB test.]] T157942 (duration: 00m 39s) [production]