951-1000 of 10000 results (36ms)
2017-05-04 ยง
14:43 <oblivian:> Setting restbase in codfw DOWN [production]
14:43 <_joe_> forcing a puppet run on cache (text,maps, misc) in eqiad/codfw to complete the switchback [production]
14:40 <oblivian:> Setting restbase in eqiad UP [production]
14:39 <oblivian:> Setting restbase-async in codfw UP [production]
14:36 <moritzm> installing mysql-connector-java security updates on hadoop cluster [production]
14:35 <_joe_> running puppet on varnishes in eqiad (text,misc,maps) to pick up the a/a traffic to services [production]
14:29 <jynus> dropping and recreating user for maintain-views on labsdb1001 T164103 [production]
14:24 <marostegui@naos> Synchronized wmf-config/db-eqiad.php: Increase db1070 weight - T160392 (duration: 01m 10s) [production]
14:23 <chasemp> maintain-meta_p --databases dtywiki,pawikisource,ptwikimedia,wbwikimedia --debug labsdb1003 for T164103 [production]
14:16 <chasemp> maintain-meta_p --all-databases --purge --debug labsdb1001 for T164103 [production]
14:09 <marostegui@naos> Synchronized wmf-config/db-eqiad.php: Repool db1070 with less weight - T160392 (duration: 01m 16s) [production]
14:03 <chasemp> maintain-meta_p --all-databases --purge --debug labsdb1009/1010/1011 for T164103 [production]
13:31 <gehel> restart services on maps eqiad [production]
13:21 <dereckson@naos> Synchronized wmf-config/throttle.php: Lift Account registration limit for cywiki for an event / T164482 (duration: 01m 08s) [production]
13:18 <gehel> restart services on maps codfw [production]
13:15 <gehel> restart services on maps-test [production]
12:42 <marostegui> Stop MySQL db1070 for maintenance - T160392 [production]
12:40 <marostegui@naos> Synchronized wmf-config/db-eqiad.php: Depool db1070 for maintenance - T160392 (duration: 01m 35s) [production]
12:28 <marostegui> Deploy alter table enwiki.revision on dbstore1001 - T132416 [production]
11:56 <moritzm> installing mysql-connector-java security updates [production]
11:45 <ema> starting cache_text upgrades to varnish 4.1.6-1wm1 [production]
11:38 <marostegui@naos> Synchronized wmf-config/db-eqiad.php: Remove db1022 from config files as it will be decommissioned - T163778 (duration: 01m 06s) [production]
11:36 <marostegui@naos> Synchronized wmf-config/db-codfw.php: Remove db1022 from config files as it will be decommissioned - T163778 (duration: 01m 25s) [production]
10:48 <moritzm> installing tomcat security updates [production]
10:22 <elukey> executed DEL ocg_job_status on rdb1007:6379 (new ocg_job_status hash is stored on the ocg* hosts) - T159850 [production]
10:11 <moritzm> restarting hhvm on mediawiki canaries to pick up freetype security update [production]
10:05 <ema> restart varnish-be on cp2024 without RT experiment [production]
09:40 <elukey> stop kafka on kafka1012 and reboot the host for kernel upgrade [production]
09:16 <joal@naos> Finished deploy [analytics/refinery@9d35029]: (no justification provided) (duration: 02m 58s) [production]
09:13 <joal@naos> Started deploy [analytics/refinery@9d35029]: (no justification provided) [production]
08:50 <marostegui@naos> Synchronized wmf-config/db-codfw.php: Remove db1040 from config files as it will be decommissioned - T164057 (duration: 00m 48s) [production]
08:49 <marostegui@naos> Synchronized wmf-config/db-eqiad.php: Remove db1040 from config files as it will be decommissioned - T164057 (duration: 00m 55s) [production]
08:23 <gehel> restart elasticsearch on relforge for JDK update [production]
07:59 <marostegui@naos> Synchronized wmf-config/db-eqiad.php: Remove tempdb2001 from config files as it will be decommissioned - T161712 (duration: 01m 07s) [production]
07:58 <marostegui@naos> Synchronized wmf-config/db-codfw.php: Remove tempdb2001 from config files as it will be decommissioned - T161712 (duration: 01m 25s) [production]
07:25 <_joe_> restarted cp3043 backend varnish at 7:13 UTC while trying to debug issues [production]
06:58 <moritzm> installing freetype security updates [production]
06:26 <marostegui@naos> Synchronized wmf-config/db-codfw.php: Depool tempdb2001, no longer needed - T161712 (duration: 01m 08s) [production]
06:17 <marostegui> Stop MySQL on tempdb2001 to take a backup and prepare to decomission - T161712 [production]
06:10 <marostegui> Deploy alter table on wikidatawiki.wb_terms - db2066 - T162539 T163548 [production]
06:10 <marostegui@naos> Synchronized wmf-config/db-codfw.php: Depool db2066 - T162539 T163548 (duration: 01m 25s) [production]
06:09 <Dereckson> CentralAuth: Removed MediaWiki 2FA for Alexsh (T164265) [production]
06:03 <marostegui> Deploy alter table on wikidatawiki.wb_terms - dbstore2002 - T162539 T163548 [production]
02:31 <l10nupdate@naos> ResourceLoader cache refresh completed at Thu May 4 02:31:22 UTC 2017 (duration 5m 21s) [production]
02:26 <l10nupdate@naos> scap sync-l10n completed (1.29.0-wmf.21) (duration: 08m 02s) [production]
02:08 <mobrovac@naos> Finished deploy [restbase/deploy@4d04dfd]: blacklist dewiki page, take 3a (duration: 08m 37s) [production]
02:00 <urandom> T160759: lowering tombstone threshold to 1000 on all eqiad nodes [production]
01:59 <mobrovac@naos> Started deploy [restbase/deploy@4d04dfd]: blacklist dewiki page, take 3a [production]
01:58 <mobrovac@naos> Finished deploy [restbase/deploy@4d04dfd]: blacklist dewiki page, take 3 (duration: 03m 29s) [production]
01:54 <mobrovac@naos> Started deploy [restbase/deploy@4d04dfd]: blacklist dewiki page, take 3 [production]