851-900 of 10000 results (44ms)
2017-08-30 §
12:51 <gehel> restart wdqs-updater on wdqs2001 for config change [production]
12:40 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1053 weight - T168661 (duration: 00m 47s) [production]
12:26 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1053 with low weight - T168661 (duration: 00m 46s) [production]
12:05 <marostegui> Upgrade MariaDB to 10.0.32 on db1053 - T168661 [production]
12:05 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1053 - T168661 (duration: 00m 47s) [production]
11:06 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore db1055 original weight - T174265 (duration: 00m 46s) [production]
10:24 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Give db1055 more traffic - T174265 (duration: 00m 47s) [production]
09:49 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Give db1055 more traffic - T174265 (duration: 00m 47s) [production]
09:17 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1059 - T168661 (duration: 00m 47s) [production]
09:07 <elukey> restart all jvm daemons on druid100[123] for security updates [production]
08:51 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Give db1055 more traffic - T174265 (duration: 00m 48s) [production]
08:06 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Give db1055 more traffic - T174265 (duration: 00m 47s) [production]
07:47 <jmm@puppetmaster1001> conftool action : set/pooled=yes; selector: mw1228.eqiad.wmnet [production]
07:47 <marostegui> Upgrade MariaDB on db1059 to 10.0.32 - T168661 [production]
07:44 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1059 for a MariaDB upgrade - T168661 (duration: 00m 53s) [production]
07:14 <moritzm> powering down mw1294 for hardware diagnostics (T1674069 [production]
07:12 <jmm@puppetmaster1001> conftool action : set/pooled=inactive; selector: mw1294.eqiad.wmnet [production]
07:12 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Slowly repool db1055 - T174265 (duration: 00m 52s) [production]
03:16 <l10nupdate@tin> ResourceLoader cache refresh completed at Wed Aug 30 03:16:09 UTC 2017 (duration 7m 19s) [production]
03:08 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.16) (duration: 15m 42s) [production]
02:32 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.15) (duration: 08m 28s) [production]
02:17 <demon@tin> Finished deploy [gerrit/gerrit@f33c63f]: Testing, no-op (duration: 00m 07s) [production]
02:17 <demon@tin> Started deploy [gerrit/gerrit@f33c63f]: Testing, no-op [production]
01:27 <demon@tin> Synchronized wmf-config/InitialiseSettings.php: remove education program from legalteamwiki (duration: 00m 47s) [production]
00:53 <demon@tin> Synchronized wmf-config/flaggedrevs.php: killing FR on testwiki (duration: 00m 46s) [production]
00:52 <demon@tin> Synchronized dblists/flaggedrevs.dblist: killing FR on testwiki (duration: 00m 47s) [production]
00:05 <cwd> turned dedupe off [production]
2017-08-29 §
23:50 <cmjohnson1> reinstalling mw1228 [production]
23:34 <demon@tin> Synchronized php-1.30.0-wmf.15/extensions/Popups/: swat (duration: 00m 47s) [production]
23:33 <demon@tin> Synchronized php-1.30.0-wmf.16/extensions/Popups/: swat (duration: 00m 50s) [production]
21:33 <urandom> T169939: Decommission Cassandra: restbase1008-c.eqiad.wmnet [production]
21:16 <andrewbogott> restarting designate-sink on labservices1001 [production]
21:01 <ejegg> updated DjangoBannerStats from 5963e7c116f083ada28476c1c41ff1b46232d772 to ce95eab3514a2cd989f090598e01686efba72386 [production]
20:56 <ejegg> updated payments-wiki from 58d33b837167f14dc9388c8d3acc0281b012932f to bf97cd236bdec421082db8a8a782965de9c98358 [production]
20:49 <godog> bounce varnish on cp1074 / cp1099 / cp1072 - mailbox lag [production]
20:38 <ppchelko@tin> Finished deploy [changeprop/deploy@a57c79d]: Release a redis-based deduplicator in test mode. Attempt 2 (duration: 01m 17s) [production]
20:37 <ppchelko@tin> Started deploy [changeprop/deploy@a57c79d]: Release a redis-based deduplicator in test mode. Attempt 2 [production]
20:36 <ppchelko@tin> Finished deploy [changeprop/deploy@ed0fadc]: Release a redis-based deduplicator in test mode (duration: 04m 28s) [production]
20:31 <ppchelko@tin> Started deploy [changeprop/deploy@ed0fadc]: Release a redis-based deduplicator in test mode [production]
19:47 <urandom> T169939: Decommission Cassandra: restbase1008-b.eqiad.wmnet [production]
19:34 <ottomata> restarting all kafka brokers and mirror maker processes to apply https://gerrit.wikimedia.org/r/#/c/374610/ [production]
19:12 <demon@tin> rebuilt wikiversions.php and synchronized wikiversions files: group0 to wmf.16 [production]
19:08 <ppchelko@tin> Finished deploy [restbase/deploy@7f2e55f]: Update CXServer endpoints config (duration: 06m 48s) [production]
19:02 <ottomata> restarting main-eqiad -> analytics kafka mirror maker processes on analytics kafka brokers, something is not working... [production]
19:01 <XenoRyet> updated Smashpig from 98c55161deffed8364043a27089e7d47cddc3059 to 8f4388d407f313c1083cf96ed106efcc5d5a29f7 [production]
19:01 <ppchelko@tin> Started deploy [restbase/deploy@7f2e55f]: Update CXServer endpoints config [production]
18:19 <robh> attempting firmware upgrade on scs-a8-eqiad [production]
18:17 <Pchelolo> depooling restbase1008,1009,1010,2003,2005 while cluster reshaping is going on [production]
18:15 <demon@tin> Finished scap: bootstrap wmf.16 (duration: 45m 27s) [production]
18:15 <urandom> T169939: Decommission Cassandra: restbase1008-a.eqiad.wmnet [production]