5551-5600 of 10000 results (61ms)
2018-02-05 §
18:35 <elukey> add 'ulimit -c unlimited' to /etc/default/apache2 to see if httpd's CoreDumpDirectory works properly on phab1001 [production]
18:35 <mutante> welcome new root shell user bstorm [production]
18:31 <mutante> added bstorm to the 'wmf' and 'ops' LDAP groups (modify-ldap-groups on terbium) (T185493) [production]
18:30 <ppchelko@tin> Finished deploy [restbase/deploy@55e9d87]: Enable ensure_content_type filter for mobile content (duration: 12m 04s) [production]
18:18 <ppchelko@tin> Started deploy [restbase/deploy@55e9d87]: Enable ensure_content_type filter for mobile content [production]
18:07 <gehel@tin> Finished deploy [wdqs/wdqs@d7eb899]: wdqs blazegraph + gui + updater upgrade (duration: 02m 36s) [production]
18:04 <gehel@tin> Started deploy [wdqs/wdqs@d7eb899]: wdqs blazegraph + gui + updater upgrade [production]
17:52 <ejegg> updated payments-wiki from 341cb573a1 to 39a7ef32e5 [production]
17:38 <mholloway-shell@tin> Finished deploy [mobileapps/deploy@d970b61]: Update mobileapps to 7a9fab3 (duration: 05m 45s) [production]
17:32 <mholloway-shell@tin> Started deploy [mobileapps/deploy@d970b61]: Update mobileapps to 7a9fab3 [production]
16:10 <marostegui> Renaming wikidata tables on s5 on eqiad - T184599 [production]
16:03 <marostegui> Renaming wikidata tables on s5 on codfw - T184599 [production]
15:54 <mholloway-shell@tin> Finished deploy [mobileapps/deploy@c9c774e]: Update mobileapps to 1411ccb (duration: 06m 06s) [production]
15:48 <mholloway-shell@tin> Started deploy [mobileapps/deploy@c9c774e]: Update mobileapps to 1411ccb [production]
15:26 <elukey> temporary setting CoreDumpDirectory /srv/apache2_dump to httpd on phab1001 (+ httpd reload) to investigate core dumps for T182832 [production]
14:46 <hashar> European SWAT completed. I have not deployed matmarex patches to change Abkhaz collation ( https://gerrit.wikimedia.org/r/#/c/406185/ https://gerrit.wikimedia.org/r/#/c/406187/ ) [production]
14:41 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: Enable ArticlePlaceholder for Estonian Wikipedia (etwiki) - T186107 (duration: 00m 55s) [production]
14:35 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: Set wgNamespaceRobotPolicies on ptwiki's NS_USER to noindex - T185660 (duration: 00m 55s) [production]
14:31 <hashar@tin> Synchronized wmf-config/throttle.php: Add throttle rules - T185794 T185811 (duration: 00m 55s) [production]
14:24 <hashar@tin> Synchronized php-1.31.0-wmf.17/extensions/Flow/includes/Import/OptInController.php: OptInController catch both errors and exception - T184670 (duration: 00m 55s) [production]
14:22 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: Fix typo in arwikibooks rollbacker group - T185720 (duration: 00m 56s) [production]
14:14 <hashar@tin> Synchronized wmf-config/throttle.php: Add throttle rule for an event - T185930 (duration: 00m 55s) [production]
14:11 <hashar@tin> Synchronized wmf-config/InitialiseSettings.php: Add 'rollbacker' group at arwikibooks - T185720 (duration: 00m 56s) [production]
13:20 <marostegui> Rename dewiki tables on s8 master (db1071 - with no replication) before dropping them - T184599 [production]
12:20 <marostegui> Drop empty wikidata database from s5 master (db1070) - T184599 [production]
12:17 <marostegui> Drop old and renamed wikidata tables from s5 master (db1070) - T184599 [production]
11:30 <godog> expand smart metrics checking rollout with https://gerrit.wikimedia.org/r/#/c/403621/ [production]
11:21 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Clarify db1078 comment as it is the new candidate master for s3 (duration: 00m 55s) [production]
11:04 <hashar> Upgraded jenkins-debian-glue to 0.18.4-wmf1 | T186494 [production]
11:03 <elukey> restart eventlogging/forwarder legacy-zmq on eventlog1001 due to slow memory leak over time (cached memory down to zero) [production]
10:13 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Fully repool db1078 (duration: 00m 55s) [production]
09:55 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1078 traffic (duration: 00m 55s) [production]
09:38 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1078 traffic - T186321 (duration: 00m 55s) [production]
09:28 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1078 with low traffic - T186321 (duration: 00m 53s) [production]
08:44 <marostegui> Stop MySQL on db1078, upgrade mariadb, kernel and socket location - T186321 [production]
08:30 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1078 - T186321 (duration: 00m 55s) [production]
08:17 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1089 - T162807 (duration: 00m 56s) [production]
07:45 <marostegui> Deploy schema change on s8 primary master (db1071) - T174569 [production]
07:43 <elukey> install libjson-c2-dbg on phab1001 to allow better debugging of httpd/mod-php stuck process - T182832 [production]
02:30 <l10nupdate@tin> scap sync-l10n completed (1.31.0-wmf.17) (duration: 06m 03s) [production]
2018-02-04 §
22:40 <elukey> restart aphlict.service on phab1001 to force it to pick up the new logfile (/var/log/aphlict/aphlict.log rather than the .log.1) [production]
06:18 <_joe_> reduced raid resync speed on conf2* to 5000 KB/s [production]
04:33 <_joe_> restarted etcdmirror on conf2002, failure caused by raid resyncs in codfw [production]
2018-02-03 §
03:55 <legoktm> restarting zuul to drop 407165,3 from the queue [production]
2018-02-02 §
23:40 <no_justification> gerrit: one last restart to try and force gerrit/phab session restart [production]
22:42 <jynus> reloading m2 dbproxy [production]
22:08 <no_justification> cobalt/gerrit2001: purged libbcprov-java libbcpkix-java, cleaned up old symlinks [production]
21:45 <demon@tin> Finished deploy [gerrit/gerrit@98f5d9a]: Gerrit 2.14.6 (duration: 00m 14s) [production]
21:45 <demon@tin> Started deploy [gerrit/gerrit@98f5d9a]: Gerrit 2.14.6 [production]
21:42 <no_justification> cobalt: disabling puppet so it doesn't restart gerrit [production]