7251-7300 of 10000 results (71ms)
2019-04-03 ยง
15:00 <anomie@mwmaint1002> Fixing empty values for 'target_author_actor' in log_search on remaining section 3 wikis for T215525 [production]
15:00 <anomie@mwmaint1002> Fixing empty values for 'target_author_actor' in log_search on section 2 wikis for T215525 [production]
14:59 <anomie@mwmaint1002> Fixing empty values for 'target_author_actor' in log_search on section 1 wikis for T215525 [production]
14:56 <anomie@deploy1001> Synchronized php-1.33.0-wmf.24/maintenance/includes/MigrateActors.php: Backporting fix from [[gerrit:500754]] (duration: 01m 01s) [production]
14:55 <anomie@deploy1001> Synchronized php-1.33.0-wmf.23/maintenance/includes/MigrateActors.php: Backporting fix from [[gerrit:500754]] (duration: 01m 01s) [production]
14:18 <marostegui> Stop replication on pc2007 for testing - T210725 [production]
14:03 <andrewbogott> restarting rabbitmq on cloudcontrol1003 [production]
13:59 <andrewbogott> restarting neutron-l3-agent on cloudnet1003 and cloudnet1004 [production]
13:46 <andrewbogott> restarting neutron-metadata-agent on cloudnet1003 [production]
13:44 <gilles@deploy1001> Synchronized php-1.33.0-wmf.23/includes/media/MediaTransformOutput.php: T216499 Identify images that should have had high importance (duration: 00m 59s) [production]
13:34 <moritzm> reverting dbmonitor2001 to deb8u12+wmf1 build [production]
13:02 <gehel@cumin2001> END (FAIL) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=99) [production]
13:01 <gehel@cumin2001> START - Cookbook sre.elasticsearch.rolling-reboot [production]
12:49 <gehel@cumin2001> END (FAIL) - Cookbook sre.elasticsearch.rolling-reboot (exit_code=99) [production]
12:45 <gehel@cumin2001> START - Cookbook sre.elasticsearch.rolling-reboot [production]
12:42 <arturo> T219626 reimaging cloudcontrol2001-dev [production]
12:31 <mutante> restarting gerrit service to apply change 498431 [production]
11:25 <Amir1> EU SWAT is done [production]
11:16 <jbond42> rolling security updates for apache [production]
10:29 <mutante> planet1001/2001 - apt autoremove un-required packages [production]
10:27 <mutante> planet1001/2001 - upgrade apache2, openssh, locales, rsyslog .. [production]
10:25 <arturo> updating puppet compiler facts [production]
10:19 <volans> upgraded spicerack to 0.0.21 on cumin[12]001 [production]
10:17 <volans> uploaded spicerack_0.0.21-1_amd64.deb to apt.wikimedia.org stretch-wikimedia [production]
09:56 <marostegui> Alter empty job table on s6 primary master - T219887 [production]
09:55 <moritzm> upgrading beta to hhvm wikidiff 1.8.1 (T203069) [production]
09:54 <mutante> running mysql select queries on m3-slave to get data from phabricator conpherence as requested by andre [production]
09:45 <moritzm> removed labtestnet2003.codfw.wmnet from debmonitor (T219776) [production]
09:29 <ema> cp-ats-codfw: test ATS rolling restart T213263 [production]
09:27 <marostegui> Drop wikishared.wikimedia_editor_tasks_entity_description_exists table from x1 T219963 [production]
09:27 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool s8 sanitarium master (duration: 00m 56s) [production]
09:26 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Repool s8 sanitarium master (duration: 01m 00s) [production]
08:35 <jynus> merging change on network constants (firewall operation) [production]
08:23 <marostegui> Restart mysql on sanitarium hosts db1124 db1125 db2094 db2095 - T218302 [production]
08:18 <marostegui> Stop replication on db2082 and db1087 (s8 sanitarium masters) T218302 [production]
08:17 <marostegui@deploy1001> Synchronized wmf-config/db-codfw.php: Depool s8 sanitarium master (duration: 00m 57s) [production]
08:16 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool s8 sanitarium master (duration: 00m 58s) [production]
08:09 <moritzm> installing new apache packages on mmw1261 [production]
07:53 <gilles@deploy1001> Synchronized php-1.33.0-wmf.24/includes/media/ThumbnailImage.php: T216499 Only apply high priority hint half the time (duration: 00m 58s) [production]
07:51 <moritzm> installing new apache packages on mwdebug [production]
07:42 <marostegui> Reboot db1115 - tendril and dbtree will be down [production]
07:40 <marostegui> DIsable event scheduler on db1115 before restarting - tendril is stuck [production]
07:26 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1120 T219493 (duration: 00m 57s) [production]
07:25 <marostegui> Deploy schema change on db1073, labtestwiki - T219887 [production]
07:09 <marostegui> Stop replication in sync on db1120 and db2034 (x1 codfw master) - T219493 [production]
07:07 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1120 T219493 (duration: 01m 13s) [production]
06:04 <_joe_> restart varnish backend on cp1085, causing unavailability [production]
05:57 <marostegui> Fix data drifts on bnwikisource on x1 - T219493 [production]
05:31 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool pc1007 (duration: 00m 59s) [production]
05:23 <marostegui> Upgrade pc1007 [production]