1151-1200 of 10000 results (47ms)
2018-05-14 §
16:19 <elukey> umount/remount /mnt/hdfs on stat1005 to pick up new openjdk upgrades [production]
15:11 <jynus> stop db2064 for reimage [production]
14:56 <marostegui> Drop unused table long_run_profiling from enwiki - T194661 [production]
14:45 <moritzm> rebooting labtestnet2002 for some microcode/kernel tests [production]
14:44 <mobrovac@tin> Finished deploy [restbase/deploy@75dc661]: API: Add /transform/list/tool/{tool}{/from}{/to}, take #2 (duration: 03m 58s) [production]
14:40 <mobrovac@tin> Started deploy [restbase/deploy@75dc661]: API: Add /transform/list/tool/{tool}{/from}{/to}, take #2 [production]
14:39 <mobrovac@tin> Finished deploy [restbase/deploy@75dc661]: API: Add /transform/list/tool/{tool}{/from}{/to} - T163203 (duration: 23m 35s) [production]
14:30 <milimetric@tin> Finished deploy [analytics/refinery@541823e]: deploying refinery to update python logic for cron jobs (duration: 19m 46s) [production]
14:30 <otto@tin> Finished deploy [analytics/turnilo/deploy@9b2c8f0]: initial deploy (duration: 00m 28s) [production]
14:29 <otto@tin> Started deploy [analytics/turnilo/deploy@9b2c8f0]: initial deploy [production]
14:19 <moritzm> rebooting silver for some microcode/kernel tests [production]
14:15 <mobrovac@tin> Started deploy [restbase/deploy@75dc661]: API: Add /transform/list/tool/{tool}{/from}{/to} - T163203 [production]
14:10 <milimetric@tin> Started deploy [analytics/refinery@541823e]: deploying refinery to update python logic for cron jobs [production]
13:58 <herron> added temporary iptables drop rules on fermium for IPs with many hits logged against the list subscribe rate limit [production]
13:53 <reedy@tin> Synchronized php-1.32.0-wmf.3/extensions/CirrusSearch: Partially revert deprecation of global namespace handling in prefix (duration: 01m 20s) [production]
13:50 <reedy@tin> Synchronized wmf-config/throttle.php: T194630 (duration: 01m 02s) [production]
13:41 <jynus> stop db2063 for reimage [production]
13:18 <marostegui> Deploy schema change on dbstore1002:s7 - T191519 T188299 T190148 [production]
13:08 <akosiaris> remove ganeti2003, ganeti2007 from the ganeti cluster. stretch reimaging in progress [production]
13:06 <akosiaris> reboot ganeti2008 for kernel ugprade [production]
12:38 <kartik@tin> Finished deploy [cxserver/deploy@a7ef01b]: Update cxserver to 176b507 (duration: 03m 26s) [production]
12:35 <kartik@tin> Started deploy [cxserver/deploy@a7ef01b]: Update cxserver to 176b507 [production]
11:23 <akosiaris> upload apertium-streamparser to apt.wikimedia.org/jessie-wikimedia/main T192978 [production]
10:17 <moritzm> installing systemd updates from stretch SUA update [production]
09:41 <moritzm> installing gunicorn security updates [production]
09:28 <moritzm> installing ghostscript security updates on trusty [production]
09:23 <moritzm> installing libmad security updates [production]
09:11 <moritzm> installing wavpack security updates for stretch (jessie/trusty not affected) [production]
08:41 <moritzm> uploaded HHVM 3.18.5+dfsg-1+wmf8+deb9u1 to apt.wikimedia.org [production]
07:57 <marostegui> Deploy schema change on s7 codfw master (db2040) with replication, this will generate lag on codfw - T191519 T188299 T190148 [production]
07:55 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1091 after alter table (duration: 01m 02s) [production]
06:38 <elukey> rolling restart of cassandra on aqs* for openjdk-8 upgrades [production]
06:35 <moritzm> installing wget security updates on trusty (Debian already fixed) [production]
06:16 <marostegui> Drop unused flaggedrevs from s3 testwiki - T174801 [production]
05:22 <marostegui> Deploy schema change on db1091 - T191519 T188299 T190148 [production]
05:22 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1091 for alter table (duration: 01m 03s) [production]
03:18 <l10nupdate@tin> ResourceLoader cache refresh completed at Mon May 14 03:18:25 UTC 2018 (duration 7m 25s) [production]
03:11 <l10nupdate@tin> scap sync-l10n completed (1.32.0-wmf.3) (duration: 16m 20s) [production]
2018-05-13 §
21:10 <bawolff> Reset some botpasswords associated with T194204 [production]
20:09 <bawolff> Deployed patch for T194605 [production]
2018-05-12 §
06:50 <foks> rm 2FA from User:Fatemi (at 6:38 PM UTC, Friday May 11) [production]
2018-05-11 §
21:28 <herron> updated lists rate limit to 1 subscribe per 60 minutes as a temporary measure until problem requests slow down T194032 [production]
20:59 <herron> deployed rate limiting for POST requests to mailman list subscription URIs https://gerrit.wikimedia.org/r/432168 T194032 [production]
20:27 <chasemp> temp changes on fermium for T194032 [production]
19:26 <chasemp> on fermium [production]
19:26 <chasemp> disable puppet and temp block a few IPs I believe are bad actors hammering mailman [production]
18:21 <chasemp> change 'Advertise this list when people ask what lists are on this machine' to no for cloud-admin-l and cloud-admin-feed [production]
17:21 <jynus@tin> Synchronized wmf-config/db-eqiad.php: Repool db1076 with full weight (duration: 01m 02s) [production]
16:26 <jynus> restarting mariadb@s8 at dbstore2001 [production]
16:20 <jynus> removing x1 from dbstore2001 [production]