3651-3700 of 10000 results (58ms)
2017-05-24 §
16:58 <moritzm> installing ghostscript regression update on trusty (jessie security update was not affected) [production]
16:56 <jynus> restarting and upgrading db2047 [production]
16:54 <volans> pause slowly upgrading facter across the fleet, resuming tomorrow T166203 [production]
16:37 <marostegui> Stop pt-table-checksum on s1 - T162807 [production]
16:26 <bblack> restarting varnish backend on cp1099 (mailbox lag) [production]
15:45 <godog> test-upgrade grafana 4.3.1 on labmon1001 [production]
15:35 <krinkle@tin> Synchronized php-1.30.0-wmf.2/resources/Resources.php: Restore mediawiki.page.watch.ajax dependency - Iebfda85c7 (duration: 00m 42s) [production]
15:00 <godog> deploy thumbor 0.1.39 for memcache-based throttling - T151065 [production]
14:54 <moritzm> uploaded gerrit 2.13.8+wmf2 to apt.wikimedia.org [production]
14:04 <moritzm> installing jasper security updates on trusty (jessie already fixed) [production]
13:59 <marostegui> Start running pt-table-checksum on s1 (will not run over night for now) - T162807 [production]
13:59 <paravoid> cr2-esams: enabling netflows experimentally [production]
13:54 <elukey> upgrade Druid daemons on druid100[123] to 0.10 - T164008 [production]
13:28 <volans> slowly upgrading facter across the fleet checking is a noop T166203 [production]
13:14 <godog> upload prometheus-hhvm-exporter 0.3-1 to jessie-wikimedia - T158286 [production]
12:20 <moritzm> upgrade application servers using HHVM 3.18 to the latest 3.18.2+wmf4 build [production]
12:09 <moritzm> updating puppet on puppetmaster2002 [production]
12:08 <godog> bounce pybal on lvs1003 - T134893 [production]
11:52 <XioNoX> pregressively adding "remove-private" to ix4/6 and transit4/6 bgp groups on cr2-esams T83037 [production]
11:36 <moritzm> uploaded puppet_3.8.5-2~bpo8+2 to apt.wikimedia.org [production]
10:50 <akosiaris> repool esams T133387 [production]
10:46 <volans> stopped temporarily ircecho to avoid alert spam [production]
10:43 <ema> upgrade prometheus-node-exporter on lvs hosts to 0.14.0~git20170523-0 T160156 [production]
10:43 <ema> upgrade prometheus-node-exporter on cache hosts to 0.14.0~git20170523-0 T160156 [production]
10:05 <volans> forcing puppet run on failed hosts only in esams T133387 [production]
09:59 <XioNoX> asw-esams back up (T133387) [production]
09:53 <XioNoX> rebooting asw-esams for upgrade (T133387) [production]
09:49 <ema> upgrade prometheus-node-exporter on cache hosts to 0.14.0~git20170523-0 T147569 [production]
09:26 <godog> upload prometheus-node-exporter 0.14.0~git20170523-0 to jessie-wikimedia - T160156 [production]
09:15 <akosiaris@puppetmaster1001> conftool action : set/pooled=yes; selector: cp3036.esams.wmnet [production]
09:10 <akosiaris> drain esams for network tests for T133387 [production]
08:52 <marostegui> Deploy alter table on codfw master (db2019 and let it replicate) on s4 - T166206 [production]
08:51 <joal@tin> Finished deploy [analytics/refinery@9377d9c]: Deploying to fix yesterday's deploy bugs (duration: 02m 44s) [production]
08:49 <akosiaris> depool cp3036 for T133387 testing [production]
08:49 <akosiaris@puppetmaster1001> conftool action : set/pooled=no; selector: cp3036.esams.wmnet [production]
08:48 <joal@tin> Started deploy [analytics/refinery@9377d9c]: Deploying to fix yesterday's deploy bugs [production]
07:28 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1094 - T164530 (duration: 00m 41s) [production]
07:17 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1086, depool db1094 - T164530 (duration: 00m 41s) [production]
07:03 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1079, depool db1086 - T164530 (duration: 00m 42s) [production]
06:56 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1079 - T164530 (duration: 00m 54s) [production]
06:34 <marostegui> Deploy alter table on s2.fawiki directly on codfw master (db2029) after running the clean up duplicates script - https://phabricator.wikimedia.org/T164530 [production]
06:04 <marostegui> Run pt-table-checksum on s7.frwiktionary - https://phabricator.wikimedia.org/T163190 [production]
06:02 <marostegui> Deploy alter table on s2 db1047 - https://phabricator.wikimedia.org/T162611 [production]
03:04 <l10nupdate@tin> ResourceLoader cache refresh completed at Wed May 24 03:04:03 UTC 2017 (duration 6m 45s) [production]
02:57 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.2) (duration: 13m 38s) [production]
02:24 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.1) (duration: 07m 30s) [production]
2017-05-23 §
21:00 <mepps> deployed payment wiki 0c06f8e6c998dccaa9857476dd71c16103e9b9e2 [production]
20:24 <bblack> enable BBR for all caches - T147569 [production]
20:20 <bblack> enable BBR for all caches @ codfw - T147569 [production]
20:10 <bblack> enable BBR for all caches @ ulsfo - T147569 [production]