9351-9400 of 10000 results (69ms)
2017-06-13 §
12:12 <marostegui> Deploy alter table on s2 on dbstore1002 - T166205 [production]
12:11 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1064 - T166206 (duration: 00m 51s) [production]
11:56 <godog> enable thumbor serving for group0 wikis with media files - T167782 [production]
11:41 <moritzm> upgrading HHVM on tin/naos to HHVM 3.18 [production]
10:59 <moritzm> upgrading mw1283-mw1290 to HHVM 3.18 [production]
10:21 <godog> reenable thumbor swift storage, same paths as mediawiki - T167783 [production]
10:11 <elukey> completed rollout of https://gerrit.wikimedia.org/r/354449 [production]
09:54 <moritzm> upgrading mw2248-mw2250 to HHVM 3.18 [production]
09:37 <godog> disable thumbor shadow requests, enable thumbor-only serving for testwiki - T167490 [production]
09:28 <moritzm> upgrading mw1276-mw1282 to HHVM 3.18 [production]
09:27 <elukey> puppet disabled on kafka*, analytics*, druid*, conf* for https://gerrit.wikimedia.org/r/354449 - incremental rollout [production]
09:13 <marostegui> Deploy alter table s4 - db1095 - T166206 [production]
08:56 <moritzm> upgrading mw1165-mw1167 to HHVM 3.18 [production]
08:42 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1060 - T166205 (duration: 00m 41s) [production]
08:38 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Restore db1089 original weight - T166935 (duration: 00m 42s) [production]
08:21 <gehel> restart OSM synchronisation on maps2001 [production]
08:14 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1089 weight (duration: 00m 42s) [production]
08:05 <gehel@puppetmaster1001> conftool action : set/pooled=yes; selector: name=elastic2020.codfw.wmnet [production]
08:01 <gehel> adding elastic2020 back in the elasticsearch cluster - T149006 [production]
07:47 <marostegui> Drop table updates on enwiki (s1) - T139342 [production]
07:41 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Increase db1089 weight (duration: 00m 41s) [production]
07:30 <moritzm> restarting HHVM on mw canaries to pick up libtasn update [production]
07:21 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1089 with less weight (duration: 00m 41s) [production]
07:12 <marostegui> Reboot scb2005 - T167638 [production]
06:55 <elukey> executed "cumin 'mw2*.codfw.wmnet' 'find /var/log/hhvm/* -user root -exec chown www-data:www-data {} \;'" to fix the last occurences of wrong root:adm hhvm log occurrences [production]
06:51 <moritzm> installing libtasn security updates [production]
06:43 <marostegui> Stop MySQL on db1089 to upgrade its raid controller firmware - T166935 [production]
06:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Depool db1089 - T166935 (duration: 00m 42s) [production]
02:33 <l10nupdate@tin> ResourceLoader cache refresh completed at Tue Jun 13 02:33:23 UTC 2017 (duration 6m 12s) [production]
02:27 <l10nupdate@tin> scap sync-l10n completed (1.30.0-wmf.4) (duration: 08m 00s) [production]
01:29 <papaul> OS install on labtestnet2002 [production]
00:40 <andyrussg@tin> Finished scap: Update CentralNotice (duration: 20m 51s) [production]
00:19 <andyrussg@tin> Started scap: Update CentralNotice [production]
2017-06-12 §
23:22 <mutante> netmon1002 - keyholder arm - loaded rancid deploy key (uses separate passphrase from deployment key) [production]
22:01 <mutante> netmon1002 - apt-get -t jessie-backports install rancid (upgrade from 2.3.8 to 3.6.2 to match version on netmon1001) - rancid version is not specified in puppet so even though backports gets enabled the older version gets installed and this manual step is needed unless we start specifying the version in the manifest (T159756) [production]
20:30 <mutante> ns0, ns1 - same as before - gen zones, check zones, reload zones, to add "atj.wikipedia.org" (T167714) [production]
20:26 <mutante> ns2 - authdns-gen-zones -f /srv/authdns/git/templates /etc/gdnsd/zones && gdnsd checkconf && gdnsd reload-zones to add new Wikipedia language "atj" (needed when editing langlist but not touching templates) (T167714) [production]
19:10 <thcipriani@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:357233|Lift IP throttle for Wikipedia workshop (14 June 2017)]] T167011 + [[gerrit:358422|Fix throttle rule for Scotland university editathon]] (duration: 00m 41s) [production]
18:46 <thcipriani@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:358056|Lift IP throttle for Editathon (13 June 2017)]] T167517 (duration: 00m 41s) [production]
18:40 <thcipriani@tin> Synchronized wmf-config/throttle.php: SWAT: [[gerrit:357510|Lift IP throttle for Wikipedia Editathon (June 16th 2017)]] T167201 (duration: 00m 41s) [production]
18:30 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:358059|Add NS:100 to wgNamespacesToBeSearchedDefault for enwikisource]] T167511 (duration: 00m 41s) [production]
18:27 <thcipriani@tin> Synchronized php-1.30.0-wmf.4/resources/src/mediawiki.rcfilters/mw.rcfilters.Controller.js: SWAT: [[gerrit:358407|RCFilters: Retain extra url params when comparing url equivalency]] T167551 (duration: 00m 41s) [production]
18:17 <thcipriani@tin> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:358091|Setup the new wgPopupsGateway config variable. NOOP]] T165018 (duration: 00m 42s) [production]
17:24 <joal@tin> Finished deploy [analytics/refinery@08fe129]: Bug correction on regular weekly deploy of refinery (2) (duration: 03m 00s) [production]
17:24 <gehel> running stress + bonnie on elastic2020 to check new hardware - T149006 [production]
17:21 <joal@tin> Started deploy [analytics/refinery@08fe129]: Bug correction on regular weekly deploy of refinery (2) [production]
17:07 <gehel@tin> Finished deploy [wdqs/wdqs@84557b8]: (no justification provided) (duration: 02m 32s) [production]
17:05 <gehel@tin> Started deploy [wdqs/wdqs@84557b8]: (no justification provided) [production]
16:43 <marostegui@tin> Synchronized wmf-config/db-eqiad.php: Repool db1089 with less weight (duration: 00m 41s) [production]
14:32 <gehel> restart elasticsearch on relforge1001 to validate GC configuration [production]