1-50 of 10000 results (55ms)
2019-09-05 ยง
23:13 <ayounsi@deploy1001> Finished deploy [netbox/deploy@367ca84]: test (duration: 00m 42s) [production]
23:12 <ayounsi@deploy1001> Started deploy [netbox/deploy@367ca84]: test [production]
23:09 <jforrester@deploy1001> Synchronized wmf-config/CommonSettings.php: T151425 Require that passwords are not in the most common 100k list for all users (duration: 00m 48s) [production]
22:12 <eileen> tools revision changed from b42bda6bf3 to 643c48b26a [production]
21:42 <crusnov@deploy1001> Finished deploy [netbox/deploy@367ca84]: deploy for netbox split T223291 (duration: 00m 03s) [production]
21:42 <crusnov@deploy1001> Started deploy [netbox/deploy@367ca84]: deploy for netbox split T223291 [production]
21:35 <crusnov@deploy1001> Finished deploy [netbox/deploy@367ca84]: test deploy for netbox split - again (duration: 00m 12s) [production]
21:34 <crusnov@deploy1001> Started deploy [netbox/deploy@367ca84]: test deploy for netbox split - again [production]
19:28 <krinkle@deploy1001> Synchronized wmf-config/CommonSettings.php: c7678f0e3d638 (duration: 00m 47s) [production]
19:21 <krinkle@deploy1001> Synchronized php-1.34.0-wmf.21/extensions/WikimediaMaintenance/blameStartupRegistry.php: 7adf466614d (duration: 00m 48s) [production]
18:10 <crusnov@deploy1001> Finished deploy [netbox/deploy@367ca84]: test deploy for netbox split (duration: 38m 39s) [production]
17:31 <crusnov@deploy1001> Started deploy [netbox/deploy@367ca84]: test deploy for netbox split [production]
16:22 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Switch all events to eventgate - T228705 - take 2 (duration: 00m 49s) [production]
16:05 <otto@deploy1001> Synchronized wmf-config/InitialiseSettings.php: Switch all events to eventgate - T228705 (duration: 00m 48s) [production]
16:04 <ottomata> switching remaining job queue events (and all remaining events) to eventgate - T228705 [production]
15:59 <jynus> restarting batch processes on mwmaint1002 T232106 [production]
15:54 <jynus@deploy1001> Synchronized private/PrivateSettings.php: updating cli password (duration: 00m 47s) [production]
15:23 <herron> beginning replacement of kafka1001 with kafka-main1001 T225005 [production]
14:54 <ema> restbase2009: repool after successful envoy deployment T210411 [production]
14:50 <ema> restbase2009: depool and add TLS termination w/ envoy -- https://gerrit.wikimedia.org/r/#/c/operations/puppet/+/533028/ T210411 [production]
14:42 <XioNoX> remove iron from mr* routers - T231811 [production]
14:30 <filippo@puppetmaster1001> conftool action : set/pooled=yes; selector: name=prometheus1003.eqiad.wmnet [production]
14:15 <@> helmfile [EQIAD] Ran 'sync' command on namespace 'sessionstore' for release 'production' . [production]
14:14 <@> helmfile [CODFW] Ran 'sync' command on namespace 'sessionstore' for release 'production' . [production]
14:11 <cdanis> restarted swiftrepl on ms-fe1005 T231110 [production]
13:54 <@> helmfile [CODFW] Ran 'apply' command on namespace 'sessionstore' for release 'production' . [production]
13:39 <moritzm> upgrading remaining API servers to PHP 7.2.22 [production]
13:37 <@> helmfile [STAGING] Ran 'apply' command on namespace 'sessionstore' for release 'staging' . [production]
13:21 <filippo@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=prometheus1003.eqiad.wmnet [production]
13:17 <filippo@puppetmaster1001> conftool action : set/pooled=yes; selector: name=prometheus1004.eqiad.wmnet [production]
13:04 <hashar@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.34.0-wmf.21 [production]
12:47 <@> helmfile [STAGING] Ran 'sync' command on namespace 'sessionstore' for release 'staging' . [production]
12:13 <moritzm> upgrading mw1284-mw1290 to PHP 7.2.22 [production]
12:02 <@> helmfile [STAGING] Ran 'sync' command on namespace 'sessionstore' for release 'staging' . [production]
11:57 <moritzm> upgrading remaining job runners to PHP 7.2.22 [production]
11:50 <dcausse> EU swat done [production]
11:48 <dcausse@deploy1001> Synchronized php-1.34.0-wmf.20/extensions/CirrusSearch/: T159321: Add morelikethis a non-greedy version of the morelike keyword (duration: 00m 59s) [production]
10:53 <godog> temporarily enable prometheus admin web api in prometheus@ops in eqiad to delete spammy metrics - T228395 [production]
10:49 <filippo@puppetmaster1001> conftool action : set/pooled=inactive; selector: name=prometheus1004.eqiad.wmnet [production]
10:46 <moritzm> upgrading mw1221-mw1335 to PHP 7.2.22 [production]
10:31 <moritzm> upgrading mw1319-mw1333 to PHP 7.2.22 [production]
10:28 <_joe_> upgrading scap across the fleet T224857 [production]
10:25 <moritzm> upgrading mw1238-mw1258 to PHP 7.2.22 [production]
09:39 <mutante> ganeti1001 - creating VM moscovium (T232077) [production]
09:26 <vgutierrez> rolling back from ats-tls to nginx on cp1076 - T231433 [production]
09:17 <jmm@cumin2001> END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) [production]
09:17 <jmm@cumin2001> START - Cookbook sre.hosts.downtime [production]
09:05 <hashar@deploy1001> rebuilt and synchronized wikiversions files: Promote wikidatawiki to 1.34.0-wmf.21 for T232035 - T220746 [production]
09:04 <vgutierrez> rolling back from ats-tls to nginx on cp3034 - T231433 [production]
08:55 <hashar@deploy1001> rebuilt and synchronized wikiversions files: Rollback wikidatawiki to 1.34.0-wmf.20 for T232035 [production]