401-450 of 10000 results (67ms)
2019-12-10 §
14:52 <akosiaris@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
14:43 <akosiaris@cumin1001> START - Cookbook sre.ganeti.makevm [production]
14:42 <akosiaris@cumin1001> END (PASS) - Cookbook sre.ganeti.makevm (exit_code=0) [production]
14:32 <akosiaris@cumin1001> START - Cookbook sre.ganeti.makevm [production]
14:30 <akosiaris@cumin1001> END (FAIL) - Cookbook sre.ganeti.makevm (exit_code=99) [production]
14:30 <akosiaris@cumin1001> START - Cookbook sre.ganeti.makevm [production]
14:08 <jbond42> rolling restart of varnishkafaka-webrequest and varnishkafaka-eventloggin [production]
13:54 <godog> remove stale puppetmaster2001:/var/run/confd-template/.*.err [production]
13:21 <marostegui> Compress table db2115 wikishared.cx_corpora on db2115 - T240325 [production]
12:36 <Urbanecm> EU SWAT done [production]
12:36 <urbanecm@deploy1001> Synchronized wmf-config/abusefilter.php: SWAT: 80fac66: Enable abusefilter blocking cap at testwiki (duration: 00m 55s) [production]
12:32 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 80fac66: Enable abusefilter blocking cap at testwiki (duration: 00m 55s) [production]
12:19 <nikerabbit@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:555921|Add wiki-for-human-rights CX campaign (T239977)]] (duration: 00m 56s) [production]
11:46 <_joe_> restarting etcd on conf1005, also etcdmirrormaker [production]
11:34 <jbond42> rolloing restart of ats servers [production]
11:28 <mbsantos@deploy1001> Finished deploy [kartotherian/deploy@452b144] (stretch): Update kartotherian-package to f9fb029 (T240227) (duration: 00m 20s) [production]
11:27 <mbsantos@deploy1001> Started deploy [kartotherian/deploy@452b144] (stretch): Update kartotherian-package to f9fb029 (T240227) [production]
11:04 <_joe_> restarting pybal on lvs1015, then 1013 and 1014 to pick up the etcd restart [production]
10:59 <_joe_> restarting pybal on lvs1016, the the other eqiad pybals, to catch up on etcd restart [production]
10:55 <_joe_> restarting etcd on conf1004 T237362 [production]
10:48 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Repool db1127 after table defragmentation (duration: 00m 55s) [production]
10:36 <marostegui> Optimize wikishared.cx_corpora on db2115 (non compressed table) - T183485 [production]
10:35 <marostegui> Upgrade db1127 [production]
10:13 <moritzm> stopping slapd on dubnium/pollux following application of the spare role T224557 [production]
10:06 <onimisionipe> add new disk to RAID array on cloudelastic1002 - T239957 [production]
09:51 <marostegui> Optimize wikishared. cx_corpora on db1127 - T183485 [production]
09:48 <marostegui@deploy1001> Synchronized wmf-config/db-eqiad.php: Depool db1127 for table defragmentation (duration: 00m 59s) [production]
09:20 <marostegui> Restart mysql on dbstore1003, 1004 and 1005 for upgrade [production]
09:11 <marostegui> Restart MySQL on labsdb1012 [production]
06:39 <marostegui> Remove db1062 from tendril and zarcillo T239188 [production]
06:08 <marostegui> Deploy schema change on s4 codfw master (this will generate lag on s4 codfw) T233135 [production]
06:06 <marostegui> Remove triggers from db2095:3314 for ar_comment - T234704 [production]
02:11 <cstone> updated civicrm revision changed from 09149e0427 to b519d4fb73, [production]
2019-12-09 §
23:04 <XenoRyet> reenabled Ingenico Connect recurring charge job [production]
23:00 <brennen@deploy1001> Synchronized php-1.35.0-wmf.8/extensions/Cite: Sync [[gerrit:556066|Hotfix: Defensive array accesses (T240248)]] (duration: 00m 57s) [production]
22:55 <brennen@deploy1001> rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.8 [production]
22:54 <XenoRyet> updated civicrm from 7eab025ec0 to 09149e0427 [production]
22:54 <shdubsh> restart prometheus on prometheus2004 -- T238807 [production]
22:40 <sbassett> Deployed security patch for T192134 to wmf.8 [production]
22:37 <sbassett> Deployed security patch for T192134 to wmf.5 [production]
21:55 <mholloway-shell@deploy1001> Finished deploy [mobileapps/deploy@aa65057]: Update mobileapps to f9771ab (duration: 10m 39s) [production]
21:48 <shdubsh> restart prometheus on prometheus2003 -- T238807 [production]
21:45 <mholloway-shell@deploy1001> Started deploy [mobileapps/deploy@aa65057]: Update mobileapps to f9771ab [production]
21:32 <ebernhardson@deploy1001> Finished deploy [wikimedia/discovery/analytics@08cfd70]: Set location of ivy cache for spark (duration: 00m 24s) [production]
21:32 <ebernhardson@deploy1001> Started deploy [wikimedia/discovery/analytics@08cfd70]: Set location of ivy cache for spark [production]
19:18 <Urbanecm> Morning SWAT done [production]
19:18 <Urbanecm> Purge several logo files (T150618) [production]
19:18 <Urbanecm> Run namespaceDupes.php for eswikisource (T240050) [production]
19:16 <urbanecm@deploy1001> Synchronized wmf-config/InitialiseSettings.php: SWAT: 32da89f: Upload HD logos for en, fi and nl arbcom wikis (2/2, T150618) (duration: 01m 00s) [production]
19:14 <urbanecm@deploy1001> Synchronized static/images/project-logos/: SWAT: 32da89f: Upload HD logos for en, fi and nl arbcom wikis (1/2, T150618) (duration: 01m 01s) [production]