|
2019-12-10
§
|
| 11:34 |
<jbond42> |
rolloing restart of ats servers |
[production] |
| 11:28 |
<mbsantos@deploy1001> |
Finished deploy [kartotherian/deploy@452b144] (stretch): Update kartotherian-package to f9fb029 (T240227) (duration: 00m 20s) |
[production] |
| 11:27 |
<mbsantos@deploy1001> |
Started deploy [kartotherian/deploy@452b144] (stretch): Update kartotherian-package to f9fb029 (T240227) |
[production] |
| 11:04 |
<_joe_> |
restarting pybal on lvs1015, then 1013 and 1014 to pick up the etcd restart |
[production] |
| 10:59 |
<_joe_> |
restarting pybal on lvs1016, the the other eqiad pybals, to catch up on etcd restart |
[production] |
| 10:55 |
<_joe_> |
restarting etcd on conf1004 T237362 |
[production] |
| 10:48 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Repool db1127 after table defragmentation (duration: 00m 55s) |
[production] |
| 10:36 |
<marostegui> |
Optimize wikishared.cx_corpora on db2115 (non compressed table) - T183485 |
[production] |
| 10:35 |
<marostegui> |
Upgrade db1127 |
[production] |
| 10:13 |
<moritzm> |
stopping slapd on dubnium/pollux following application of the spare role T224557 |
[production] |
| 10:06 |
<onimisionipe> |
add new disk to RAID array on cloudelastic1002 - T239957 |
[production] |
| 09:51 |
<marostegui> |
Optimize wikishared. cx_corpora on db1127 - T183485 |
[production] |
| 09:48 |
<marostegui@deploy1001> |
Synchronized wmf-config/db-eqiad.php: Depool db1127 for table defragmentation (duration: 00m 59s) |
[production] |
| 09:20 |
<marostegui> |
Restart mysql on dbstore1003, 1004 and 1005 for upgrade |
[production] |
| 09:11 |
<marostegui> |
Restart MySQL on labsdb1012 |
[production] |
| 06:39 |
<marostegui> |
Remove db1062 from tendril and zarcillo T239188 |
[production] |
| 06:08 |
<marostegui> |
Deploy schema change on s4 codfw master (this will generate lag on s4 codfw) T233135 |
[production] |
| 06:06 |
<marostegui> |
Remove triggers from db2095:3314 for ar_comment - T234704 |
[production] |
| 02:11 |
<cstone> |
updated civicrm revision changed from 09149e0427 to b519d4fb73, |
[production] |
|
2019-12-09
§
|
| 23:04 |
<XenoRyet> |
reenabled Ingenico Connect recurring charge job |
[production] |
| 23:00 |
<brennen@deploy1001> |
Synchronized php-1.35.0-wmf.8/extensions/Cite: Sync [[gerrit:556066|Hotfix: Defensive array accesses (T240248)]] (duration: 00m 57s) |
[production] |
| 22:55 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.8 |
[production] |
| 22:54 |
<XenoRyet> |
updated civicrm from 7eab025ec0 to 09149e0427 |
[production] |
| 22:54 |
<shdubsh> |
restart prometheus on prometheus2004 -- T238807 |
[production] |
| 22:40 |
<sbassett> |
Deployed security patch for T192134 to wmf.8 |
[production] |
| 22:37 |
<sbassett> |
Deployed security patch for T192134 to wmf.5 |
[production] |
| 21:55 |
<mholloway-shell@deploy1001> |
Finished deploy [mobileapps/deploy@aa65057]: Update mobileapps to f9771ab (duration: 10m 39s) |
[production] |
| 21:48 |
<shdubsh> |
restart prometheus on prometheus2003 -- T238807 |
[production] |
| 21:45 |
<mholloway-shell@deploy1001> |
Started deploy [mobileapps/deploy@aa65057]: Update mobileapps to f9771ab |
[production] |
| 21:32 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@08cfd70]: Set location of ivy cache for spark (duration: 00m 24s) |
[production] |
| 21:32 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@08cfd70]: Set location of ivy cache for spark |
[production] |
| 19:18 |
<Urbanecm> |
Morning SWAT done |
[production] |
| 19:18 |
<Urbanecm> |
Purge several logo files (T150618) |
[production] |
| 19:18 |
<Urbanecm> |
Run namespaceDupes.php for eswikisource (T240050) |
[production] |
| 19:16 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: 32da89f: Upload HD logos for en, fi and nl arbcom wikis (2/2, T150618) (duration: 01m 00s) |
[production] |
| 19:14 |
<urbanecm@deploy1001> |
Synchronized static/images/project-logos/: SWAT: 32da89f: Upload HD logos for en, fi and nl arbcom wikis (1/2, T150618) (duration: 01m 01s) |
[production] |
| 19:07 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: f984d18: Add aliases for Help and Project on eswikisource (T240050) (duration: 01m 00s) |
[production] |
| 19:01 |
<onimisionipe> |
continue osm-import on maps1004 - T239728 |
[production] |
| 18:37 |
<herron> |
enabling lvs for kibana-next elk7 upgrade environment, in case any alerts fire relating to this please disreagard them |
[production] |
| 18:19 |
<onimisionipe@deploy1001> |
Finished deploy [wdqs/wdqs@9f9190e]: New WDQS Build (duration: 09m 33s) |
[production] |
| 18:09 |
<onimisionipe@deploy1001> |
Started deploy [wdqs/wdqs@9f9190e]: New WDQS Build |
[production] |
| 18:09 |
<onimisionipe@deploy1001> |
Finished deploy [wdqs/wdqs@9f9190e]: New WDQS Build (duration: 03m 02s) |
[production] |
| 18:06 |
<onimisionipe@deploy1001> |
Started deploy [wdqs/wdqs@9f9190e]: New WDQS Build |
[production] |
| 18:01 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: Revert "group2 wikis to 1.35.0-wmf.5" |
[production] |
| 17:52 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: all wikis to 1.35.0-wmf.8 |
[production] |
| 17:09 |
<brennen@deploy1001> |
Synchronized php: group1 wikis to 1.35.0-wmf.8 (duration: 01m 00s) |
[production] |
| 17:08 |
<brennen@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.35.0-wmf.8 |
[production] |
| 17:03 |
<brennen> |
attempting to roll 1.35.0-wmf.8 forward to group1 |
[production] |
| 15:57 |
<moritzm> |
installing openslp security updates |
[production] |
| 15:40 |
<jiji@cumin1001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |