2019-09-24
§
|
23:38 |
<mutante> |
gerrit service restart to switch LDAP backend |
[production] |
23:35 |
<bstorm_> |
wiki-replicas depooled labsdb1011 |
[production] |
23:33 |
<mutante> |
gerrit2001 - restarting gerrit service |
[production] |
23:30 |
<mutante> |
switching LDAP servers used by Gerrit to readonly replicas. stop using so called "labs" config for LDAP backend. |
[production] |
22:25 |
<twentyafterfour@deploy1001> |
Finished scap: testwikis wikis to 1.34.0-wmf.24 refs T220749 (duration: 40m 38s) |
[production] |
21:53 |
<mutante> |
restbase1024 - enable IPMI over LAN which wasn't working before |
[production] |
21:45 |
<twentyafterfour@deploy1001> |
Started scap: testwikis wikis to 1.34.0-wmf.24 refs T220749 |
[production] |
21:19 |
<mutante> |
ganeti4001 - racadm racreset - attempt to fix IPMI |
[production] |
20:19 |
<twentyafterfour> |
restarting gerrit due to unreasonably high garbage collection times and sluggish performance in general. |
[production] |
19:39 |
<XioNoX> |
disable asw2-d-eqiad:ge-5/0/41 excessive flapping |
[production] |
19:28 |
<ejegg> |
updated payments-wiki from 939b771800 to 5193dcdfa9 |
[production] |
19:20 |
<twentyafterfour> |
branching 1.34.0-wmf.24 refs T220749 |
[production] |
18:45 |
<AndyRussG> |
updated fruec from fb29cb74 to 97128874bf |
[production] |
18:08 |
<ejegg> |
updated Fundraising CiviCRM feca96a2e3 to 52d2a24404 |
[production] |
17:13 |
<cstone> |
civicrm revision changed from 5def62ab05 to feca96a2e3 |
[production] |
14:40 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
14:28 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
14:24 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
14:24 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
14:17 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
14:09 |
<moritzm> |
rebooting cloudvirt1021 for kernel update |
[production] |
14:09 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
14:09 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.downtime (exit_code=0) |
[production] |
14:09 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.downtime |
[production] |
14:09 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
13:50 |
<volans@cumin1001> |
END (PASS) - Cookbook sre.hosts.decommission (exit_code=False) |
[production] |
13:50 |
<volans@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
13:49 |
<jbond42__> |
promote puppetmaster1003 to a real puppetmaster backend https://gerrit.wikimedia.org/r/c/operations/puppet/+/538686 |
[production] |
13:45 |
<_joe_> |
installing the new conftool version on the cumin hosts |
[production] |
13:40 |
<_joe_> |
uploaded conftool 1.1.4-3 to stretch-wikimedia, T233679 |
[production] |
13:19 |
<volans@cumin1001> |
END (FAIL) - Cookbook sre.hosts.decommission (exit_code=True) |
[production] |
13:18 |
<volans@cumin1001> |
START - Cookbook sre.hosts.decommission |
[production] |
13:02 |
<@> |
helmfile [STAGING] Ran 'sync' command on namespace 'restrouter' for release 'staging' . |
[production] |
12:22 |
<arturo> |
remove systemd-sysv from jessie-wikimedia/openstack-mitaka-jessie in install1002 (T231793) |
[production] |
12:20 |
<dcausse@deploy1001> |
Synchronized wmf-config/CirrusSearch-production.php: T233584 [cirrus] temp disable sanity check (duration: 00m 55s) |
[production] |
12:18 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@19d0f44]: REVERT (due to wikifeeds problems): Start using the wikifeeds service for v1/feed - T170455 (duration: 02m 35s) |
[production] |
12:16 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@19d0f44]: REVERT (due to wikifeeds problems): Start using the wikifeeds service for v1/feed - T170455 |
[production] |
11:47 |
<mobrovac@deploy1001> |
Finished deploy [restbase/deploy@87eea26]: Start using the wikifeeds service for v1/feed - T170455 (duration: 02m 35s) |
[production] |
11:45 |
<mobrovac@deploy1001> |
Started deploy [restbase/deploy@87eea26]: Start using the wikifeeds service for v1/feed - T170455 |
[production] |
11:43 |
<Urbanecm> |
EU SWAT done |
[production] |
11:41 |
<urbanecm@deploy1001> |
Synchronized wmf-config/VariantSettings.php: SWAT: 11a48f8: Add support for some languages on Commons and stop support for nys on Wikidata (T230480) (duration: 00m 56s) |
[production] |
11:39 |
<Urbanecm> |
Run mwscript initSiteStats.php --wiki=napwikisource --update (T233673) |
[production] |
11:37 |
<urbanecm@deploy1001> |
Synchronized wmf-config/VariantSettings.php: SWAT: 9eaa4f8: Set wgArticleCountMethod to any for napwikisource (T233673) (duration: 00m 56s) |
[production] |
11:30 |
<Urbanecm> |
Purge https://en.wikipedia.org/static/images/project-logos/mxwikimedia.png (T233670) |
[production] |
11:30 |
<urbanecm@deploy1001> |
Synchronized wmf-config/VariantSettings.php: SWAT: b6947c5: Follow-up 8f3f0705baed: add missing namespace for eswiki (T233562) (duration: 00m 56s) |
[production] |
11:27 |
<urbanecm@deploy1001> |
Synchronized php-1.34.0-wmf.23/extensions/MassMessage/: SWAT: ba9b209: Provide deduplication info to MassMessageJob (T232379) (duration: 00m 57s) |
[production] |
11:26 |
<urbanecm@deploy1001> |
Synchronized static/images/project-logos/mxwikimedia.png: SWAT: 246b352: Update logo for mx.wikimedia (T233670) (duration: 00m 54s) |
[production] |
11:24 |
<urbanecm@deploy1001> |
Synchronized php-1.34.0-wmf.23/extensions/GrowthExperiments/modules/homepage/ext.growthExperiments.Homepage.less: SWAT: d4c64a7: Fix broken display of mobile overlay headings (T233163) (duration: 00m 57s) |
[production] |
11:16 |
<urbanecm@deploy1001> |
Synchronized wmf-config/VariantSettings.php: SWAT: 8bf6aae: Enable alternate mobile link for ar,zh,hi wikis (T206497) (duration: 00m 54s) |
[production] |