|
2020-06-22
ยง
|
| 23:16 |
<catrope@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Add domains to wgCopyUploadsDomains (T255336, T255363, T255386, T255313) (duration: 01m 01s) |
[production] |
| 22:39 |
<bstorm_> |
downtimed labstore1005 to prevent an alert during puppet merge T253353 |
[production] |
| 22:38 |
<volans@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 22:35 |
<volans@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 22:16 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@f2002c8]: bump glent jar to 0.2.2 (duration: 00m 56s) |
[production] |
| 22:15 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@f2002c8]: bump glent jar to 0.2.2 |
[production] |
| 22:12 |
<volans> |
cleanup interfaces and addresses in Netbox for offline servers - T233183 |
[production] |
| 21:59 |
<ebernhardson@deploy1001> |
Finished deploy [wikimedia/discovery/analytics@6e7f9f7]: bump glent jar to 0.2.2 (duration: 00m 18s) |
[production] |
| 21:58 |
<ebernhardson@deploy1001> |
Started deploy [wikimedia/discovery/analytics@6e7f9f7]: bump glent jar to 0.2.2 |
[production] |
| 17:19 |
<mutante> |
gerrit1002 - let puppet remove [database] secttion from config; restart gerrit another time |
[production] |
| 17:14 |
<mutante> |
gerrit1002 (gerrit-test): re-enabled puppet, restarted gerrit service |
[production] |
| 16:58 |
<volans@cumin1001> |
END (PASS) - Cookbook sre.dns.netbox (exit_code=0) |
[production] |
| 16:49 |
<volans@cumin1001> |
START - Cookbook sre.dns.netbox |
[production] |
| 15:05 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 15:01 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 14:48 |
<moritzm> |
installing mutt security updates |
[production] |
| 14:47 |
<Amir1> |
creating shnwiktionary is done |
[production] |
| 14:44 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/interwiki.php: Update interwiki cache (duration: 02m 58s) |
[production] |
| 14:42 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 14:41 |
<ladsgroup@deploy1001> |
Synchronized static/images/project-logos/: Creating shnwiktionary (T253029) (duration: 00m 56s) |
[production] |
| 14:40 |
<ladsgroup@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Creating shnwiktionary (T253029) (duration: 00m 56s) |
[production] |
| 14:39 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 14:37 |
<ladsgroup@deploy1001> |
rebuilt and synchronized wikiversions files: Creating shnwiktionary (T253029) |
[production] |
| 14:36 |
<ladsgroup@deploy1001> |
Synchronized dblists: Creating shnwiktionary (T253029) (duration: 00m 58s) |
[production] |
| 14:16 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 14:10 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 14:05 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 13:59 |
<moritzm> |
re-enabling Puppet in codfw |
[production] |
| 13:55 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 13:51 |
<moritzm> |
disable Puppet in codfw to reduce puppetdb2002 memory activity, unblocking the migration of the Ganeti instance for a reboot |
[production] |
| 13:19 |
<otto@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Bump eventlogging_Test schema version to 1.1.0 to pick up client_dt and set wgEventLoggingServiceUri for all wikis - T238230 (duration: 00m 58s) |
[production] |
| 13:11 |
<marostegui> |
Stop MySQL on db2078 instances |
[production] |
| 12:53 |
<vgutierrez> |
upgrade to trafficserver 8.0.8~rc0-1wm1 on cp5006 and cp5012 |
[production] |
| 12:45 |
<moritzm> |
draining ganeti2007 for eventual reboot |
[production] |
| 12:42 |
<jmm@cumin2001> |
END (PASS) - Cookbook sre.hosts.reboot-single (exit_code=0) |
[production] |
| 12:38 |
<jmm@cumin2001> |
START - Cookbook sre.hosts.reboot-single |
[production] |
| 12:31 |
<akosiaris> |
failover logstash2023 from ganeti2007->ganeti2023 for migration_downtime change to apply |
[production] |
| 12:26 |
<volans@deploy1001> |
Finished deploy [homer/deploy@e9acec8]: Release v0.2.3 on cumin1001 now on buster (duration: 01m 25s) |
[production] |
| 12:24 |
<volans@deploy1001> |
Started deploy [homer/deploy@e9acec8]: Release v0.2.3 on cumin1001 now on buster |
[production] |
| 12:22 |
<volans@deploy1001> |
Finished deploy [homer/deploy@e9acec8]: Release v0.2.3 on cumin1001 now on buster (duration: 00m 03s) |
[production] |
| 12:22 |
<volans@deploy1001> |
Started deploy [homer/deploy@e9acec8]: Release v0.2.3 on cumin1001 now on buster |
[production] |
| 11:53 |
<Urbanecm> |
EU B&C window done |
[production] |
| 11:50 |
<urbanecm@deploy1001> |
Synchronized php-1.35.0-wmf.37/extensions/VisualEditor/modules/: Backport: 0a08066: Revert "Allow generic params to be passed to getWikitextFragment" (T255785) (duration: 00m 58s) |
[production] |
| 11:45 |
<marostegui@cumin2001> |
dbctl commit (dc=all): 'Fully repool db1094', diff saved to https://phabricator.wikimedia.org/P11627 and previous config saved to /var/cache/conftool/dbconfig/20200622-114554-marostegui.json |
[production] |
| 11:40 |
<moritzm> |
draining ganeti2008 for eventual reboot |
[production] |
| 11:37 |
<volans@deploy1001> |
Finished deploy [homer/deploy@e9acec8]: Release v0.2.3 on cumin1001 now on buster (duration: 00m 28s) |
[production] |
| 11:37 |
<volans@deploy1001> |
Started deploy [homer/deploy@e9acec8]: Release v0.2.3 on cumin1001 now on buster |
[production] |
| 11:34 |
<marostegui@cumin2001> |
dbctl commit (dc=all): 'Slowly repool db1094', diff saved to https://phabricator.wikimedia.org/P11625 and previous config saved to /var/cache/conftool/dbconfig/20200622-113401-marostegui.json |
[production] |
| 11:30 |
<urbanecm@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: 74e8295: IS: Cleanup some redundant rows (duration: 00m 56s) |
[production] |
| 11:29 |
<Urbanecm> |
Run namespaceDupes.php for zh* projects (T165593) |
[production] |