|
2015-04-07
§
|
| 16:41 |
<krenair> |
Synchronized php-1.25wmf24/extensions/VisualEditor/lib/ve: https://gerrit.wikimedia.org/r/#/c/202400/ (duration: 00m 12s) |
[production] |
| 16:26 |
<Krinkle> |
git-deploy: Deploying integration/slave-scripts 4c6f541 |
[releng] |
| 16:20 |
<krenair> |
Synchronized php-1.25wmf24/extensions/Wikidata: https://gerrit.wikimedia.org/r/#/c/202398/1 (duration: 00m 18s) |
[production] |
| 16:16 |
<Krenair> |
https://gerrit.wikimedia.org/r/#/c/134124/ was merged but has not been synced |
[production] |
| 16:16 |
<krenair> |
Synchronized wmf-config/CommonSettings.php: https://gerrit.wikimedia.org/r/#/c/169716/ (duration: 00m 14s) |
[production] |
| 15:49 |
<krenair> |
Synchronized php-1.25wmf24/extensions/Flow: https://gerrit.wikimedia.org/r/#/c/202262/2 (duration: 00m 14s) |
[production] |
| 15:43 |
<krenair> |
Finished scap: https://gerrit.wikimedia.org/r/#/c/202258/1 (duration: 22m 29s) |
[production] |
| 15:41 |
<bblack> |
re-weighted pybal esams/upload (all-1 to all-3) |
[production] |
| 15:21 |
<krenair> |
Started scap: https://gerrit.wikimedia.org/r/#/c/202258/1 |
[production] |
| 13:32 |
<cmjohnson1> |
scheduled downtime for barium to replace disk. |
[production] |
| 12:57 |
<hashar> |
running apt-get upgrade on integration-slave-trusty* hosts |
[releng] |
| 12:45 |
<hashar> |
recreating integration-slave-trusty-1005 |
[releng] |
| 12:26 |
<hashar> |
deleting integration-slave-trusty-1005 has been provisioned with role::ci::website instead of role::ci::slave::labs |
[releng] |
| 12:11 |
<hashar> |
retriggering a bunch of browser tests hitting beta.wmflabs.org |
[releng] |
| 12:07 |
<hashar> |
Puppet being fixed, it is finishing the installation of integration-slave-trusty-*** hosts |
[releng] |
| 12:03 |
<hashar> |
Browser tests against beta cluster were all failing due to an improper DNS resolver being applied on CI labs instances {{bug|T95273}}. Should be fixed now. |
[releng] |
| 12:00 |
<hashar> |
running puppet on all integration machines and resigning puppet client certs |
[releng] |
| 11:57 |
<springle> |
xtrabackup clone db2016 to db2042 |
[production] |
| 11:31 |
<hashar> |
integration-puppetmaster is back and operational with local puppet client working properly. |
[releng] |
| 11:28 |
<hashar> |
restored /etc/puppet/fileserver.conf |
[releng] |
| 11:08 |
<hashar> |
dishing out puppet SSL configuration on all integratio nodes. Can't figure out so lets restart from scratch |
[releng] |
| 10:59 |
<springle> |
install db2042, puppet sign, etc |
[production] |
| 10:52 |
<hashar> |
made puppetmaster certname = integration-puppetmaster.eqiad.wmflabs instead of the ec2 id :( |
[releng] |
| 10:49 |
<hashar> |
manually hacking integration-puppetmaster /etc/puppet/puppet.conf config file which is missing the [master] section |
[releng] |
| 09:54 |
<godog> |
swift weight ms-be10[678] to 2000 |
[production] |
| 07:18 |
<paravoid> |
powercycling analytics1020, unresponsive |
[production] |
| 07:12 |
<_joe_> |
powercycling mw2128, network driver crashes |
[production] |
| 06:01 |
<LocalisationUpdate> |
ResourceLoader cache refresh completed at Tue Apr 7 06:00:13 UTC 2015 (duration 0m 12s) |
[production] |
| 04:49 |
<mutante> |
rbf - puppetstoredconfigclean.rb, remove from icinga |
[production] |
| 03:07 |
<LocalisationUpdate> |
completed (1.25wmf24) at 2015-04-07 03:06:13+00:00 |
[production] |
| 03:02 |
<l10nupdate> |
Synchronized php-1.25wmf24/cache/l10n: (no message) (duration: 06m 16s) |
[production] |
| 02:41 |
<LocalisationUpdate> |
completed (1.25wmf23) at 2015-04-07 02:40:43+00:00 |
[production] |
| 02:35 |
<l10nupdate> |
Synchronized php-1.25wmf23/cache/l10n: (no message) (duration: 09m 00s) |
[production] |
| 01:47 |
<springle> |
Synchronized wmf-config/db-eqiad.php: repool db1035, warm up (duration: 00m 12s) |
[production] |
| 01:25 |
<Krinkle> |
Reloading Zuul to deploy https://gerrit.wikimedia.org/r/202300 |
[releng] |
| 01:14 |
<mutante> |
rbf2001/rbf2002 - stop redis server |
[production] |
| 01:11 |
<mutante> |
rbf eqiad and codfw - disable puppet (T95153) |
[production] |
| 00:54 |
<mutante> |
haedus/capella - shutdown -h |
[production] |
| 00:40 |
<mutante> |
radon: revoke salt key, puppet cert |
[production] |
| 00:39 |
<krenair> |
Synchronized php-1.25wmf23/includes/Title.php: debug logging - https://gerrit.wikimedia.org/r/#/c/202218/ (duration: 00m 11s) |
[production] |
| 00:36 |
<krenair> |
Synchronized php-1.25wmf24/includes/Title.php: debug logging - https://gerrit.wikimedia.org/r/#/c/202290/ (duration: 00m 15s) |
[production] |
| 00:34 |
<mutante> |
haedus/capella: disabling puppet. reclaim |
[production] |