|
2019-01-23
ยง
|
| 23:28 |
<crusnov@deploy1001> |
Started deploy [netbox/deploy@aa3c342]: Upgrade netbox to 2.5.3 - T212524 |
[production] |
| 23:26 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.14 refs T206668 |
[production] |
| 23:26 |
<chaomodus> |
scap deploy netbox 2.5.3 |
[production] |
| 23:13 |
<jforrester@deploy1001> |
Synchronized php-1.33.0-wmf.14/extensions/Translate/TranslateHooks.php: T214517 T214358 Hot-deploy Ic9d85fec1 to un-block train, hopefully (duration: 00m 53s) |
[production] |
| 23:00 |
<jforrester@deploy1001> |
Synchronized php-1.33.0-wmf.14/extensions/WikimediaEvents/includes/WikimediaEventsHooks.php: Hot-deploy I81165bf00 to use the right name and value for the cookie (duration: 00m 53s) |
[production] |
| 22:08 |
<chaomodus> |
proton1001 restarted nagios-nrpe-server which died from oom |
[production] |
| 21:30 |
<mutante> |
scandium - removing npm and nodejs*, testing puppetization to reinstall them |
[production] |
| 20:50 |
<twentyafterfour@deploy1001> |
Synchronized php: group1 wikis to 1.33.0-wmf.13 refs T206668 (duration: 00m 52s) |
[production] |
| 20:50 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.13 refs T206668 |
[production] |
| 20:43 |
<twentyafterfour@deploy1001> |
Synchronized php: group1 wikis to 1.33.0-wmf.14 refs T206668 (duration: 00m 52s) |
[production] |
| 20:42 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: group1 wikis to 1.33.0-wmf.14 refs T206668 |
[production] |
| 20:33 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.33.0-wmf.14 refs T206668 |
[production] |
| 20:23 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.33.0-wmf.13 refs T206668 |
[production] |
| 20:21 |
<twentyafterfour> |
rolling back because error rate increased significantly after promoting |
[production] |
| 20:09 |
<twentyafterfour> |
twentyafterfour@deploy1001 rebuilt and synchronized wikiversions files: group0 wikis to 1.33.0-wmf.14 refs T206668 |
[production] |
| 20:07 |
<twentyafterfour@deploy1001> |
rebuilt and synchronized wikiversions files: group0 wikis to 1.33.0-wmf.14 refs T206668 |
[production] |
| 19:33 |
<moritzm> |
rebooting dubnium to pick up SSBD-enabled qemu |
[production] |
| 19:03 |
<moritzm> |
rebooting puppetdb2001 to pick up SSBD-enabled qemu |
[production] |
| 18:46 |
<jforrester@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: Config: Disable showing 'depicts' statements on Commons for now via I66d97031 (duration: 00m 52s) |
[production] |
| 18:44 |
<jforrester@deploy1001> |
Synchronized php-1.33.0-wmf.14/extensions/WikimediaEvents/includes/WikimediaEventsHooks.php: Hot-deploy Ief9c9155c to avoid auto-opting new accounts into PHP7 (duration: 00m 53s) |
[production] |
| 18:35 |
<anomie@deploy1001> |
Synchronized php-1.33.0-wmf.13/includes/page/WikiPage.php: Add even more temporary logging for T210739 (duration: 00m 54s) |
[production] |
| 18:26 |
<moritzm> |
rebooting mendelevium/ticket.wikimedia.org to pick up SSBD-enabled qemu |
[production] |
| 18:10 |
<sbisson@deploy1001> |
Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:485212|Reapply Enable the Welcome survey on viwiki]] (duration: 00m 53s) |
[production] |
| 18:09 |
<sbisson@deploy1001> |
Synchronized php-1.33.0-wmf.13/extensions/GrowthExperiments/: SWAT: [[gerrit:485209|Help panel: ResourceLoaderHelpPanelModule handle help panel disabled]] (duration: 00m 54s) |
[production] |
| 18:03 |
<jbond@cumin1001> |
conftool action : set/pooled=yes; selector: name=dns5002.wikimedia.org |
[production] |
| 17:57 |
<jbond@cumin1001> |
conftool action : set/pooled=no; selector: name=dns5002.wikimedia.org |
[production] |
| 17:24 |
<dcausse@deploy1001> |
Finished deploy [search/mjolnir/deploy@a141ad3]: fix retry_on_conflict (duration: 04m 21s) |
[production] |
| 17:20 |
<dcausse@deploy1001> |
Started deploy [search/mjolnir/deploy@a141ad3]: fix retry_on_conflict |
[production] |
| 16:57 |
<jbond@cumin1001> |
conftool action : set/pooled=yes; selector: name=dns5001.wikimedia.org |
[production] |
| 16:53 |
<jbond@cumin1001> |
conftool action : set/pooled=no; selector: name=dns5001.wikimedia.org |
[production] |
| 16:50 |
<jbond@cumin1001> |
conftool action : set/pooled=yes; selector: name=dns4002.wikimedia.org |
[production] |
| 16:44 |
<jbond@cumin1001> |
conftool action : set/pooled=no; selector: name=dns4002.wikimedia.org |
[production] |
| 16:43 |
<jbond@cumin1001> |
conftool action : set/pooled=yes; selector: name=dns4001.wikimedia.org |
[production] |
| 16:36 |
<jbond@cumin1001> |
conftool action : set/pooled=no; selector: name=dns4001.wikimedia.org |
[production] |
| 16:31 |
<jbond@cumin1001> |
conftool action : set/pooled=yes; selector: name=dns2002.wikimedia.org |
[production] |
| 16:14 |
<jbond@cumin1001> |
conftool action : set/pooled=no; selector: name=dns2002.wikimedia.org |
[production] |
| 16:13 |
<jbond42> |
rolling restarts of PDNS recursors/ntpd in codfw/esams/ulsfi/eqsin to pick up openssl security update |
[production] |
| 16:02 |
<jbond42> |
restarting ntpd on dns2001 |
[production] |
| 16:00 |
<jbond@cumin1001> |
conftool action : set/pooled=yes; selector: name=dns2001.wikimedia.org |
[production] |
| 15:57 |
<jynus> |
adding dbstore1004:s2 to tendril |
[production] |
| 15:43 |
<jbond@cumin1001> |
conftool action : set/pooled=no; selector: name=dns2001.wikimedia.org |
[production] |
| 15:20 |
<marostegui> |
Truncate wmf_checksum table on dbstore1002 - T213670 |
[production] |
| 14:55 |
<marostegui> |
Compress InnoDB on a few tables on dbstore1002 to gain some extra space - T213670 |
[production] |
| 14:18 |
<marostegui> |
Convert tokudb tables into innodb on dbstore1002 - T213706 |
[production] |
| 13:47 |
<marostegui> |
Convert a bunch of Aria tables to InnoDB on dbstore1002 |
[production] |
| 13:38 |
<onimisionipe> |
repooling maps1002 |
[production] |
| 13:32 |
<gehel> |
restarting kartotherian on maps100[234] |
[production] |
| 13:30 |
<gehel> |
restarting kartotherian on maps1003 |
[production] |
| 13:27 |
<marostegui> |
Migrate some tokudb tables to innodb on dbstore1002 - T213706 |
[production] |
| 13:18 |
<gehel> |
running cumin 'P{O:cache::upload} and A:eqiad' 'run-puppet-agent' |
[production] |