|
2019-01-07
§
|
| 09:55 |
<banyek> |
executing schema change on db1079 with replication enabled - T85757 |
[production] |
| 09:53 |
<banyek> |
stopping replication on db1079 - T85757 |
[production] |
| 09:47 |
<banyek@deploy1001> |
Synchronized wmf-config/db-eqiad.php: depool db1079 for schema change - T85757 (duration: 01m 02s) |
[production] |
| 09:36 |
<banyek> |
depooling db1079 for schema change - T85757 |
[production] |
| 09:19 |
<joal> |
Deploying refinery onto HDFS so that refinery-job-0.0.82.jar is present on HDFS (needed to run mediawiki-history successfully) |
[analytics] |
| 08:49 |
<joal> |
Rerun failed mediawiki-denormalize job with update spark conf |
[analytics] |
| 08:30 |
<moritzm> |
rolling restart of swift backend servers to pick up OpenSSL security update |
[production] |
| 07:29 |
<elukey> |
decom analytics103[7,8] from Analytics Hadoop |
[analytics] |
| 07:24 |
<elukey> |
restart pdfrender on scb1002 |
[production] |
| 05:45 |
<bd808> |
Manually installed python3-venv on tools-sgebastion-06. Gerrit patch submitted for proper automation. |
[tools] |
| 00:30 |
<legoktm> |
deploying https://gerrit.wikimedia.org/r/482392 / create node10 mage |
[releng] |
|
2019-01-06
§
|
| 23:02 |
<AlexZ> |
restarted CVNBot14, CVNBot18, CVNBot2, CVNBot3, CVNBot5 due to RC lag. |
[cvn] |
| 22:06 |
<bd808> |
Added floating ip to tools-sgebastion-06 (T212360) |
[tools] |
| 22:03 |
<bd808> |
Set floatingip quota of 60 for tools project in eqiad1-r region (T212360) |
[admin] |
| 14:50 |
<ariel@deploy1001> |
Finished deploy [dumps/dumps@cb30b6c]: check xml files for closing mediawiki tag (duration: 00m 06s) |
[production] |
| 14:50 |
<ariel@deploy1001> |
Started deploy [dumps/dumps@cb30b6c]: check xml files for closing mediawiki tag |
[production] |
| 07:58 |
<elukey> |
manually stopped the hdfs-balancer to ease the decom process (the hdfs nodes are already nicely balanced) |
[analytics] |
| 07:55 |
<elukey> |
decom analytics103[5,6] from Analytics Hadoop |
[analytics] |
| 02:29 |
<bd808> |
Restarted webservice |
[tools.admin] |
| 00:39 |
<Krinkle> |
Updating docker-pkg files on contint1001 for https://gerrit.wikimedia.org/r/482392 |
[releng] |
|
2019-01-05
§
|
| 23:54 |
<bd808> |
Manually installed php-mbstring on tools-sgebastion-06. Gerrit patch submitted to install it on the rest of the Son of Grid Engine nodes. |
[tools] |
| 20:23 |
<elukey> |
manually clean up of big logs under /var/log/.. |
[production] |
| 09:47 |
<Zoranzoki21> |
tools.zoranzoki21wiki: Archived https://www.mediawiki.org/wiki/Extension:CategoryOnUpload (https://www.wikidata.org/wiki/Q21676266) - T212994 |
[tools.zoranzoki21wiki] |
| 09:40 |
<Zoranzoki21> |
tools.zoranzoki21wiki: Archived hhttps://www.mediawiki.org/wiki/Extension:Back-and-Forth (https://www.wikidata.org/wiki/Q21676612) - T212994 |
[tools.zoranzoki21wiki] |
| 09:33 |
<Zoranzoki21> |
tools.zoranzoki21wiki: Archived https://www.mediawiki.org/wiki/Extension:Autoincrement (https://www.wikidata.org/wiki/Q21676537) - T212994 |
[tools.zoranzoki21wiki] |
| 09:22 |
<Zoranzoki21> |
tools.zoranzoki21wiki: Archived Extension:AmazonPartnerLink at wikidata.org (https://www.wikidata.org/wiki/Q21676304) - T212994 |
[tools.zoranzoki21wiki] |
| 09:19 |
<Zoranzoki21> |
tools.zoranzoki21wiki: Archived Extension:AmazonPartnerLink at MediaWiki.org per T212994 |
[tools.zoranzoki21wiki] |
| 09:16 |
<Zoranzoki21> |
tools.zoranzoki21wiki: Archived Extension:AjaxQueryPages at wikidata.org (https://www.wikidata.org/wiki/Q21676173) - T212994 |
[tools.zoranzoki21wiki] |
| 09:03 |
<Zoranzoki21> |
tools.zoranzoki21wiki: Archived Extension:AjaxQueryPages at MediaWiki.org per T212994 |
[tools.zoranzoki21wiki] |
| 09:03 |
<Zoranzoki21> |
tools.zoranzoki21wiki: Archived Extension:AjaxQueryPages at MediaWiki.org |
[tools.zoranzoki21wiki] |
| 08:59 |
<Zoranzoki21> |
Moving process of resolving T212994 to zoranzoki21wiki tool |
[tools.zoranzoki21bot] |
| 08:50 |
<Zoranzoki21> |
Starting process of resolving T212994 |
[tools.zoranzoki21bot] |
| 07:37 |
<elukey> |
decommission analytics1033/34 from the Hadoop cluster |
[analytics] |
|
2019-01-04
§
|
| 23:07 |
<mutante> |
scandium apt-get remove nodejs nodes-legacy ; puppet agent -tv - after merging gerrit:482150 this fixed "you have held broken packages" issue, now we are at a puppet dependecy cycle with apt::pin T201366 |
[production] |
| 21:37 |
<bd808> |
Truncated /data/project/.system/accounting after archiving ~30 days of history |
[tools] |
| 18:17 |
<halfak> |
deploying ores-wmflabs-deploy:f3dbd2 |
[ores] |
| 18:13 |
<halfak> |
staging ores-wmflabs-deploy:f3dbd2 |
[ores] |
| 16:06 |
<halfak> |
ran "sudo service uwsgi-ores restart" on ores-staging-01 |
[ores] |
| 15:42 |
<bawolff@deploy1001> |
Synchronized private/PrivateSettings.php: T212667 - More aggressive anti-spam measures for account creation on kowiki (duration: 00m 48s) |
[production] |
| 15:39 |
<halfak> |
staging ores-wmflabs-deploy:7a3bdf |
[ores] |
| 15:10 |
<Hauskatze> |
restarted cvnbot3 on #cvn-wp-es |
[cvn] |
| 14:08 |
<moritzm> |
rebooting etcd1001-1003 to pick up SSBD-enabled qemu |
[production] |
| 14:05 |
<arturo> |
T212302 creating openstack-puppetmaster-01 and cloudvps-upgrade-test VM instances |
[openstack] |
| 13:52 |
<moritzm> |
rebooting etcd1004-1006 to pick up SSBD-enabled qemu |
[production] |
| 13:33 |
<moritzm> |
rebooting kubernetes staging etcd hosts to pick up SSBD-enabled qemu |
[production] |
| 13:11 |
<moritzm> |
rebooting kubernetes staging master to pick up SSBD-enabled qemu |
[production] |
| 12:57 |
<moritzm> |
rebooting kubernetes staging workers for kernel security update |
[production] |
| 11:58 |
<moritzm> |
installing libsndfile security updates |
[production] |
| 11:33 |
<moritzm> |
installing jasper security updates |
[production] |
| 11:31 |
<moritzm> |
installing libdatetime-timezone-perl updates for recent tz changes |
[production] |