1-50 of 496 results (21ms)
2026-09-12 §
18:23 <Southparkfan> project-wide puppet hiera: remove puppetmaster::geoip::{fetch_private,use_proxy}, puppetdb_host, profile::puppetmaster::common::{command_broadcast,puppetdb_host,puppetdb_hosts} [deployment-prep]
18:14 <Southparkfan> project-wide puppet hiera: remove role::puppetmaster::puppetdb::shared_buffers, obsoleted by profile::puppetdb::database::shared_buffers [deployment-prep]
18:09 <Southparkfan> project-wide puppet hiera: remove profile::puppetdb::master pointing to former deployment-puppetdb02 (overridden in deployment-puppetdb prefix), profile::puppetdb::slaves (by default already empty) + profile::puppetdb::extra_authorized_hosts (variable does not exist, couldn't find it in historic commits either) [deployment-prep]
2026-09-10 §
22:01 <Southparkfan> decommission deployment-mwlog02 - T436469 [deployment-prep]
21:08 <Southparkfan> masked and stopped stray udp2log.service on deployment-mwlog03, claimed 8420/udp which should have been assigned to udp_tee - T436469 [deployment-prep]
2026-09-09 §
22:36 <Southparkfan> point profile::rsyslog::udp_tee::destinations to both deployment-mwlog02 and deployment-mwlog03 8421/udp - T436469 [deployment-prep]
22:32 <Southparkfan> set role::logging::mediawiki::udp2log::monitor: false to unbreak T436469 [deployment-prep]
16:53 <Southparkfan> cpjobqueue: switch back to deployment-jobrunner05 (PHP 8.3) - T435393 [deployment-prep]
16:32 <Southparkfan> adjust cpjobqueue config to temporarily send jobs to deployment-jobrunner06 (PHP 8.5) - T435393 [deployment-prep]
16:12 <Southparkfan> decommission deployment-docker-mathoid02 - T436465 [deployment-prep]
15:40 <komla@cloudcumin1001> END (PASS) - Cookbook wmcs.openstack.quota_increase (exit_code=0) by 30 server-groups (T437117) [deployment-prep]
15:40 <komla@cloudcumin1001> START - Cookbook wmcs.openstack.quota_increase by 30 server-groups (T437117) [deployment-prep]
11:58 <fnegri@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.add_user_to_project (exit_code=0) for user 'denisse' in role 'member' [deployment-prep]
11:58 <fnegri@cloudcumin1001> START - Cookbook wmcs.vps.add_user_to_project for user 'denisse' in role 'member' [deployment-prep]
2026-09-08 §
19:36 <Southparkfan> truncate Apache2 forensic log on deployment-mediawiki14, disk almost full [deployment-prep]
19:35 <Southparkfan> set profile::mediawiki::httpd::enable_forensic_log to false, to avoid disk exhaustion during high-traffic load [deployment-prep]
2026-09-07 §
19:31 <Southparkfan> 19:31 UTC: switch back from PHP 8.5 to PHP 8.3 hosts - T435393 [deployment-prep]
19:06 <Southparkfan> 18:05 UTC: pool mediawiki15 and mediawiki16 (PHP 8.5) as replacements for 13 and 14 (PHP 8.3), smoke test - T435393 [deployment-prep]
19:03 <Southparkfan> banhammer lots of ranges to get Beta Cluster back online; not sure it was very effective, but we seem to be out of the woods [deployment-prep]
17:55 <Southparkfan> no disk space left on deployment-mediawiki14, cleared logs in /var/log/apache2/forensic to unbreak [deployment-prep]
2026-09-03 §
23:29 <Southparkfan> attach Cinder volume for /srv on deploy06, jobrunner06, mediawiki15/mediawiki16 - T435393 [deployment-prep]
2026-09-02 §
22:21 <Southparkfan> decommission deployment-webperf21 - T436464 [deployment-prep]
2026-09-01 §
21:45 <Southparkfan> hiera: switch ATS routing for performance.beta.wmcloud.org from webperf21 to webperf31 - T436464 [deployment-prep]
20:55 <Southparkfan> decommission deployment-webperf22 - T436464 [deployment-prep]
20:52 <Southparkfan> https://gerrit.wikimedia.org/r/c/operations/puppet/+/1333288 cherry-picked on project puppetserver - T436464 [deployment-prep]
19:59 <Southparkfan> decommission deployment-webperf32 - T436464 [deployment-prep]
17:54 <Southparkfan> switch webproxy for wikifeeds-beta to deployment-docker-wikifeeds01 - T436462 [deployment-prep]
17:47 <Southparkfan> switch profile::restbase::citoid_uri and profile::restbase::cxserver_uri to resp. citoid03 and cxserver03, old VMs no longer exist - T436619 [deployment-prep]
17:43 <Southparkfan> revoked Puppet certs for deployment-docker-cxserver02 and deployment-docker-citoid02 - T436619 [deployment-prep]
2026-08-31 §
22:17 <andrewbogott> (log again, mentioned wrong task last time) add PHP 8.5 hosts to Scap dsh groups - T435393 (andrew retrying SPF's failed log) [deployment-prep]
21:21 <Southparkfan> switched cache-text08 backend from mediawiki14 to mediawiki16, then switched back to mediawiki14 to match Puppet state - T435393 [deployment-prep]
21:11 <Southparkfan> add PHP 8.5 hosts to Scap dsh groups - T436462 [deployment-prep]
18:38 <Southparkfan> decommission deployment-wikifeeds02 - T436462 [deployment-prep]
2026-08-26 §
18:07 <andrewbogott> resolving rebase conflicts in /srv/git/labs/private [deployment-prep]
2026-08-25 §
21:32 <brett> Switch acme-chief active to deployment-acme-chief07, passive to deployment-acme-chief08 [deployment-prep]
21:23 <brett> revert deployment-prep acme-chief switch: acme-chief active to deployment-acme-chief05 and passive to deployment-acme-chief06 [deployment-prep]
21:03 <brett> Switch acme-chief active to deployment-acme-chief07, passive to deployment-acme-chief08 [deployment-prep]
20:31 <Southparkfan> T401839 - provisioned deployment-docker-wikifeeds01 (trixie) using Tofu (cloudvps-repos/deployment-prep/tofu-provisioning) [deployment-prep]
07:35 <taavi@cloudcumin1001> END (PASS) - Cookbook wmcs.vps.remove_instance (exit_code=0) for instance deployment-ircd03 [deployment-prep]
07:35 <taavi@cloudcumin1001> START - Cookbook wmcs.vps.remove_instance for instance deployment-ircd03 [deployment-prep]
2026-06-25 §
16:50 <inflatador> add 60GB cinder vol to deployment-cirrussearch15 T425585 [deployment-prep]
14:25 <inflatador> delete unused servers deployment-cirrussearch1[2-4] T425585 [deployment-prep]
2026-06-19 §
07:07 <dcausse> restarted php-fpm on deployment-jobrunner05 (inconsistent php state: MediaWiki\Extension\PageAssessments\HookHandler\ParserHooks::__construct(): Argument #3 ($config) must be of type MediaWiki\Config\Config, MediaWiki\Page\WikiPageFactory given) [deployment-prep]
2026-06-18 §
07:23 <dcausse> reindexing all wikis to opensearch2 (T425585, T427196) [deployment-prep]
2026-06-17 §
14:56 <inflatador> mwscript /srv/mediawiki-staging/php-master/extensions/CirrusSearch/maintenance/ForceSearchIndex.php --wiki=enwikibooks [deployment-prep]
2026-05-02 §
14:02 <TheresNoTime> Add bvibber to deployment-prep project [deployment-prep]
2026-04-21 §
20:47 <inflatador> updating cirrussearch hosts to Trixie/OpenSearch 2 T421763 [deployment-prep]
2026-03-18 §
21:11 <dcausse> T403775: reindexing all wikis to enable new sorting options [deployment-prep]
21:07 <dcausse> restarting opensearch on deployment-cirrussearch(12|13|14) instances to pickup new plugin versions [deployment-prep]
2026-03-13 §
13:59 <andrewbogott> deleting ptr record 117.0.16.172.in-addr.arpa. -- accidental duplicate for deployment-kafka-logging01.deployment-prep.eqiad1.wikimedia.cloud [deployment-prep]