751-800 of 8601 results (28ms)
2018-12-05 §
14:58 <thcipriani> bring integration-slave-jessie-1004 back online (disks look fine) [releng]
02:57 <kart_> Beta: Updated cxserver to c4240e6 [releng]
2018-12-04 §
06:04 <legoktm> deploying https://gerrit.wikimedia.org/r/477115 [releng]
04:08 <legoktm> deploying https://gerrit.wikimedia.org/r/473724 https://gerrit.wikimedia.org/r/477416 [releng]
2018-12-03 §
22:05 <Krenair> T210214 deleting deployment-cache-text04 [releng]
15:01 <Amir1> ores:03b9c98 is going beta [releng]
2018-11-30 §
22:32 <thcipriani> removing deployment-redis0{5,6} since I can't ssh in, and they don't seem to have any puppet roles applied [releng]
2018-11-29 §
14:26 <godog> switch mediawiki logging to use localhost syslog -> kafka -> logstash [releng]
13:54 <hashar> Building docker-registry.discovery.wmnet/releng/java8-sonar-scanner:0.1.0 for https://gerrit.wikimedia.org/r/475496 | T209849 [releng]
08:35 <hashar> Deleted instances castor02 and integration-publishing , replaced by new instances in the new WMCS region | T208803 [releng]
2018-11-28 §
08:45 <hashar> Switching Jenkins job cache to integration-castor03 with AN EMPTY CACHE | T208803 [releng]
08:18 <godog> test mediawiki kafka logging on deployment-mediawiki-07 [releng]
2018-11-27 §
15:55 <Amir1> giving User:Fisch-WMDE and User:Thiemo Mättig (WMDE) admin rights on enwiki, dewiki and arwiki (WMDE staff, beta cluster) [releng]
13:59 <godog> cherry-pick https://gerrit.wikimedia.org/r/c/operations/puppet/+/475352 [releng]
11:38 <Amir1> Deploying ores:9b9ba06 to beta [releng]
2018-11-26 §
22:22 <Krenair> shutoff deployment-cache-text04, now replaced with deployment-cache-text05 in the new region - T210214 [releng]
18:02 <Amir1> deploy ores:3cdaaa6 to beta [releng]
2018-11-23 §
13:55 <dcausse> restarted elasticsearch on all deployement-elastic0X nodes (search broken on the beta cluster) [releng]
11:09 <hashar> Jenkins: removing plugins "Single Use Slave" and "Event Publisher (via ZMQ PUB SUB)". Were used for Nodepool | T209361 [releng]
10:29 <hashar> Building releng/java8-wikidata-query-rdf:0.2.1 container for https://gerrit.wikimedia.org/r/#/c/integration/config/+/475428/ T209776 [releng]
2018-11-22 §
10:34 <hashar> Building container releng/java8-wikidata-query-rdf:0.2.0 to support Chrome ( https://gerrit.wikimedia.org/r/#/c/integration/config/+/475298/ | T209776 ) [releng]
2018-11-21 §
21:44 <Krenair> Changed beta.wmflabs.org and *.beta.wmflabs.org A records from 208.80.155.135 (deployment-cache-text04) to 185.15.56.36 (deployment-cache-text05) [releng]
20:49 <hashar> gerrit: added WMDE-leszek to group "Gerrit Managers" https://gerrit.wikimedia.org/r/#/admin/groups/119,members | T200311 [releng]
03:25 <bd808> Forced puppet run on deployment-mediawiki-0[79] to pick up new redis::shards settings T210030 [releng]
03:02 <bd808> Repeated application of role::mediawiki::memcached on deployment-memc04, deployment-memc06, and deployment-memc07 for T210030 [releng]
01:22 <bd808> Applied role::mediawiki::memcached on deployment-memc05.deployment-prep.eqiad.wmflabs to provision redis T210030 [releng]
2018-11-20 §
23:45 <mutante> deployment-deploy01 edited /srv/deployment/iegreview/iegreview/.git/DEPLOY_HEAD - - replaced deployment-tin with deployment-deploy1 to fix scap cloning / puppet [releng]
23:01 <mutante> deployment-deploy01 edited /srv/deployment/scholarships/scholarships/.git - replaced deployment-tin with deployment-deploy1 to fix scap / cloning of scholarships app [releng]
22:42 <thcipriani> repooling integration-slave-jessie-1003 after cleaning mvn and gradle cache [releng]
20:23 <Krenair> Changed deployment-prep mysql repl password in attempt to get replication working again, have stored it at deployment-puppetmaster03:/var/lib/git/labs/private/modules/secret/secrets/mysql/repl_password [releng]
18:18 <mdholloway> deployment-mcs01 deployed [mobileapps/deploy@7553087] [releng]
14:59 <hashar> created integration-castor03.integration.eqiad.wmflabs intended as a replacement for castor02 | T208803 [releng]
14:34 <hashar> beta-scap job fixed by deleting a file on deployment-mediawiki-07 [releng]
14:27 <hashar> deployment-mediawiki-07 : sudo rm -fR /srv/mediawiki/.~tmp~/ [releng]
13:55 <andrewbogott> deleting deployment-redis05 and deployment-redis06 as per Giuseppe, "we're not using the old jobqueue, we should remove those vms" [releng]
13:08 <twentyafterfour> removed local unix user mwdeploy from deployment-mediawiki-07 because it was shadowing the real mwdeploy user in ldap [releng]
13:01 <twentyafterfour> PHP Startup: Unable to load dynamic library '/usr/lib/php/20151012/luasandbox.so' - /usr/lib/php/20151012/luasandbox.so: cannot open shared object file: No such file or directory T208101 [releng]
12:11 <twentyafterfour> scap failures on deployment-mediawiki-07 are related to uid/gid mismatch of the mwdeploy user, specifically the owner of that user's home dir is uid 603 but /etc/passwd|group have a different uid/gid for the same username. T208101 [releng]
11:47 <hashar> Armed keyholder on deployment-deploy01 Got shutdown while being migrated a new cloud region # T208101 [releng]
11:00 <hashar> deployment-deploy01 got migrated to a new region but the Jenkins configuration had not been updated. Adjusting IP address from 10.68.23.38 to 172.16.4.18 | T208101 [releng]
10:58 <hashar> Clearing out deployment-deploy01 disk space. Went offline due to disk space consumption [releng]
10:04 <Krenair> manually fixed deployment-mediawiki-09:/srv/mediawiki/wmf-config/db-labs.php to match deployment copy, not sure why it didn't deploy properly yet [releng]
2018-11-19 §
22:40 <Krenair> manually sorted certs for deployment-puppetdb02 [releng]
22:23 <Krenair> duplicated wiki(user|admin) mysql users on deployment-db0[34] - previous hosts 10.%, new hosts 172.16.% [releng]
18:32 <Krenair> creating deployment-cache-text05 to replace deployment-cache-text04 [releng]
15:53 <Amir1> cherry-picking gerrit:474694/1 in beta puppetmaster [releng]
15:06 <Amir1> ores:e957b24 is going beta [releng]
13:47 <hashar> Shutdown integration-publishing , replaced by integration-publishing02 # T208803 [releng]
13:21 <hashar> Created integration-publishing02 172.16.4.5 for WMCS region migration # T208803 [releng]
11:13 <hashar> updating jobs wikidata-query-rdf-maven-java8-docker wikidata-query-rdf-maven-java8-docker-site-publish for https://gerrit.wikimedia.org/r/#/c/integration/config/+/474660/ [releng]