Smart proxy content sync doesn't working while it says it's synchronized

Support
1

Problem:

i have installed katello 3.18 and smart proxy servers in centos7 based on Foreman :: Plugin Manuals docuementation. i have created centos7 and ubuntu18 repos, synced, created content view and promoted to a one environment. . when i go to smart proxy page, i hit sync button and after 1 sec it says "Smart proxy is synchronized ", but actually it didnt do anything. i have 2 warnings that /var/lib/pulp/content is not there which i manually created and /var/lib/mangodb is not readable and i changed the permission to 755. but there is no error whatsoever.
as below please find output of one dynflow tasks. looks like katello server uses pulp3 and smart proxy uses pulp2? not sure about it, but i also set “:enabled: https” in /etc/foreman-proxy/setting.d/pulpcore.yml file to enable pulp3

3: Actions::Pulp::Orchestration::Repository::RefreshRepos (success) [ 0.22s / 0.22s ]

Queue: default

Started at: 2021-04-13 01:06:13 UTC

Ended at: 2021-04-13 01:06:14 UTC

Real time: 0.22s

Execution time (excluding suspended state): 0.22s

Input:

smart_proxy_id: 2
environment_id:
content_view_id:
repository_id:
remote_user: admin
remote_cp_user: admin
current_request_id:
current_timezone: Australia/Sydney
current_user_id: 4
current_organization_id: 1
current_location_id: 2

Output:

pulp_tasks:

Katello server:

HTTPBoot
Version
2.3.3
Pulp
Version
2.1.0
Pulp server version
2.21.5
Database connection
Messaging connection
Workers
4
Supported Content Types

puppet

Pulpcore
Version
2.1.0
Supported Content Types

deb
docker
file
yum

Registration
Version
2.3.3
TFTP
Version
2.3.3
TFTP server
192.168.122.240

Smart proxy server
Pulp node
Version
2.1.0
Pulp server version
2.21.5
Database connection
Messaging connection
Workers
4
Supported Content Types

deb
docker
file
puppet
yum

Registration
Version
2.3.3
Templates
Version
2.3.3

Expected outcome:

sync between katello server and smart proxy initiated when hit sync command or a new content view publishes

Foreman and Proxy versions:

katello01.akunacapital.local Pulp, Pulpcore, Puppet CA, Puppet, Logs, Registration, TFTP, and HTTPBoot

2.3.3
proxy01.akunacapital.local Pulp Node, Templates, Puppet CA, Puppet, Logs, and Registration

2.3.3

Foreman and Proxy plugin versions:

Name Description Author Version
foreman-tasks 3.0.5
foreman_ansible 6.1.1
foreman_bootdisk 17.0.2
foreman_discovery 16.3.4
foreman_hooks 0.3.17
foreman_monitoring 2.1.0
foreman_openscap 4.1.3
foreman_remote_execution 4.2.2
foreman_setup 7.0.0
foreman_templates 9.0.1
katello 3.18.2.1

Distribution and version:
latest centos 7 on both katello and foreman

Other relevant data:

2

according to the service page i posted before, looks like only puppet contents are managed by pulp2 in katello but smart proxy manages all contents by pulp2. now my question is that how i can switch smart proxy to use pulp3 as well like katello server? ive already enabled pulpcore with this setting and restarted the proxy but no luck

[root@proxy01 settings.d]# cat pulpcore.yml

:enabled: https
:pulp_url: https://proxy01.domain.local
:content_app_url: https://proxy01.domain.local/pulp/content
:mirror: false
[root@proxy01 settings.d]#

3

I have reinstalled proxy with below answers. now pulpcore is installed but all plugins are still installed in pulp2 as below. so pulpcore doesnt have any plugins. please let me know how to install pulp3 plugins in smart proxy as i think this sync issue i have is because of that

[root@proxy02 scenarios.d]# cat foreman-proxy-content-answers.yaml|grep pulp
proxy_pulp_deb_to_pulpcore: true
proxy_pulp_isos_to_pulpcore: false
proxy_pulp_yum_to_pulpcore: true
pulpcore_manage_postgresql: true
pulpcore_postgresql_host: localhost
pulpcore_postgresql_port: 5432
pulpcore_postgresql_user: pulp
pulpcore_postgresql_db_name: pulpcore
pulpcore_postgresql_ssl: false
pulpcore_postgresql_ssl_require: true
pulpcore_postgresql_ssl_cert: “/etc/pki/katello/certs/pulpcore-database.crt”
pulpcore_postgresql_ssl_key: “/etc/pki/katello/private/pulpcore-database.key”
pulpcore_postgresql_ssl_root_ca: “/etc/pki/tls/certs/ca-bundle.crt”
pulpcore_worker_count: 2
foreman_proxy::plugin::pulp:
pulpnode_enabled: false
pulpcore_enabled: true
pulpcore_api_url: https://proxy02.domain.local
pulpcore_content_url: https://proxy02.domain.local/pulp/content
pulpcore_mirror: false
pulp_url: https://proxy02.domain.local/pulp
pulp_dir: “/var/lib/pulp”
pulp_content_dir: “/var/lib/pulp/content”

Pulp
Version
2.1.0
Pulp server version
2.21.5
Database connection
Messaging connection
Workers
4
Supported Content Types

deb
docker
file
puppet
yum

Pulpcore
Version
2.1.0
Supported Content Types

Registration
Version
2.3.3
Templates
Version
2.3.3

4

any help in this case is really appreciated.
I have reinstalled katello and proxy to have only pulp2 in both. so i disabled pulpcore (pulp3) from beginning to see if the sync can happen , but no luck. again both optimized and complete syncs finishes in a second and says synchronizing competed but nothing actually happened.
i have found Katello Smart Proxy not Syncing similar to my case. but here i just have “Default organization” and “Default location” which content view, proxy and every other things are part of them, so not sure it/s my case.

5

Hi @yaser - can you share the exact foreman-installer command you used to set up Foreman + Katello?

6

Hi @Jonathon_Turel , i’ve used below commands and tweaked their answer files to switch compeletely on pulp2 to make sync on proxy work but still no luck. in previous posts, I mentioned in proxy i couldnt install pulp3 deb and rpm plugins and by enabling pulpcore, still all plugins in proxy were pulp2. now just want to make sync between katello and proxy works, so switched to pulp2 on both servers without luck. sync still finishes in 1 sec and although it says successfull but no sync has been done yet.
Thanks

Katello installation:

foreman-installer --scenario katello --enable-foreman-plugin-ansible --enable-foreman-plugin-bootdisk --enable-foreman-plugin-setup --enable-foreman-plugin-openscap --enable-foreman-compute-libvirt

katello-answer.yml:
proxy_pulp_deb_to_pulpcore: false
proxy_pulp_isos_to_pulpcore: true
proxy_pulp_yum_to_pulpcore: false

foreman_proxy::plugin::pulp:
enabled: true
listen_on: https
pulpnode_enabled: false
pulpcore_enabled: false

use_pulp_2_for_yum: true
use_pulp_2_for_deb: true

Proxy installation:

foreman-installer --scenario foreman-proxy-content --certs-tar-file “/root/prx01.domain.local-certs.tar” --foreman-proxy-content-parent-fqdn “kat01.domain.local” --foreman-proxy-register-in-foreman “true” --foreman-proxy-foreman-base-url “https://kat01.domain.local” --foreman-proxy-trusted-hosts “kat01.domain.local” --foreman-proxy-trusted-hosts “prx01.domain.local” --foreman-proxy-oauth-consumer-key “D2pvo9QrsA” --foreman-proxy-oauth-consumer-secret “r6zT42fXsQkJD” --puppet-server-foreman-url “https://kat01.domain.local”

foreman-proxy-content.yml file:

proxy_pulp_deb_to_pulpcore: true
proxy_pulp_isos_to_pulpcore: false
proxy_pulp_yum_to_pulpcore: false

enable_deb: true
foreman_proxy::plugin::pulp:
enabled: false
listen_on: https
pulpnode_enabled: true
pulpcore_enabled: false
pulpcore_api_url: https://prx01.akunacapital.local
pulpcore_content_url: https://prx01.akunacapital.local/pulp/content
pulpcore_mirror: false
version:
pulp_url: https://prx01.akunacapital.local/pulp
pulp_dir: “/var/lib/pulp”
pulp_content_dir: “/var/lib/pulp/content”