Can't Create VMWare Instance With Foreman 2.x

Problem:
Currently using Foreman 2.x, I’m unable to create a VMWare instance using the network install option when Foreman is configured to talk to vSphere 6.5. The error generated it:

Failed to create a compute vsphere-test (VMware) instance test-instance: InvalidArgument: A specified parameter was not correct: 

There is nothing there to indicate what specified parameter is missing. If I look in vSphere, it shows the same error in the Status message for the related entry in the Tasks section. vSphere shows having creating the host, assigning an instance UUID, BIOS UUID, MAC address and then removing the host.

I am able to create instances when using Foreman 1.7.5 to point to this same vSphere instance.

The relevant entries from production.log are provided at the end of this post.

Expected outcome:

A successfully created host

Foreman and Proxy versions:
foreman-2.3.1-1.el7.noarch
foreman-cli-2.3.1-1.el7.noarch
foreman-debug-2.3.1-1.el7.noarch
foreman-dynflow-sidekiq-2.3.1-1.el7.noarch
foreman-ec2-2.3.1-1.el7.noarch
foreman-installer-2.3.1-1.el7.noarch
foreman-openstack-2.3.1-1.el7.noarch
foreman-postgresql-2.3.1-1.el7.noarch
foreman-proxy-2.3.1-1.el7.noarch
foreman-release-2.3.1-1.el7.noarch
foreman-release-scl-7-3.el7.noarch
foreman-selinux-2.3.1-1.el7.noarch
foreman-vmware-2.3.1-1.el7.noarch
rubygem-foreman_maintain-0.7.1-1.el7.noarch
tfm-rubygem-actioncable-6.0.3.4-1.el7.noarch
tfm-rubygem-actionmailbox-6.0.3.4-1.el7.noarch
tfm-rubygem-actionmailer-6.0.3.4-1.el7.noarch
tfm-rubygem-actionpack-6.0.3.4-1.el7.noarch
tfm-rubygem-actiontext-6.0.3.4-1.el7.noarch
tfm-rubygem-actionview-6.0.3.4-1.el7.noarch
tfm-rubygem-activejob-6.0.3.4-1.el7.noarch
tfm-rubygem-activemodel-6.0.3.4-1.el7.noarch
tfm-rubygem-activerecord-6.0.3.4-1.el7.noarch
tfm-rubygem-activerecord-session_store-1.1.1-4.el7.noarch
tfm-rubygem-activestorage-6.0.3.4-1.el7.noarch
tfm-rubygem-activesupport-6.0.3.4-1.el7.noarch
tfm-rubygem-addressable-2.6.0-2.el7.noarch
tfm-rubygem-algebrick-0.7.3-7.el7.noarch
tfm-rubygem-amazing_print-1.1.0-1.el7.noarch
tfm-rubygem-ancestry-3.0.7-1.el7.noarch
tfm-rubygem-ansi-1.5.0-2.el7.noarch
tfm-rubygem-apipie-bindings-0.4.0-1.el7.noarch
tfm-rubygem-apipie-dsl-2.3.0-1.el7.noarch
tfm-rubygem-apipie-params-0.0.5-4.el7.noarch
tfm-rubygem-apipie-rails-0.5.17-3.el7.noarch
tfm-rubygem-arel-9.0.0-4.el7.noarch
tfm-rubygem-audited-4.9.0-3.el7.noarch
tfm-rubygem-awesome_print-1.8.0-5.el7.noarch
tfm-rubygem-bcrypt-3.1.12-3.el7.x86_64
tfm-rubygem-builder-3.2.4-1.el7.noarch
tfm-rubygem-bundler_ext-0.4.1-5.el7.noarch
tfm-rubygem-clamp-1.1.2-6.el7.noarch
tfm-rubygem-concurrent-ruby-1.1.6-2.el7.noarch
tfm-rubygem-concurrent-ruby-edge-0.6.0-2.fm2_1.el7.noarch
tfm-rubygem-connection_pool-2.2.2-2.el7.noarch
tfm-rubygem-crass-1.0.6-1.el7.noarch
tfm-rubygem-css_parser-1.4.7-4.el7.noarch
tfm-rubygem-daemons-1.2.3-6.el7.noarch
tfm-rubygem-deacon-1.0.0-4.el7.noarch
tfm-rubygem-deep_cloneable-3.0.0-3.el7.noarch
tfm-rubygem-diffy-3.0.1-5.el7.noarch
tfm-rubygem-domain_name-0.5.20160310-4.el7.noarch
tfm-rubygem-dynflow-1.4.7-1.fm2_3.el7.noarch
tfm-rubygem-erubi-1.9.0-1.el7.noarch
tfm-rubygem-excon-0.76.0-1.el7.noarch
tfm-rubygem-facter-2.4.0-7.el7.x86_64
tfm-rubygem-fast_gettext-1.4.1-4.el7.noarch
tfm-rubygem-ffi-1.12.2-1.el7.x86_64
tfm-rubygem-fog-aws-3.6.5-1.el7.noarch
tfm-rubygem-fog-core-2.1.0-3.el7.noarch
tfm-rubygem-fog-json-1.2.0-3.el7.noarch
tfm-rubygem-fog-openstack-1.0.8-3.el7.noarch
tfm-rubygem-fog-vsphere-3.4.0-1.el7.noarch
tfm-rubygem-fog-xml-0.1.2-8.el7.noarch
tfm-rubygem-foreman_default_hostgroup-5.0.0-4.fm2_1.el7.noarch
tfm-rubygem-foreman_hooks-0.3.17-1.fm2_3.el7.noarch
tfm-rubygem-foreman_templates-9.0.1-1.fm2_2.el7.noarch
tfm-rubygem-formatador-0.2.1-12.el7.noarch
tfm-rubygem-friendly_id-5.3.0-1.el7.noarch
tfm-rubygem-get_process_mem-0.2.1-4.el7.noarch
tfm-rubygem-gettext_i18n_rails-1.8.0-2.el7.noarch
tfm-rubygem-git-1.5.0-1.el7.noarch
tfm-rubygem-gitlab-sidekiq-fetcher-0.6.0-1.el7.noarch
tfm-rubygem-globalid-0.4.2-1.el7.noarch
tfm-rubygem-graphql-1.8.14-2.el7.noarch
tfm-rubygem-graphql-batch-0.3.10-2.el7.noarch
tfm-rubygem-gssapi-1.2.0-7.el7.noarch
tfm-rubygem-hammer_cli-2.3.0-1.el7.noarch
tfm-rubygem-hammer_cli_foreman-2.3.0-1.el7.noarch
tfm-rubygem-hashie-3.6.0-2.el7.noarch
tfm-rubygem-highline-1.7.8-5.el7.noarch
tfm-rubygem-http-cookie-1.0.2-4.el7.noarch
tfm-rubygem-i18n-1.8.2-1.el7.noarch
tfm-rubygem-ipaddress-0.8.0-12.el7.noarch
tfm-rubygem-jwt-2.2.1-2.el7.noarch
tfm-rubygem-kafo-6.1.2-1.el7.noarch
tfm-rubygem-kafo_parsers-1.1.0-3.el7.noarch
tfm-rubygem-kafo_wizards-0.0.1-4.el7.noarch
tfm-rubygem-ldap_fluff-0.4.7-5.el7.noarch
tfm-rubygem-little-plugger-1.1.4-2.el7.noarch
tfm-rubygem-locale-2.0.9-14.el7.noarch
tfm-rubygem-logging-2.3.0-1.el7.noarch
tfm-rubygem-loofah-2.4.0-1.el7.noarch
tfm-rubygem-mail-2.7.1-1.el7.noarch
tfm-rubygem-marcel-0.3.3-1.el7.noarch
tfm-rubygem-method_source-0.9.2-2.el7.noarch
tfm-rubygem-mimemagic-0.3.5-1.el7.noarch
tfm-rubygem-mime-types-3.2.2-4.el7.noarch
tfm-rubygem-mime-types-data-3.2018.0812-4.el7.noarch
tfm-rubygem-mini_mime-1.0.2-1.el7.noarch
tfm-rubygem-mini_portile2-2.4.0-1.el7.noarch
tfm-rubygem-multi_json-1.14.1-2.el7.noarch
tfm-rubygem-mustermann-1.0.2-4.el7.noarch
tfm-rubygem-net-ldap-0.16.1-2.el7.noarch
tfm-rubygem-net-ping-2.0.1-4.el7.noarch
tfm-rubygem-netrc-0.11.0-5.el7.noarch
tfm-rubygem-net-scp-1.2.1-4.el7.noarch
tfm-rubygem-net-ssh-4.2.0-2.el7.noarch
tfm-rubygem-nio4r-2.5.4-1.el7.x86_64
tfm-rubygem-nokogiri-1.10.9-1.el7.x86_64
tfm-rubygem-oauth-0.5.4-4.el7.noarch
tfm-rubygem-optimist-3.0.0-2.el7.noarch
tfm-rubygem-passenger-4.0.18-10.13.el7.x86_64
tfm-rubygem-passenger-native-4.0.18-10.13.el7.x86_64
tfm-rubygem-passenger-native-libs-4.0.18-10.13.el7.x86_64
tfm-rubygem-pg-1.1.4-3.el7.x86_64
tfm-rubygem-powerbar-2.0.1-2.el7.noarch
tfm-rubygem-promise.rb-0.7.4-2.el7.noarch
tfm-rubygem-public_suffix-3.0.3-2.el7.noarch
tfm-rubygem-puppetdb_foreman-5.0.0-2.fm2_1.el7.noarch
tfm-rubygem-rabl-0.14.3-1.el7.noarch
tfm-rubygem-rack-2.2.3-1.el7.noarch
tfm-rubygem-rack-cors-1.0.2-2.el7.noarch
tfm-rubygem-rack-jsonp-1.3.1-9.el7.noarch
tfm-rubygem-rack-protection-2.0.3-4.el7.noarch
tfm-rubygem-rack-test-1.1.0-4.el7.noarch
tfm-rubygem-rails-6.0.3.4-1.el7.noarch
tfm-rubygem-rails-dom-testing-2.0.3-6.el7.noarch
tfm-rubygem-rails-html-sanitizer-1.3.0-1.el7.noarch
tfm-rubygem-rails-i18n-6.0.0-2.el7.noarch
tfm-rubygem-railties-6.0.3.4-1.el7.noarch
tfm-rubygem-rake-compiler-1.0.7-3.el7.noarch
tfm-rubygem-rb-inotify-0.9.7-5.el7.noarch
tfm-rubygem-rbvmomi-2.2.0-3.el7.noarch
tfm-rubygem-record_tag_helper-1.0.1-3.el7.noarch
tfm-rubygem-redfish_client-0.5.2-1.el7.noarch
tfm-rubygem-redis-4.1.2-2.el7.noarch
tfm-rubygem-responders-3.0.0-3.el7.noarch
tfm-rubygem-rest-client-2.0.2-3.el7.noarch
tfm-rubygem-rkerberos-0.1.5-19.el7.x86_64
tfm-rubygem-roadie-3.4.0-3.el7.noarch
tfm-rubygem-roadie-rails-2.1.1-2.el7.noarch
tfm-rubygem-rsec-0.4.3-4.el7.noarch
tfm-rubygem-ruby2ruby-2.4.2-3.el7.noarch
tfm-rubygem-rubyipmi-0.10.0-6.el7.noarch
tfm-rubygem-ruby-libvirt-0.7.1-1.el7.x86_64
tfm-rubygem-ruby_parser-3.10.1-3.el7.noarch
tfm-rubygem-safemode-1.3.6-1.el7.noarch
tfm-rubygem-scoped_search-4.1.9-1.el7.noarch
tfm-rubygem-sd_notify-0.1.0-1.el7.noarch
tfm-rubygem-secure_headers-6.3.0-2.el7.noarch
tfm-rubygem-sequel-5.7.1-3.el7.noarch
tfm-rubygem-server_sent_events-0.1.2-1.el7.noarch
tfm-rubygem-sexp_processor-4.10.0-6.el7.noarch
tfm-rubygem-sidekiq-5.2.7-3.el7.noarch
tfm-rubygem-sinatra-2.0.3-4.el7.noarch
tfm-rubygem-sprockets-4.0.2-1.el7.noarch
tfm-rubygem-sprockets-rails-3.2.1-6.el7.noarch
tfm-rubygem-sshkey-1.9.0-4.el7.noarch
tfm-rubygem-statsd-instrument-2.1.4-3.el7.noarch
tfm-rubygem-thor-1.0.1-2.el7.noarch
tfm-rubygem-thread_safe-0.3.6-5.el7.noarch
tfm-rubygem-tilt-2.0.8-4.el7.noarch
tfm-rubygem-tzinfo-1.2.6-1.el7.noarch
tfm-rubygem-unf-0.1.3-8.el7.noarch
tfm-rubygem-unf_ext-0.0.7.2-3.el7.x86_64
tfm-rubygem-unicode-0.4.4.4-3.el7.x86_64
tfm-rubygem-unicode-display_width-1.0.5-4.el7.noarch
tfm-rubygem-validates_lengths_from_database-0.5.0-7.el7.noarch
tfm-rubygem-webpack-rails-0.9.8-5.el7.noarch
tfm-rubygem-websocket-driver-0.7.1-1.el7.x86_64
tfm-rubygem-websocket-extensions-0.1.5-1.el7.noarch
tfm-rubygem-will_paginate-3.1.7-3.el7.noarch
tfm-rubygem-xmlrpc-0.3.0-2.el7.noarch
tfm-rubygem-zeitwerk-2.2.2-1.el7.noarch
tfm-runtime-6.1-4.el7.x86_64

Distribution and version:
CentOS 7.9.2009

Other relevant data:
Entries from production.log. Some text was replaced to hide internal vsphere details. If some names don’t line up, that may be why.

2020-12-14T19:58:05 [I|app|528d20e9] Started POST "/hosts" for 10.0.0.10 at 2020-12-14 19:58:05 +0000
2020-12-14T19:58:05 [I|app|528d20e9] Processing by HostsController#create as */*
2020-12-14T19:58:05 [I|app|528d20e9]   Parameters: {"utf8"=>"✓", "authenticity_token"=>"ksQcfO32VPcqVGQcjBkl9vuCreAtEY9lz81YQpWXqGzElwIgS+uT9XfFhWS+o+maTENOjWOYb95m5UBXZvyQ1A==", "host"=>{"name"=>"test-instance", "organization_id"=>"1", "location_id"=>"2", "hostgroup_id
"=>"29", "puppetclass_ids"=>[""], "managed"=>"true", "progress_report_id"=>"[FILTERED]", "type"=>"Host::Managed", "interfaces_attributes"=>{"0"=>{"_destroy"=>"0", "type"=>"Nic::Managed", "identifier"=>"", "name"=>"test-instance", "domain_id"=>"2", "subnet_id"=>"1", "ip"
=>"", "ip6"=>"", "managed"=>"1", "primary"=>"1", "provision"=>"1", "virtual"=>"0", "tag"=>"", "attached_to"=>"", "compute_attributes"=>{"type"=>"VirtualVmxnet3", "network"=>"network-30"}}}, "compute_attributes"=>{"cpus"=>"1", "corespersocket"=>"1", "memory_mb"=>"2048", "fir
mware"=>"bios", "cluster"=>"QA", "resource_pool"=>"Resources", "path"=>"/Datacenters/test/vm", "guest_id"=>"centos7_64Guest", "hardware_version"=>"Default", "memoryHotAddEnabled"=>"0", "cpuHotAddEnabled"=>"0", "add_cdrom"=>"0", "boot_order"=>["network", "disk"], "sta
rt"=>"1", "annotation"=>"", "scsi_controllers"=>"{\"scsiControllers\":[{\"type\":\"ParaVirtualSCSIController\",\"key\":1000}],\"volumes\":[{\"thin\":true,\"name\":\"Hard disk\",\"mode\":\"persistent\",\"controllerKey\":1000,\"sizeGb\":10,\"datastore\":\"vmware-svm\",\"st
oragePod\":null,\"eagerZero\":false}]}"}, "architecture_id"=>"1", "operatingsystem_id"=>"14", "provision_method"=>"build", "build"=>"1", "medium_id"=>"1", "ptable_id"=>"114", "pxe_loader"=>"", "disk"=>"", "root_pass"=>"[FILTERED]", "is_owned_by"=>"5-Users", "enabled"=>"1", 
"comment"=>"", "overwrite"=>"false"}}
2020-12-14T19:58:05 [I|app|528d20e9] Adding Compute instance for test-instance.test.com
2020-12-14T19:58:05 [I|app|528d20e9] Loaded compute resource data for networks in 0.33421319 seconds
2020-12-14T19:58:06 [W|app|528d20e9] Failed to create a compute vsphere-test (VMware) instance test-instance.test.com: InvalidArgument: A specified parameter was not correct: 
2020-12-14T19:58:06 [I|app|528d20e9] Backtrace for 'Failed to create a compute vsphere-test (VMware) instance test-instance.test.com: InvalidArgument: A specified parameter was not correct: 
 ' error (RbVmomi::Fault): InvalidArgument: A specified parameter was not correct: 
/opt/theforeman/tfm/root/usr/share/gems/gems/rbvmomi-2.2.0/lib/rbvmomi/vim/Task.rb:14:in `wait_for_completion'
/opt/theforeman/tfm/root/usr/share/gems/gems/fog-vsphere-3.4.0/lib/fog/vsphere/requests/compute/create_vm.rb:48:in `create_vm_on_datastore'
/opt/theforeman/tfm/root/usr/share/gems/gems/fog-vsphere-3.4.0/lib/fog/vsphere/requests/compute/create_vm.rb:40:in `create_vm'
/opt/theforeman/tfm/root/usr/share/gems/gems/fog-vsphere-3.4.0/lib/fog/vsphere/models/compute/server.rb:302:in `save'
/usr/share/foreman/app/models/compute_resources/foreman/model/vmware.rb:489:in `create_vm'
/usr/share/foreman/app/models/concerns/orchestration/compute.rb:91:in `setCompute'
/usr/share/foreman/app/models/concerns/orchestration.rb:227:in `execute'
/usr/share/foreman/app/models/concerns/orchestration.rb:152:in `block in process'
/usr/share/foreman/app/models/concerns/orchestration.rb:144:in `each'
/usr/share/foreman/app/models/concerns/orchestration.rb:144:in `process'
/usr/share/foreman/app/models/concerns/orchestration.rb:44:in `around_save_orchestration'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:139:in `run_callbacks'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:825:in `_run_save_callbacks'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/callbacks.rb:327:in `create_or_update'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/timestamp.rb:128:in `create_or_update'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/persistence.rb:470:in `save'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/validations.rb:47:in `save'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/transactions.rb:314:in `block in save'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/transactions.rb:375:in `block in with_transaction_returning_status'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/connection_adapters/abstract/database_statements.rb:280:in `block in transaction'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/connection_adapters/abstract/transaction.rb:280:in `block in within_new_transaction'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/concurrency/load_interlock_aware_monitor.rb:26:in `block (2 levels) in synchronize'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `handle_interrupt'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `block in synchronize'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `handle_interrupt'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `synchronize'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/connection_adapters/abstract/transaction.rb:278:in `within_new_transaction'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/connection_adapters/abstract/database_statements.rb:280:in `transaction'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/transactions.rb:212:in `transaction'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/transactions.rb:366:in `with_transaction_returning_status'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/transactions.rb:314:in `save'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/suppressor.rb:44:in `save'
/usr/share/foreman/app/models/concerns/foreman/sti.rb:26:in `save'
/usr/share/foreman/app/controllers/hosts_controller.rb:98:in `create'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_controller/metal/basic_implicit_render.rb:6:in `send_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/abstract_controller/base.rb:195:in `process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_controller/metal/rendering.rb:30:in `process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/abstract_controller/callbacks.rb:42:in `block in process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:112:in `block in run_callbacks'
/usr/share/foreman/app/controllers/concerns/foreman/controller/timezone.rb:10:in `set_timezone'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/usr/share/foreman/app/models/concerns/foreman/thread_session.rb:32:in `clear_thread'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/usr/share/foreman/app/controllers/concerns/foreman/controller/topbar_sweeper.rb:12:in `set_topbar_sweeper_controller'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/opt/theforeman/tfm/root/usr/share/gems/gems/audited-4.9.0/lib/audited/sweeper.rb:14:in `around'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/opt/theforeman/tfm/root/usr/share/gems/gems/audited-4.9.0/lib/audited/sweeper.rb:14:in `around'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:139:in `run_callbacks'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/abstract_controller/callbacks.rb:41:in `process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_controller/metal/rescue.rb:22:in `process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_controller/metal/instrumentation.rb:33:in `block in process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/notifications.rb:180:in `block in instrument'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/notifications/instrumenter.rb:24:in `instrument'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/notifications.rb:180:in `instrument'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_controller/metal/instrumentation.rb:32:in `process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_controller/metal/params_wrapper.rb:245:in `process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/railties/controller_runtime.rb:27:in `process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/abstract_controller/base.rb:136:in `process'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionview-6.0.3.4/lib/action_view/rendering.rb:39:in `process'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_controller/metal.rb:190:in `dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_controller/metal.rb:254:in `dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/routing/route_set.rb:50:in `dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/routing/route_set.rb:33:in `serve'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/journey/router.rb:49:in `block in serve'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/journey/router.rb:32:in `each'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/journey/router.rb:32:in `serve'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/routing/route_set.rb:834:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/apipie-dsl-2.3.0/lib/apipie_dsl/static_dispatcher.rb:67:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/static_dispatcher.rb:66:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/extractor/recorder.rb:137:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/static.rb:126:in `call'
/usr/share/foreman/lib/foreman/middleware/telemetry.rb:10:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/middleware/checksum_in_headers.rb:27:in `call'
/usr/share/foreman/lib/foreman/middleware/catch_json_parse_errors.rb:9:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/tempfile_reaper.rb:15:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/etag.rb:27:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/conditional_get.rb:40:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/head.rb:12:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/http/content_security_policy.rb:18:in `call'
/usr/share/foreman/lib/foreman/middleware/logging_context_session.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/session/abstract/id.rb:266:in `context'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/session/abstract/id.rb:260:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/cookies.rb:648:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/callbacks.rb:27:in `block in call'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:101:in `run_callbacks'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/callbacks.rb:26:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/actionable_exceptions.rb:18:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/debug_exceptions.rb:32:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/show_exceptions.rb:33:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/rack/logger.rb:37:in `call_app'
/opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/rack/logger.rb:28:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/sprockets-rails-3.2.1/lib/sprockets/rails/quiet_assets.rb:13:in `call'
/usr/share/foreman/lib/foreman/middleware/logging_context_request.rb:11:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/remote_ip.rb:81:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/request_id.rb:27:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/method_override.rb:24:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/runtime.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/cache/strategy/local_cache_middleware.rb:29:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/executor.rb:14:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/static.rb:126:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/sendfile.rb:110:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/host_authorization.rb:76:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/secure_headers-6.3.0/lib/secure_headers/middleware.rb:11:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/engine.rb:527:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/railtie.rb:190:in `public_send'
/opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/railtie.rb:190:in `method_missing'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/urlmap.rb:74:in `block in call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/urlmap.rb:58:in `each'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/urlmap.rb:58:in `call'
/usr/share/passenger/phusion_passenger/rack/thread_handler_extension.rb:74:in `process_request'
/usr/share/passenger/phusion_passenger/request_handler/thread_handler.rb:141:in `accept_and_process_next_request'
/usr/share/passenger/phusion_passenger/request_handler/thread_handler.rb:109:in `main_loop'
/usr/share/passenger/phusion_passenger/request_handler.rb:455:in `block (3 levels) in start_threads'
/opt/theforeman/tfm/root/usr/share/gems/gems/logging-2.3.0/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context'
2020-12-14T19:58:06 [W|app|528d20e9] Rolling back due to a problem: [#<Orchestration::Task:0x00007fae598a0598 @name="Set up compute instance test-instance.test.com", @id="Set up compute instance test-instance.test.com", @status="failed", @priority=3, @action=[#<Host::Managed id: nil, name: "test-instance.test.com", last_compile: nil, last_report: nil, updated_at: nil, created_at: nil, root_pass: [FILTERED], architecture_id: 1, operatingsystem_id: 14, environment_id: 1, ptable_id: 114, medium_id: 1, build: true, comment: "", disk: "", installed_at: nil, model_id: nil, hostgroup_id: 29, owner_id: 5, owner_type: "User", enabled: true, puppet_ca_proxy_id: 1, managed: true, use_image: nil, image_file: nil, uuid: nil, compute_resource_id: 2, puppet_proxy_id: 1, certname: nil, image_id: nil, organization_id: 1, location_id: 2, type: "Host::Managed", otp: nil, realm_id: nil, compute_profile_id: 4, provision_method: "build", grub_pass: "$5$QVtVwdYjxaOnX5uR$U3PrcKppHOEbapBpU0QWJLTgEgQdxk...", global_status: 0, lookup_value_matcher: [FILTERED], pxe_loader: "", initiated_at: nil, build_errors: nil>, :setCompute], @created=1607975885.4802907, @timestamp=2020-12-14 19:58:06 UTC>]
2020-12-14T19:58:06 [I|app|528d20e9] Processed 1 tasks from queue 'Host::Managed Main', completed 0/3
2020-12-14T19:58:06 [E|app|528d20e9] Task 'Set up compute instance test-instance.test.com' *failed*
2020-12-14T19:58:06 [E|app|528d20e9] Task 'Query instance details for test-instance.test.com' *canceled*
2020-12-14T19:58:06 [E|app|528d20e9] Task 'Power up compute instance test-instance.test.com' *canceled*
2020-12-14T19:58:06 [E|app|528d20e9] Failed to save: Failed to create a compute vsphere-test (VMware) instance test-instance.test.com: InvalidArgument: A specified parameter was not correct: 
 
2020-12-14T19:58:06 [I|app|528d20e9]   Rendering hosts/new.html.erb within layouts/application
2020-12-14T19:58:06 [I|app|528d20e9]   Rendered hosts/_progress.html.erb (Duration: 0.4ms | Allocations: 247)
2020-12-14T19:58:06 [I|app|528d20e9]   Rendered hosts/puppet/_main_tab_fields.html.erb (Duration: 4.6ms | Allocations: 2625)
2020-12-14T19:58:06 [I|app|528d20e9]   Rendered collection of puppetclasses/_selectedClasses.html.erb [0 times] (Duration: 0.0ms | Allocations: 3)
2020-12-14T19:58:06 [I|app|528d20e9]   Rendered collection of puppetclasses/_classes_in_groups.html.erb [0 times] (Duration: 0.0ms | Allocations: 3)
2020-12-14T19:58:06 [I|app|528d20e9]   Rendered puppetclasses/_classes.html.erb (Duration: 100.8ms | Allocations: 153039)
2020-12-14T19:58:06 [I|app|528d20e9]   Rendered puppetclasses/_class_selection.html.erb (Duration: 170.1ms | Allocations: 201921)
2020-12-14T19:58:06 [I|app|528d20e9]   Rendered hosts/puppet/_puppet_classes_tab.html.erb (Duration: 171.2ms | Allocations: 202301)
2020-12-14T19:58:07 [I|app|528d20e9]   Rendered nic/_base_form.html.erb (Duration: 32.3ms | Allocations: 20836)
2020-12-14T19:58:07 [I|app|528d20e9]   Rendered nic/_virtual_form.html.erb (Duration: 1.1ms | Allocations: 1019)
2020-12-14T19:58:07 [I|app|528d20e9] Loaded compute resource data for networks in 0.320916284 seconds
2020-12-14T19:58:07 [I|app|528d20e9]   Rendered compute_resources_vms/form/vmware/_network.html.erb (Duration: 322.2ms | Allocations: 19189)
2020-12-14T19:58:07 [I|app|528d20e9]   Rendered nic/_provider_specific_form.html.erb (Duration: 323.7ms | Allocations: 20312)
2020-12-14T19:58:07 [I|app|528d20e9]   Rendered nic/manageds/_managed.html.erb (Duration: 360.1ms | Allocations: 44083)
2020-12-14T19:58:07 [I|app|528d20e9]   Rendered nic/_base_form.html.erb (Duration: 36.3ms | Allocations: 19621)
2020-12-14T19:58:07 [I|app|528d20e9]   Rendered nic/_virtual_form.html.erb (Duration: 0.9ms | Allocations: 864)
2020-12-14T19:58:07 [I|app|528d20e9] Loaded compute resource data for networks in 0.295781643 seconds
2020-12-14T19:58:07 [I|app|528d20e9]   Rendered compute_resources_vms/form/vmware/_network.html.erb (Duration: 296.9ms | Allocations: 19009)
2020-12-14T19:58:07 [I|app|528d20e9]   Rendered nic/_provider_specific_form.html.erb (Duration: 298.0ms | Allocations: 19650)
2020-12-14T19:58:07 [I|app|528d20e9]   Rendered nic/manageds/_managed.html.erb (Duration: 338.1ms | Allocations: 41441)
2020-12-14T19:58:07 [I|app|528d20e9]   Rendered hosts/_interfaces.html.erb (Duration: 701.0ms | Allocations: 86969)
2020-12-14T19:58:08 [I|app|528d20e9] Loaded compute resource data for cluster-QA in 0.489092073 seconds
2020-12-14T19:58:08 [I|app|528d20e9] Loaded compute resource data for resource_pools-QA in 0.669930514 seconds
2020-12-14T19:58:09 [I|app|528d20e9] Loaded compute resource data for folders in 0.266865067 seconds
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered compute_resources_vms/form/vmware/_base.html.erb (Duration: 1461.8ms | Allocations: 149565)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered compute_resources_vms/form/_volumes.html.erb (Duration: 1.4ms | Allocations: 459)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered hosts/_compute_detail.html.erb (Duration: 1465.1ms | Allocations: 150680)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered hosts/_compute.html.erb (Duration: 1467.9ms | Allocations: 152031)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered common/os_selection/_architecture.html.erb (Duration: 6.8ms | Allocations: 2304)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered common/os_selection/_pxe_loader.html.erb (Duration: 7.1ms | Allocations: 2475)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered common/os_selection/_operatingsystem.html.erb (Duration: 36.0ms | Allocations: 12122)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered hosts/provision_method/build/_form.html.erb (Duration: 38.4ms | Allocations: 13197)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered hosts/provision_method/image/_form.html.erb (Duration: 0.5ms | Allocations: 125)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered hosts/_operating_system.html.erb (Duration: 52.8ms | Allocations: 18273)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered hosts/_unattended.html.erb (Duration: 1522.3ms | Allocations: 170946)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered collection of puppetclasses/_class_parameters.html.erb [3 times] (Duration: 9.9ms | Allocations: 3100)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered puppetclasses/_classes_parameters.html.erb (Duration: 28.1ms | Allocations: 9093)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered common_parameters/_inherited_parameters.html.erb (Duration: 2.5ms | Allocations: 1377)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered common_parameters/_parameter.html.erb (Duration: 2.6ms | Allocations: 1448)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered common_parameters/_parameters.html.erb (Duration: 5.8ms | Allocations: 2856)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered hosts/_form.html.erb (Duration: 2543.2ms | Allocations: 515396)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered hosts/new.html.erb within layouts/application (Duration: 2544.5ms | Allocations: 515768)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered layouts/_application_content.html.erb (Duration: 2.2ms | Allocations: 739)
2020-12-14T19:58:09 [I|app|528d20e9]   Rendering layouts/base.html.erb
2020-12-14T19:58:09 [I|app|528d20e9]   Rendered layouts/base.html.erb (Duration: 39.1ms | Allocations: 28502)
2020-12-14T19:58:09 [I|app|528d20e9] Completed 200 OK in 4330ms (Views: 2553.2ms | ActiveRecord: 54.0ms | Allocations: 719183)

Forgot to include this in the original post.

I tried Foreman 2.0.3, 2.1.4, 2.2.1, 2.3.0, and 2.3.1 and they all produced the same error.

It seems like some parameter has invalid value, but it doesn’t show the actual vsphere request so it’s hard to pin point what parameter it might be, as the request parameters seems correct. Could you try editing /usr/share/foreman/ this file: https://github.com/theforeman/foreman/blob/fb285ce995975fb255151d9385a16554b8d51295/app/models/compute_resources/foreman/model/vmware.rb#L743

and add

:debug => true

And after restarting the server, it should give you more information in the log. Then you can see the actual request to vsphere. If that doesn’t help, you can share it and I can take a look into that for you.

Unfortunately that didn’t seem to make anything new show up in the output that jumped out to me.

I added the suggested change:

--- ./app/models/compute_resources/foreman/model/vmware.rb.orig 2020-12-15 19:34:01.640348926 +0000
+++ ./app/models/compute_resources/foreman/model/vmware.rb      2020-12-15 19:09:52.002503625 +0000
@@ -740,7 +740,8 @@
         :vsphere_username             => user,
         :vsphere_password             => password,
         :vsphere_server               => server,
-        :vsphere_expected_pubkey_hash => pubkey_hash
+        :vsphere_expected_pubkey_hash => pubkey_hash,
+        :debug                        => true
       )
     rescue => e
       if e.message =~ /The remote system presented a public key with hash (\w+) but we're expecting a hash of/

I then stopped and started httpd and foreman-proxy

I then attempted to create the host again and got the following:

2020-12-15T19:22:59 [I|app|bab8dc2a] Started POST "/hosts" for 10.0.0.10 at 2020-12-15 19:22:59 +0000
2020-12-15T19:22:59 [I|app|bab8dc2a] Processing by HostsController#create as */*
2020-12-15T19:22:59 [I|app|bab8dc2a]   Parameters: {"utf8"=>"✓", "authenticity_token"=>"s/YSmmaFbTb4swI8verc81WC+dKFNjwd0pzlqkXU9D99XYM8ksdXp1BDJSQbv6tZb4PIaGcsHbdFtAP6S3rP3A==", "host"=>{"name"=>"test-instance", "organization_id"=>"1", "location_id"=>"2", "hostgroup_id"=>"29", "puppetclass_ids"=>[""], "managed"=>"true", "progress_report_id"=>"[FILTERED]", "type"=>"Host::Managed", "interfaces_attributes"=>{"0"=>{"_destroy"=>"0", "type"=>"Nic::Managed", "identifier"=>"", "name"=>"test-instance", "domain_id"=>"2", "subnet_id"=>"1", "ip"=>"", "ip6"=>"", "managed"=>"1", "primary"=>"1", "provision"=>"1", "virtual"=>"0", "tag"=>"", "attached_to"=>"", "compute_attributes"=>{"type"=>"VirtualVmxnet3", "network"=>"network-30"}}}, "compute_attributes"=>{"cpus"=>"1", "corespersocket"=>"1", "memory_mb"=>"2048", "firmware"=>"bios", "cluster"=>"QA", "resource_pool"=>"Resources", "path"=>"/Datacenters/test/vm", "guest_id"=>"centos7_64Guest", "hardware_version"=>"Default", "memoryHotAddEnabled"=>"0", "cpuHotAddEnabled"=>"0", "add_cdrom"=>"0", "boot_order"=>["network", "disk"], "start"=>"1", "annotation"=>"", "scsi_controllers"=>"{\"scsiControllers\":[{\"type\":\"ParaVirtualSCSIController\",\"key\":1000}],\"volumes\":[{\"thin\":true,\"name\":\"Hard disk\",\"mode\":\"persistent\",\"controllerKey\":1000,\"sizeGb\":10,\"datastore\":\"vmware-svm\",\"storagePod\":null,\"eagerZero\":false}]}"}, "architecture_id"=>"1", "operatingsystem_id"=>"14", "provision_method"=>"build", "build"=>"1", "medium_id"=>"1", "ptable_id"=>"114", "pxe_loader"=>"", "disk"=>"", "root_pass"=>"[FILTERED]", "is_owned_by"=>"5-Users", "enabled"=>"1", "comment"=>"", "overwrite"=>"false"}}
2020-12-15T19:22:59 [I|app|bab8dc2a] Adding Compute instance for test-instance.test.com
2020-12-15T19:23:00 [I|app|bab8dc2a] Loaded compute resource data for networks in 0.281262 seconds
2020-12-15T19:23:00 [W|app|bab8dc2a] Failed to create a compute vsphere-test (VMware) instance test-instance.test.com: InvalidArgument: A specified parameter was not correct: 
2020-12-15T19:23:00 [I|app|bab8dc2a] Backtrace for 'Failed to create a compute vsphere-test (VMware) instance test-instance.test.com: InvalidArgument: A specified parameter was not correct: 
 ' error (RbVmomi::Fault): InvalidArgument: A specified parameter was not correct: 
/opt/theforeman/tfm/root/usr/share/gems/gems/rbvmomi-2.2.0/lib/rbvmomi/vim/Task.rb:14:in `wait_for_completion'
/opt/theforeman/tfm/root/usr/share/gems/gems/fog-vsphere-3.4.0/lib/fog/vsphere/requests/compute/create_vm.rb:48:in `create_vm_on_datastore'
/opt/theforeman/tfm/root/usr/share/gems/gems/fog-vsphere-3.4.0/lib/fog/vsphere/requests/compute/create_vm.rb:40:in `create_vm'
/opt/theforeman/tfm/root/usr/share/gems/gems/fog-vsphere-3.4.0/lib/fog/vsphere/models/compute/server.rb:302:in `save'
/usr/share/foreman/app/models/compute_resources/foreman/model/vmware.rb:489:in `create_vm'
/usr/share/foreman/app/models/concerns/orchestration/compute.rb:91:in `setCompute'
/usr/share/foreman/app/models/concerns/orchestration.rb:227:in `execute'
/usr/share/foreman/app/models/concerns/orchestration.rb:152:in `block in process'
/usr/share/foreman/app/models/concerns/orchestration.rb:144:in `each'
/usr/share/foreman/app/models/concerns/orchestration.rb:144:in `process'
/usr/share/foreman/app/models/concerns/orchestration.rb:44:in `around_save_orchestration'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:139:in `run_callbacks'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:825:in `_run_save_callbacks'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/callbacks.rb:327:in `create_or_update'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/timestamp.rb:128:in `create_or_update'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/persistence.rb:470:in `save'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/validations.rb:47:in `save'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/transactions.rb:314:in `block in save'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/transactions.rb:375:in `block in with_transaction_returning_status'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/connection_adapters/abstract/database_statements.rb:280:in `block in transaction'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/connection_adapters/abstract/transaction.rb:280:in `block in within_new_transaction'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/concurrency/load_interlock_aware_monitor.rb:26:in `block (2 levels) in synchronize'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `handle_interrupt'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/concurrency/load_interlock_aware_monitor.rb:25:in `block in synchronize'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `handle_interrupt'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/concurrency/load_interlock_aware_monitor.rb:21:in `synchronize'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/connection_adapters/abstract/transaction.rb:278:in `within_new_transaction'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/connection_adapters/abstract/database_statements.rb:280:in `transaction'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/transactions.rb:212:in `transaction'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/transactions.rb:366:in `with_transaction_returning_status'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/transactions.rb:314:in `save'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/suppressor.rb:44:in `save'
/usr/share/foreman/app/models/concerns/foreman/sti.rb:26:in `save'
/usr/share/foreman/app/controllers/hosts_controller.rb:98:in `create'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_controller/metal/basic_implicit_render.rb:6:in `send_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/abstract_controller/base.rb:195:in `process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_controller/metal/rendering.rb:30:in `process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/abstract_controller/callbacks.rb:42:in `block in process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:112:in `block in run_callbacks'
/usr/share/foreman/app/controllers/concerns/foreman/controller/timezone.rb:10:in `set_timezone'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/usr/share/foreman/app/models/concerns/foreman/thread_session.rb:32:in `clear_thread'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/usr/share/foreman/app/controllers/concerns/foreman/controller/topbar_sweeper.rb:12:in `set_topbar_sweeper_controller'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/opt/theforeman/tfm/root/usr/share/gems/gems/audited-4.9.0/lib/audited/sweeper.rb:14:in `around'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/opt/theforeman/tfm/root/usr/share/gems/gems/audited-4.9.0/lib/audited/sweeper.rb:14:in `around'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:121:in `block in run_callbacks'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:139:in `run_callbacks'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/abstract_controller/callbacks.rb:41:in `process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_controller/metal/rescue.rb:22:in `process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_controller/metal/instrumentation.rb:33:in `block in process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/notifications.rb:180:in `block in instrument'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/notifications/instrumenter.rb:24:in `instrument'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/notifications.rb:180:in `instrument'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_controller/metal/instrumentation.rb:32:in `process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_controller/metal/params_wrapper.rb:245:in `process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/activerecord-6.0.3.4/lib/active_record/railties/controller_runtime.rb:27:in `process_action'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/abstract_controller/base.rb:136:in `process'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionview-6.0.3.4/lib/action_view/rendering.rb:39:in `process'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_controller/metal.rb:190:in `dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_controller/metal.rb:254:in `dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/routing/route_set.rb:50:in `dispatch'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/routing/route_set.rb:33:in `serve'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/journey/router.rb:49:in `block in serve'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/journey/router.rb:32:in `each'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/journey/router.rb:32:in `serve'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/routing/route_set.rb:834:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/apipie-dsl-2.3.0/lib/apipie_dsl/static_dispatcher.rb:67:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/static_dispatcher.rb:66:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/extractor/recorder.rb:137:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/static.rb:126:in `call'
/usr/share/foreman/lib/foreman/middleware/telemetry.rb:10:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/apipie-rails-0.5.17/lib/apipie/middleware/checksum_in_headers.rb:27:in `call'
/usr/share/foreman/lib/foreman/middleware/catch_json_parse_errors.rb:9:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/tempfile_reaper.rb:15:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/etag.rb:27:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/conditional_get.rb:40:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/head.rb:12:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/http/content_security_policy.rb:18:in `call'
/usr/share/foreman/lib/foreman/middleware/logging_context_session.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/session/abstract/id.rb:266:in `context'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/session/abstract/id.rb:260:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/cookies.rb:648:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/callbacks.rb:27:in `block in call'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/callbacks.rb:101:in `run_callbacks'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/callbacks.rb:26:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/actionable_exceptions.rb:18:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/debug_exceptions.rb:32:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/show_exceptions.rb:33:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/rack/logger.rb:37:in `call_app'
/opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/rack/logger.rb:28:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/sprockets-rails-3.2.1/lib/sprockets/rails/quiet_assets.rb:13:in `call'
/usr/share/foreman/lib/foreman/middleware/logging_context_request.rb:11:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/remote_ip.rb:81:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/request_id.rb:27:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/method_override.rb:24:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/runtime.rb:22:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/activesupport-6.0.3.4/lib/active_support/cache/strategy/local_cache_middleware.rb:29:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/executor.rb:14:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/static.rb:126:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/sendfile.rb:110:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/actionpack-6.0.3.4/lib/action_dispatch/middleware/host_authorization.rb:76:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/secure_headers-6.3.0/lib/secure_headers/middleware.rb:11:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/engine.rb:527:in `call'
/opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/railtie.rb:190:in `public_send'
/opt/theforeman/tfm/root/usr/share/gems/gems/railties-6.0.3.4/lib/rails/railtie.rb:190:in `method_missing'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/urlmap.rb:74:in `block in call'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/urlmap.rb:58:in `each'
/opt/theforeman/tfm/root/usr/share/gems/gems/rack-2.2.3/lib/rack/urlmap.rb:58:in `call'
/usr/share/passenger/phusion_passenger/rack/thread_handler_extension.rb:74:in `process_request'
/usr/share/passenger/phusion_passenger/request_handler/thread_handler.rb:141:in `accept_and_process_next_request'
/usr/share/passenger/phusion_passenger/request_handler/thread_handler.rb:109:in `main_loop'
/usr/share/passenger/phusion_passenger/request_handler.rb:455:in `block (3 levels) in start_threads'
/opt/theforeman/tfm/root/usr/share/gems/gems/logging-2.3.0/lib/logging/diagnostic_context.rb:474:in `block in create_with_logging_context'
2020-12-15T19:23:00 [W|app|bab8dc2a] Rolling back due to a problem: [#<Orchestration::Task:0x00007f5fef0772f8 @name="Set up compute instance test-instance.test.com", @id="Set up compute instance test-instance.test.com", @status="failed", @priority=3, @action=[#<Host::Managed id: nil, name: "test-instance.test.com", last_compile: nil, last_report: nil, updated_at: nil, created_at: nil, root_pass: [FILTERED], architecture_id: 1, operatingsystem_id: 14, environment_id: 1, ptable_id: 114, medium_id: 1, build: true, comment: "", disk: "", installed_at: nil, model_id: nil, hostgroup_id: 29, owner_id: 5, owner_type: "User", enabled: true, puppet_ca_proxy_id: 1, managed: true, use_image: nil, image_file: nil, uuid: nil, compute_resource_id: 2, puppet_proxy_id: 1, certname: nil, image_id: nil, organization_id: 1, location_id: 2, type: "Host::Managed", otp: nil, realm_id: nil, compute_profile_id: 4, provision_method: "build", grub_pass: "$5$QVtVwdYjxaOnX5uR$U3PrcKppHOEbapBpU0QWJLTgEgQdxk...", global_status: 0, lookup_value_matcher: [FILTERED], pxe_loader: "", initiated_at: nil, build_errors: nil>, :setCompute], @created=1608060179.6241944, @timestamp=2020-12-15 19:23:00 UTC>]
2020-12-15T19:23:00 [I|app|bab8dc2a] Processed 1 tasks from queue 'Host::Managed Main', completed 0/3
2020-12-15T19:23:00 [E|app|bab8dc2a] Task 'Set up compute instance test-instance.test.com' *failed*
2020-12-15T19:23:00 [E|app|bab8dc2a] Task 'Query instance details for test-instance.test.com' *canceled*
2020-12-15T19:23:00 [E|app|bab8dc2a] Task 'Power up compute instance test-instance.test.com' *canceled*
2020-12-15T19:23:00 [E|app|bab8dc2a] Failed to save: Failed to create a compute vsphere-test (VMware) instance test-instance.test.com: InvalidArgument: A specified parameter was not correct: 
2020-12-15T19:23:00 [I|app|bab8dc2a]   Rendering hosts/new.html.erb within layouts/application
2020-12-15T19:23:00 [I|app|bab8dc2a]   Rendered hosts/_progress.html.erb (Duration: 0.1ms | Allocations: 59)
2020-12-15T19:23:00 [I|app|bab8dc2a]   Rendered hosts/puppet/_main_tab_fields.html.erb (Duration: 6.5ms | Allocations: 2473)
2020-12-15T19:23:00 [I|app|bab8dc2a]   Rendered collection of puppetclasses/_selectedClasses.html.erb [0 times] (Duration: 0.0ms | Allocations: 3)
2020-12-15T19:23:00 [I|app|bab8dc2a]   Rendered collection of puppetclasses/_classes_in_groups.html.erb [0 times] (Duration: 0.0ms | Allocations: 3)
2020-12-15T19:23:01 [I|app|bab8dc2a]   Rendered puppetclasses/_classes.html.erb (Duration: 169.1ms | Allocations: 152493)
2020-12-15T19:23:01 [I|app|bab8dc2a]   Rendered puppetclasses/_class_selection.html.erb (Duration: 270.7ms | Allocations: 198137)
2020-12-15T19:23:01 [I|app|bab8dc2a]   Rendered hosts/puppet/_puppet_classes_tab.html.erb (Duration: 271.4ms | Allocations: 198238)
2020-12-15T19:23:01 [I|app|bab8dc2a]   Rendered nic/_base_form.html.erb (Duration: 29.5ms | Allocations: 19982)
2020-12-15T19:23:01 [I|app|bab8dc2a]   Rendered nic/_virtual_form.html.erb (Duration: 0.6ms | Allocations: 862)
2020-12-15T19:23:01 [I|app|bab8dc2a] Loaded compute resource data for networks in 0.277003918 seconds
2020-12-15T19:23:01 [I|app|bab8dc2a]   Rendered compute_resources_vms/form/vmware/_network.html.erb (Duration: 277.9ms | Allocations: 19031)
2020-12-15T19:23:01 [I|app|bab8dc2a]   Rendered nic/_provider_specific_form.html.erb (Duration: 278.7ms | Allocations: 19636)
2020-12-15T19:23:01 [I|app|bab8dc2a]   Rendered nic/manageds/_managed.html.erb (Duration: 309.8ms | Allocations: 41225)
2020-12-15T19:23:01 [I|app|bab8dc2a]   Rendered nic/_base_form.html.erb (Duration: 25.8ms | Allocations: 19503)
2020-12-15T19:23:01 [I|app|bab8dc2a]   Rendered nic/_virtual_form.html.erb (Duration: 0.6ms | Allocations: 859)
2020-12-15T19:23:01 [I|app|bab8dc2a] Loaded compute resource data for networks in 0.281567588 seconds
2020-12-15T19:23:01 [I|app|bab8dc2a]   Rendered compute_resources_vms/form/vmware/_network.html.erb (Duration: 282.6ms | Allocations: 19009)
2020-12-15T19:23:01 [I|app|bab8dc2a]   Rendered nic/_provider_specific_form.html.erb (Duration: 283.4ms | Allocations: 19611)
2020-12-15T19:23:01 [I|app|bab8dc2a]   Rendered nic/manageds/_managed.html.erb (Duration: 310.9ms | Allocations: 40710)
2020-12-15T19:23:01 [I|app|bab8dc2a]   Rendered hosts/_interfaces.html.erb (Duration: 621.8ms | Allocations: 82405)
2020-12-15T19:23:02 [I|app|bab8dc2a] Loaded compute resource data for cluster-QA in 0.452486833 seconds
2020-12-15T19:23:02 [I|app|bab8dc2a] Loaded compute resource data for resource_pools-QA in 0.607400486 seconds
2020-12-15T19:23:03 [I|app|bab8dc2a] Loaded compute resource data for folders in 0.222720467 seconds
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered compute_resources_vms/form/vmware/_base.html.erb (Duration: 1308.7ms | Allocations: 147472)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered compute_resources_vms/form/_volumes.html.erb (Duration: 0.1ms | Allocations: 47)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered hosts/_compute_detail.html.erb (Duration: 1309.4ms | Allocations: 147694)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered hosts/_compute.html.erb (Duration: 1310.7ms | Allocations: 148489)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered common/os_selection/_architecture.html.erb (Duration: 5.8ms | Allocations: 1989)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered common/os_selection/_pxe_loader.html.erb (Duration: 5.4ms | Allocations: 2272)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered common/os_selection/_operatingsystem.html.erb (Duration: 31.5ms | Allocations: 11280)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered hosts/provision_method/build/_form.html.erb (Duration: 32.6ms | Allocations: 11947)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered hosts/provision_method/image/_form.html.erb (Duration: 0.1ms | Allocations: 11)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered hosts/_operating_system.html.erb (Duration: 42.7ms | Allocations: 15605)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered hosts/_unattended.html.erb (Duration: 1353.8ms | Allocations: 164243)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered collection of puppetclasses/_class_parameters.html.erb [3 times] (Duration: 7.6ms | Allocations: 2618)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered puppetclasses/_classes_parameters.html.erb (Duration: 23.0ms | Allocations: 8202)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered common_parameters/_inherited_parameters.html.erb (Duration: 1.3ms | Allocations: 932)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered common_parameters/_parameter.html.erb (Duration: 1.6ms | Allocations: 982)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered common_parameters/_parameters.html.erb (Duration: 3.5ms | Allocations: 1839)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered hosts/_form.html.erb (Duration: 2377.4ms | Allocations: 493640)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered hosts/new.html.erb within layouts/application (Duration: 2378.4ms | Allocations: 493824)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered layouts/_application_content.html.erb (Duration: 2.2ms | Allocations: 737)
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendering layouts/base.html.erb
2020-12-15T19:23:03 [I|app|bab8dc2a]   Rendered layouts/base.html.erb (Duration: 37.4ms | Allocations: 28499)
2020-12-15T19:23:03 [I|app|bab8dc2a] Completed 200 OK in 3900ms (Views: 2374.9ms | ActiveRecord: 80.9ms | Allocations: 645139)