Problem:
When building a VMware host, the virtual machine is destroyed after it is created due to Foreman attempting to “Reconfigure Virtual Machine” after the virtual machine has been powered.
Expected outcome:
The virtual machine is fully configured before power on.
Foreman and Proxy versions:
Foreman and Proxies 3.13.0
Foreman and Proxy plugin versions:
Distribution and version:
Rocky 9, Vcenter 8u2
Other relevant data:
Provisioning VMware host started failing. It has been working as expected until recently. Famous last words of “Nothing has changed” somewhat apply. Foreman/Proxies have not had software updates, nor has VCenter. The only configuration change was using Hammer to update compute profiles.
When building the host, the logs on VCenter show Foreman creates the VM, powers on the VM, attempts reconfigure the VM, powers off the VM, destroys the VM.
Foreman log states, “Failed to update a compute VCenter (VMware) instance myhost.local.domain: InvalidPowerState: The attempted operation cannot be performed in the current state (Powered on).”
A workaround is to not power on the VM during the host creation and then manually power on the VM, which works as expected.
Pointers on what may have changed and how to resolve this issue is greatly appreciated.
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Processing by HostsController#create as */*
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Parameters: {"authenticity_token"=>"jd5whHkumasR7Or6o7qMP4FB8V8qfWJZmc5P5c3xCPFBYYWOOsOYB4pRLLVF1t5rOnxqDRAyTgc2jcGzu1YMWw", "host"=>{"salt_module_ids"=>[""], "name"=>"nikki-rattner", "organization_id"=>"23", "location_id"=>"14", "hostgroup_id"=>"2", "salt_environment_id"=>"2", "salt_proxy_id"=>"4", "managed"=>"true", "progress_report_id"=>"[FILTERED]", "type"=>"Host::Managed", "interfaces_attributes"=>{"0"=>{"_destroy"=>"0", "type"=>"Nic::Managed", "identifier"=>"", "name"=>"nikki-rattner", "domain_id"=>"7", "subnet_id"=>"11", "ip"=>"10.0.81.97", "ip6"=>"", "managed"=>"1", "primary"=>"1", "provision"=>"1", "execution"=>"1", "virtual"=>"0", "tag"=>"", "attached_to"=>"", "compute_attributes"=>{"type"=>"VirtualVmxnet3", "network"=>"dvportgroup-7577"}}}, "compute_attributes"=>{"cpus"=>"1", "corespersocket"=>"2", "memory_mb"=>"2560", "firmware"=>"bios", "cluster"=>"DEVCL02", "resource_pool"=>"Resources", "path"=>"/Datacenters/DC1/vm/my-domain.com", "guest_id"=>"rockylinux_64Guest", "hardware_version"=>"Default", "memoryHotAddEnabled"=>"0", "cpuHotAddEnabled"=>"0", "add_cdrom"=>"0", "boot_order"=>["network", "disk"], "start"=>"1", "annotation"=>"", "controllers"=>"{\"controllers\":[{\"type\":\"ParaVirtualSCSIController\",\"key\":1000}],\"volumes\":[{\"thin\":true,\"name\":\"Hard disk\",\"mode\":\"persistent\",\"sizeGb\":20,\"controllerKey\":1000,\"storagePod\":null,\"datastore\":\"vsan_dev\"}]}"}, "architecture_id"=>"5", "operatingsystem_id"=>"16", "provision_method"=>"build", "build"=>"1", "medium_id"=>"70", "ptable_id"=>"809", "pxe_loader"=>"PXELinux BIOS", "disk"=>"", "root_pass"=>"[FILTERED]", "is_owned_by"=>"22-Users", "enabled"=>"1", "comment"=>"", "overwrite"=>"false"}}
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Current location set to none
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Current organization set to none
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Building token starting with 242d1c SHA256:7cff6a07580b91ee0daad977a2dd7bd4f74aac95927c6c3fb4b08abeb636afc9
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Scheduling new DHCP reservations for nikki-rattner.my-domain.com
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Enqueued task 'dhcp_create_10.0.81.97' to 'Host::Managed Main' queue
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Scheduling new DNS entries
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Enqueued task 'Create IPv4 DNS record for nikki-rattner.my-domain.com' to 'Host::Managed Main' queue
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Enqueued task 'Create Reverse IPv4 DNS record for nikki-rattner.my-domain.com' to 'Host::Managed Main' queue
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Current organization set to Development
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Current location set to my-domain.com
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Current location set to none
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Current organization set to none
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Enqueued task 'Deploy TFTP PXELinux config for nikki-rattner.my-domain.com' to 'Host::Managed Main' queue
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Enqueued task 'Deploy TFTP PXEGrub2 config for nikki-rattner.my-domain.com' to 'Host::Managed Main' queue
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Enqueued task 'Deploy TFTP PXEGrub config for nikki-rattner.my-domain.com' to 'Host::Managed Main' queue
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Enqueued task 'Deploy TFTP iPXE config for nikki-rattner.my-domain.com' to 'Host::Managed Main' queue
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Enqueued task 'Fetch TFTP boot files for nikki-rattner.my-domain.com' to 'Host::Managed Main' queue
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Scheduling new IP reservation(s) in external IPAM for nikki-rattner.my-domain.com
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Enqueued task 'external_ipam_create_10.0.81.97_IPv4' to 'Host::Managed Main' queue
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Enqueued task 'Set up compute instance nikki-rattner.my-domain.com' to 'Host::Managed Main' queue
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Enqueued task 'Query instance details for nikki-rattner.my-domain.com' to 'Host::Managed Main' queue
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Enqueued task 'Power up compute instance nikki-rattner.my-domain.com' to 'Host::Managed Main' queue
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Processing task 'Set up compute instance nikki-rattner.my-domain.com' from 'Host::Managed Main'
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Adding Compute instance for nikki-rattner.my-domain.com
Apr 29 20:49:11 foreman.my-domain.com foreman[1255785]: Reading from compute resource cache: networks
Apr 29 20:49:12 foreman.my-domain.com foreman[1255785]: Processing task 'Query instance details for nikki-rattner.my-domain.com' from 'Host::Managed Main'
Apr 29 20:49:12 foreman.my-domain.com foreman[1255785]: Orchestration::Compute: Trying to match network interfaces from fog <Fog::Vsphere::Compute::Interfaces
0e7474a0 | server_id="5022a707-44fd-9ebf-ddc8-e9f15390b23b"
0e7474a0 | [
0e7474a0 | <Fog::Vsphere::Compute::Interface
0e7474a0 | mac="00:50:56:a2:0b:88",
0e7474a0 | network="dvportgroup-7577",
0e7474a0 | name="Network adapter 1",
0e7474a0 | status="untried",
0e7474a0 | connected=false,
0e7474a0 | summary="DVSwitch: 50 22 af cd e6 99 5b a1-1a 5f 18 60 73 9a db 42",
0e7474a0 | type=RbVmomi::VIM::VirtualVmxnet3,
0e7474a0 | key=4000,
0e7474a0 | virtualswitch=nil,
0e7474a0 | server_id="5022a707-44fd-9ebf-ddc8-e9f15390b23b"
0e7474a0 | >
0e7474a0 | ]
0e7474a0 | >
Apr 29 20:49:12 foreman.my-domain.com foreman[1255785]: Orchestration::Compute: nic #<Nic::Managed id: nil, mac: nil, ip: "10.0.81.97", type: "Nic::Managed", name: "nikki-rattner.my-domain.com", host_id: nil, subnet_id: 11, domain_id: 7, attrs: {}, created_at: nil, updated_at: nil, provider: nil, username: nil, password: nil, virtual: false, link: true, identifier: "", tag: "", attached_to: "", managed: true, mode: "balance-rr", attached_devices: "", bond_options: "", primary: true, provision: true, compute_attributes: {"type"=>"VirtualVmxnet3", "network"=>"dvportgroup-7577"}, execution: true, ip6: "", subnet6_id: nil> assigned to <Fog::Vsphere::Compute::Interface
0e7474a0 | mac="00:50:56:a2:0b:88",
0e7474a0 | network="dvportgroup-7577",
0e7474a0 | name="Network adapter 1",
0e7474a0 | status="untried",
0e7474a0 | connected=false,
0e7474a0 | summary="DVSwitch: 50 22 af cd e6 99 5b a1-1a 5f 18 60 73 9a db 42",
0e7474a0 | type=RbVmomi::VIM::VirtualVmxnet3,
0e7474a0 | key=4000,
0e7474a0 | virtualswitch=nil,
0e7474a0 | server_id="5022a707-44fd-9ebf-ddc8-e9f15390b23b"
0e7474a0 | >
Apr 29 20:49:12 foreman.my-domain.com foreman[1255785]: Processing task 'Create DHCP Settings for nikki-rattner.my-domain.com' from 'Host::Managed Main'
Apr 29 20:49:12 foreman.my-domain.com foreman[1255785]: Create DHCP reservation nikki-rattner.my-domain.com for nikki-rattner.my-domain.com-00:50:56:a2:0b:88/10.0.81.97
Apr 29 20:49:12 foreman.my-domain.com foreman[1255785]: DHCP reservation on net 10.0.81.0 with attrs: {:hostname=>"nikki-rattner.my-domain.com", :mac=>"00:50:56:a2:0b:88", :ip=>"10.0.81.97", :network=>"10.0.81.0", :nextServer=>"10.0.80.8", :filename=>"pxelinux.0", :name=>"nikki-rattner.my-domain.com", :related_macs=>[]}
Apr 29 20:49:12 foreman.my-domain.com foreman[1255785]: Processing task 'Create IPv4 DNS record for nikki-rattner.my-domain.com' from 'Host::Managed Main'
Apr 29 20:49:12 foreman.my-domain.com foreman[1255785]: Add DNS A record for nikki-rattner.my-domain.com/10.0.81.97
Apr 29 20:49:12 foreman.my-domain.com foreman[1255785]: Processing task 'Create Reverse IPv4 DNS record for nikki-rattner.my-domain.com' from 'Host::Managed Main'
Apr 29 20:49:12 foreman.my-domain.com foreman[1255785]: Add DNS PTR record for 10.0.81.97/nikki-rattner.my-domain.com
Apr 29 20:49:12 foreman.my-domain.com foreman[1255785]: Processing task 'Creating IPv4 in External IPAM for nikki-rattner.my-domain.com' from 'Host::Managed Main'
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Processing task 'Deploy TFTP PXELinux config for nikki-rattner.my-domain.com' from 'Host::Managed Main'
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Current organization set to Development
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Current location set to my-domain.com
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Current location set to none
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Current organization set to none
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Deploying TFTP PXELinux configuration for nikki-rattner.my-domain.com
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Processing task 'Deploy TFTP PXEGrub2 config for nikki-rattner.my-domain.com' from 'Host::Managed Main'
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Current organization set to Development
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Current location set to my-domain.com
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Current location set to none
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Current organization set to none
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Skipping TFTP PXEGrub2 configuration for nikki-rattner.my-domain.com
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Processing task 'Deploy TFTP PXEGrub config for nikki-rattner.my-domain.com' from 'Host::Managed Main'
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Current organization set to Development
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Current location set to my-domain.com
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Current location set to none
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Current organization set to none
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Skipping TFTP PXEGrub configuration for nikki-rattner.my-domain.com
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Processing task 'Deploy TFTP iPXE config for nikki-rattner.my-domain.com' from 'Host::Managed Main'
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Current organization set to Development
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Current location set to my-domain.com
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Current location set to none
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Current organization set to none
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Deploying TFTP iPXE configuration for nikki-rattner.my-domain.com
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Processing task 'Fetch TFTP boot files for nikki-rattner.my-domain.com' from 'Host::Managed Main'
Apr 29 20:49:14 foreman.my-domain.com foreman[1255785]: Fetching required TFTP boot files for nikki-rattner.my-domain.com
Apr 29 20:49:15 foreman.my-domain.com foreman[1255785]: Processing task 'Power up compute instance nikki-rattner.my-domain.com' from 'Host::Managed Main'
Apr 29 20:49:15 foreman.my-domain.com foreman[1255785]: Powering up Compute instance for nikki-rattner.my-domain.com
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Processed 12 tasks from queue 'Host::Managed Main', completed 12/12
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Task 'Set up compute instance nikki-rattner.my-domain.com' *completed*
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Task 'Query instance details for nikki-rattner.my-domain.com' *completed*
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Task 'Create DHCP Settings for nikki-rattner.my-domain.com' *completed*
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Task 'Create IPv4 DNS record for nikki-rattner.my-domain.com' *completed*
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Task 'Create Reverse IPv4 DNS record for nikki-rattner.my-domain.com' *completed*
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Task 'Creating IPv4 in External IPAM for nikki-rattner.my-domain.com' *completed*
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Task 'Deploy TFTP PXELinux config for nikki-rattner.my-domain.com' *completed*
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Task 'Deploy TFTP PXEGrub2 config for nikki-rattner.my-domain.com' *completed*
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Task 'Deploy TFTP PXEGrub config for nikki-rattner.my-domain.com' *completed*
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Task 'Deploy TFTP iPXE config for nikki-rattner.my-domain.com' *completed*
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Task 'Fetch TFTP boot files for nikki-rattner.my-domain.com' *completed*
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Task 'Power up compute instance nikki-rattner.my-domain.com' *completed*
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on mac 00:50:56:a2:0b:88
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on ip 10.0.81.97
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on type Nic::Managed
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on name nikki-rattner.my-domain.com
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on host_id 709
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on subnet_id 11
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on domain_id 7
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on attrs {}
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on provider
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on username
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on password [redacted]
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on virtual false
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on link true
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on identifier
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on tag
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on attached_to
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on managed true
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on mode balance-rr
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on attached_devices
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on bond_options
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on primary true
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on provision true
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on compute_attributes {"type"=>"VirtualVmxnet3", "network"=>"dvportgroup-7577"}
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on execution true
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on ip6
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Nic::Managed (930) create event on subnet6_id
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on name nikki-rattner.my-domain.com
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on root_pass
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on architecture_id 5
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on operatingsystem_id 16
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on ptable_id 809
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on medium_id 70
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on build true
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on comment
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on disk
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on installed_at
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on model_id
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on hostgroup_id 2
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on owner_id 22
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on owner_type User
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on enabled true
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on puppet_ca_proxy_id
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on managed true
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on use_image
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on image_file
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on uuid 5022a707-44fd-9ebf-ddc8-e9f15390b23b
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on compute_resource_id 1
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on puppet_proxy_id
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on certname
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on image_id
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on organization_id 23
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on location_id 14
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on otp
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on realm_id
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on compute_profile_id 26
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on provision_method build
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on salt_proxy_id 4
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on grub_pass
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on salt_environment_id 2
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on pxe_loader PXELinux BIOS
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on rescue_mode false
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on initiated_at
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on build_errors
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on salt_autosign_key
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on salt_status
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Host::Base (709) create event on creator_id 22
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Observed after_build hook on nikki-rattner.my-domain.com
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Running 1 hooks for Host::Managed#after_build
Apr 29 20:49:16 foreman.my-domain.com foreman[1255785]: Running hook: /usr/share/foreman/config/hooks/host/managed/after_build/50-foreman-salt-event-trigger after_build nikki-rattner.my-domain.com
Apr 29 20:49:17 foreman.my-domain.com foreman[1255785]: Remove salt key for host nikki-rattner.my-domain.com
Apr 29 20:49:18 foreman.my-domain.com foreman[1255785]: Create salt autosign key for host nikki-rattner.my-domain.com
Apr 29 20:49:18 foreman.my-domain.com foreman[1255785]: Reading from compute resource cache: networks
Apr 29 20:49:18 foreman.my-domain.com foreman[1255785]: Scheduling compute instance update because corespersocket changed it's value from '1' (Integer) to '2' (String)
Apr 29 20:49:18 foreman.my-domain.com foreman[1255785]: Detected a change is required for compute resource
Apr 29 20:49:18 foreman.my-domain.com foreman[1255785]: Enqueued task 'Compute resource update for nikki-rattner.my-domain.com' to 'Host::Managed Main' queue
Apr 29 20:49:18 foreman.my-domain.com foreman[1255785]: Comparing ["00:50:56:a2:0b:88", "10.0.81.97", "10.0.81.0"] == ["00:50:56:a2:0b:88", "10.0.81.97", "10.0.81.0"]
Apr 29 20:49:18 foreman.my-domain.com foreman[1255785]: Comparing ["00:50:56:a2:0b:88", "10.0.81.97", "10.0.81.0"] == ["00:50:56:a2:0b:88", "10.0.81.97", "10.0.81.0"]
Apr 29 20:49:18 foreman.my-domain.com foreman[1255785]: Current organization set to Development
Apr 29 20:49:18 foreman.my-domain.com foreman[1255785]: Current location set to my-domain.com
Apr 29 20:49:18 foreman.my-domain.com foreman[1255785]: Current location set to none
Apr 29 20:49:18 foreman.my-domain.com foreman[1255785]: Current organization set to none
Apr 29 20:49:18 foreman.my-domain.com foreman[1255785]: Updating IP reservation in external IPAM for nikki-rattner.my-domain.com
Apr 29 20:49:18 foreman.my-domain.com foreman[1255785]: Processing task 'Compute resource update for nikki-rattner.my-domain.com' from 'Host::Managed Main'
Apr 29 20:49:18 foreman.my-domain.com foreman[1255785]: Update Compute instance for nikki-rattner.my-domain.com
Apr 29 20:49:19 foreman.my-domain.com foreman[1255785]: Failed to update a compute DC1 (VMware) instance nikki-rattner.my-domain.com: InvalidPowerState: The attempted operation cannot be performed in the current state (Powered on).